31922b2bf2 
								
							
								 
							
						 
						
							
							
								
								s3 to watch specific directories  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b90d92fca9 
								
							
								 
							
						 
						
							
							
								
								grpc: watch metadata changes by directory  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								21c0587900 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c8645fd232 
								
							
								 
							
						 
						
							
							
								
								master: implement grpc VolumeMarkWritable  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3657  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								12914af4d8 
								
									
								
							
								 
							
						 
						
							
							
								
								Character readability ( #3678 )  
							
							
 
							
							
							* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a8d7615eec 
								
									
								
							
								 
							
						 
						
							
							
								
								refactor(filer_client): `EachEntryFunciton` -> `EachEntryFunction` ( #3671 )  
							
							
 
							
							
							Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								721c6197f9 
								
									
								
							
								 
							
						 
						
							
							
								
								skip deltaBeat if dn is zero ( #3630 )  
							
							
 
							
							
							* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629 
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b9112747b5 
								
							
								 
							
						 
						
							
							
								
								volume server: synchronously report volume readonly status to master  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3628  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b324a6536c 
								
									
								
							
								 
							
						 
						
							
							
								
								ADHOC: add read needle meta grpc ( #3581 )  
							
							
 
							
							
							* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2e78a522ab 
								
									
								
							
								 
							
						 
						
							
							
								
								remove old raft servers if they don't answer to pings for too long ( #3398 )  
							
							
 
							
							
							* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								74b53729e1 
								
									
								
							
								 
							
						 
						
							
							
								
								feat(weed.move): add a speed limit parameter of moving files ( #3478 )  
							
							
 
							
							
							* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4573c99ae3 
								
							
								 
							
						 
						
							
							
								
								fix tests  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2b580a7566 
								
							
								 
							
						 
						
							
							
								
								also migrate jsonpb  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								eaeb141b09 
								
							
								 
							
						 
						
							
							
								
								move proto package  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4d08393b7c 
								
									
								
							
								 
							
						 
						
							
							
								
								filer prefer volume server in same data center ( #3405 )  
							
							
 
							
							
							* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404 
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fc65122766 
								
							
								 
							
						 
						
							
							
								
								rename to LoadAvg_1M  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5209ebbeef 
								
							
								 
							
						 
						
							
							
								
								remove percent  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								634bc97840 
								
							
								 
							
						 
						
							
							
								
								fix conflicts  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								afef014832 
								
							
								 
							
						 
						
							
							
								
								scaffold  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								13b9a52f80 
								
							
								 
							
						 
						
							
							
								
								fix deprecated functions  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2f0dda384d 
								
							
								 
							
						 
						
							
							
								
								vacuum show LA  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								de3afd4199 
								
							
								 
							
						 
						
							
							
								
								fix rebasing  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								06cd491abc 
								
							
								 
							
						 
						
							
							
								
								add message batch  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7576c244c4 
								
							
								 
							
						 
						
							
							
								
								add flatbuffer serde for message  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								aa4a22ad47 
								
							
								 
							
						 
						
							
							
								
								segment serde  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9f479aab98 
								
							
								 
							
						 
						
							
							
								
								allocate brokers to serve segments  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								94b8c42b2c 
								
							
								 
							
						 
						
							
							
								
								clean up  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8060fdcac5 
								
							
								 
							
						 
						
							
							
								
								remove old code  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f25e273e32 
								
							
								 
							
						 
						
							
							
								
								display data center and rack in cluster.ps  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								68065128b8 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								21b6b07dd8 
								
							
								 
							
						 
						
							
							
								
								renaming  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								64f3d6fb6e 
								
							
								 
							
						 
						
							
							
								
								metadata subscription uses client epoch  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f72f696109 
								
							
								 
							
						 
						
							
							
								
								add message batch  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7f672b37e1 
								
							
								 
							
						 
						
							
							
								
								add flatbuffer serde for message  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								113a4546fd 
								
							
								 
							
						 
						
							
							
								
								segment serde  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1112dab4f3 
								
							
								 
							
						 
						
							
							
								
								allocate brokers to serve segments  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ef93869009 
								
							
								 
							
						 
						
							
							
								
								clean up  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7db6666b97 
								
							
								 
							
						 
						
							
							
								
								remove old code  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3254f18343 
								
							
								 
							
						 
						
							
							
								
								display data center and rack in cluster.ps  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9f20d3ebd1 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5536ed85e5 
								
							
								 
							
						 
						
							
							
								
								renaming  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								449ecc8890 
								
							
								 
							
						 
						
							
							
								
								remove max connection age  
							
							
 
							
							
							related to https://github.com/chrislusf/seaweedfs/pull/3226  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								530da0cc89 
								
							
								 
							
						 
						
							
							
								
								remove unused code  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								41dfe27102 
								
							
								 
							
						 
						
							
							
								
								Revert "remove max connection age"  
							
							
 
							
							
							This reverts commit b9b684194f 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1d0c53ea56 
								
							
								 
							
						 
						
							
							
								
								remote storage: stop supporting hdfs as a remote storage  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3dd60529c5 
								
							
								 
							
						 
						
							
							
								
								some code optimizations  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								78b3728169 
								
							
								 
							
						 
						
							
							
								
								add s3 circuit breaker support for 'simultaneous request count' and 'simultaneous request bytes' limitations  
							
							
 
							
							
							configure s3 circuit breaker by 'command_s3_circuitbreaker.go':
usage eg:
# Configure the number of simultaneous global (current s3api node) requests
s3.circuit.breaker -global -type count -actions Write -values 1000 -apply
# Configure the number of simultaneous requests for bucket x read and write
s3.circuit.breaker -buckets -type count -actions Read,Write -values 1000 -apply
# Configure the total bytes of simultaneous requests for bucket write
s3.circuit.breaker -buckets -type bytes -actions Write -values 100MiB -apply
# Disable circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -enable false -apply
# Delete circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -delete -apply 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d12f431d98 
								
							
								 
							
						 
						
							
							
								
								collect volume server status  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c07820178f 
								
							
								 
							
						 
						
							
							
								
								fix s3 tests  
							
							
 
							
							
							bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter 
							
						 
						3 years ago