cb1ba0275a 
								
							
								 
							
						 
						
							
							
								
								sort imports  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								8aae82dd71 
								
									
								
							
								 
							
						 
						
							
							
								
								Added context for the MasterClient's methods to avoid endless loops ( #5628 )  
							
							
 
							
							
							* Added context for the MasterClient's methods to avoid endless loops
* Returned WithClient function. Added WithClientCustomGetMaster function
* Hid unused ctx arguments
* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions
* Changed the context termination check in the tryConnectToMaster function
* Added a child context to the tryConnectToMaster function
* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								25b2850e7d 
								
							
								 
							
						 
						
							
							
								
								refactor out FilerClientAccessor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								edc87c16f9 
								
							
								 
							
						 
						
							
							
								
								balance subscribers  
							
							
 
							
							
							need to ensure the offsets are persisted 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								cdeaaf95b4 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								554ae09f82 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								67e6051585 
								
							
								 
							
						 
						
							
							
								
								rename Coordinator to SubCoordinator  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d5abffa42c 
								
							
								 
							
						 
						
							
							
								
								rename Balancer to PubBalancer  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3622196881 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								972e9faaa2 
								
							
								 
							
						 
						
							
							
								
								move initial assignment to rebalance logic  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6e5075e14e 
								
							
								 
							
						 
						
							
							
								
								move read write topic config into filer client accessor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e7823ee967 
								
							
								 
							
						 
						
							
							
								
								retry connecting to broker leader  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								62397f2371 
								
							
								 
							
						 
						
							
							
								
								adjust error  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4dc6681833 
								
							
								 
							
						 
						
							
							
								
								proxy requests to lock owner  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f9131de43f 
								
							
								 
							
						 
						
							
							
								
								fix lock TTL  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0a12301b3d 
								
							
								 
							
						 
						
							
							
								
								avoid too large expiration time  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d41792461c 
								
							
								 
							
						 
						
							
							
								
								lock returns host and owner  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d30150dde1 
								
							
								 
							
						 
						
							
							
								
								use a short-lived lock  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ac50d8a822 
								
							
								 
							
						 
						
							
							
								
								re-lock if the lock owner is not found  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								34839237ab 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2828ccbb30 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								bc8d2a01cc 
								
							
								 
							
						 
						
							
							
								
								create local topic partition from config on filer  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ba73199174 
								
							
								 
							
						 
						
							
							
								
								reuse local partition  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d51efddf5c 
								
							
								 
							
						 
						
							
							
								
								flush to disk  
							
							
 
							
							
							Need to do: read from disk 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								35869b5c80 
								
							
								 
							
						 
						
							
							
								
								subscriber can be notified of the assignment change when topic is just configured  
							
							
 
							
							
							Next: Subscriber needs to read by the timestamp offset. 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								580940bf82 
								
									
								
							
								 
							
						 
						
							
							
								
								Merge accumulated changes related to message queue ( #5098 )  
							
							
 
							
							
							* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								de0b969b36 
								
							
								 
							
						 
						
							
							
								
								Revert "rename"  
							
							
 
							
							
							This reverts commit 35b5264ab7 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								35b5264ab7 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0361c321b4 
								
							
								 
							
						 
						
							
							
								
								add CreateTopic API  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b18112ae10 
								
							
								 
							
						 
						
							
							
								
								fix compilation bugs during merge  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a65088d739 
								
							
								 
							
						 
						
							
							
								
								broker report stats to balancer  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								89a1fd1751 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							
 
							
							
							commit 48274251463b50139f687f685ce7ba436d99443bb771fefa370a851ec008908810370a851ec00b39941edc0b875f562779984b6c54cf2492a45499ba67e6ca299e4f985698cb470d44df1eb2da46d5504ae8383adbcba75271c9caf331194d6c18d86f4eb8e8624d1990456670905911853d 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4827425146 
								
							
								 
							
						 
						
							
							
								
								balancer works  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								436d99443b 
								
							
								 
							
						 
						
							
							
								
								receive broker stats  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4d6c18d86f 
								
							
								 
							
						 
						
							
							
								
								pub sub initial tests  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								01d70c21f3 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							
 
							
							
							commit 32f4b1a130e77ad33b7cf431f30cc74e9dcb1829 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								81fdf3651b 
								
							
								 
							
						 
						
							
							
								
								grpc connection to filer add sw-client-id header  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								e90ab4ac60 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid race conditions for OnPeerUpdate ( #3525 )  
							
							
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/3524  
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2e78a522ab 
								
									
								
							
								 
							
						 
						
							
							
								
								remove old raft servers if they don't answer to pings for too long ( #3398 )  
							
							
 
							
							
							* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4d08393b7c 
								
									
								
							
								 
							
						 
						
							
							
								
								filer prefer volume server in same data center ( #3405 )  
							
							
 
							
							
							* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404 
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								aa4a22ad47 
								
							
								 
							
						 
						
							
							
								
								segment serde  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								74f60f246f 
								
							
								 
							
						 
						
							
							
								
								dynamically connect to a filer  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9f479aab98 
								
							
								 
							
						 
						
							
							
								
								allocate brokers to serve segments  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8060fdcac5 
								
							
								 
							
						 
						
							
							
								
								remove old code  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f25e273e32 
								
							
								 
							
						 
						
							
							
								
								display data center and rack in cluster.ps  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								68065128b8 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								87ccef72db 
								
							
								 
							
						 
						
							
							
								
								cluster.ps can list brokers  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ac66227798 
								
							
								 
							
						 
						
							
							
								
								renaming  
							
							
								
 
							
							
						 
						3 years ago