chrislu
							
						 
						
							
							
							
								
							
								cb1ba0275a 
								
							
								 
							
						 
						
							
							
								
								sort imports  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								vadimartynov
							
						 
						
							
							
								
								
							
							
								
							
								8aae82dd71 
								
									
								
							
								 
							
						 
						
							
							
								
								Added context for the MasterClient's methods to avoid endless loops ( #5628 )  
							
							 
							
							 
							
							
								
 
							
							
							* Added context for the MasterClient's methods to avoid endless loops
* Returned WithClient function. Added WithClientCustomGetMaster function
* Hid unused ctx arguments
* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions
* Changed the context termination check in the tryConnectToMaster function
* Added a child context to the tryConnectToMaster function
* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark 
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								25b2850e7d 
								
							
								 
							
						 
						
							
							
								
								refactor out FilerClientAccessor  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								edc87c16f9 
								
							
								 
							
						 
						
							
							
								
								balance subscribers  
							
							 
							
							 
							
							
								
 
							
							
							need to ensure the offsets are persisted 
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								cdeaaf95b4 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								554ae09f82 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								67e6051585 
								
							
								 
							
						 
						
							
							
								
								rename Coordinator to SubCoordinator  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								d5abffa42c 
								
							
								 
							
						 
						
							
							
								
								rename Balancer to PubBalancer  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3622196881 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								972e9faaa2 
								
							
								 
							
						 
						
							
							
								
								move initial assignment to rebalance logic  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								6e5075e14e 
								
							
								 
							
						 
						
							
							
								
								move read write topic config into filer client accessor  
							
							 
							
							
								
 
							
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								e7823ee967 
								
							
								 
							
						 
						
							
							
								
								retry connecting to broker leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								62397f2371 
								
							
								 
							
						 
						
							
							
								
								adjust error  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								4dc6681833 
								
							
								 
							
						 
						
							
							
								
								proxy requests to lock owner  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								f9131de43f 
								
							
								 
							
						 
						
							
							
								
								fix lock TTL  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								0a12301b3d 
								
							
								 
							
						 
						
							
							
								
								avoid too large expiration time  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								d41792461c 
								
							
								 
							
						 
						
							
							
								
								lock returns host and owner  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								d30150dde1 
								
							
								 
							
						 
						
							
							
								
								use a short-lived lock  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ac50d8a822 
								
							
								 
							
						 
						
							
							
								
								re-lock if the lock owner is not found  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								34839237ab 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								2828ccbb30 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								bc8d2a01cc 
								
							
								 
							
						 
						
							
							
								
								create local topic partition from config on filer  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ba73199174 
								
							
								 
							
						 
						
							
							
								
								reuse local partition  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								d51efddf5c 
								
							
								 
							
						 
						
							
							
								
								flush to disk  
							
							 
							
							 
							
							
								
 
							
							
							Need to do: read from disk 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								35869b5c80 
								
							
								 
							
						 
						
							
							
								
								subscriber can be notified of the assignment change when topic is just configured  
							
							 
							
							 
							
							
								
 
							
							
							Next: Subscriber needs to read by the timestamp offset. 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
								
								
							
							
								
							
								580940bf82 
								
									
								
							
								 
							
						 
						
							
							
								
								Merge accumulated changes related to message queue ( #5098 )  
							
							 
							
							 
							
							
								
 
							
							
							* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								de0b969b36 
								
							
								 
							
						 
						
							
							
								
								Revert "rename"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit 35b5264ab7 . 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								35b5264ab7 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								0361c321b4 
								
							
								 
							
						 
						
							
							
								
								add CreateTopic API  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								b18112ae10 
								
							
								 
							
						 
						
							
							
								
								fix compilation bugs during merge  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								a65088d739 
								
							
								 
							
						 
						
							
							
								
								broker report stats to balancer  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								89a1fd1751 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 4827425146 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Sep 16 15:05:38 2023 -0700
    balancer works
commit 3b50139f68 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:22:32 2023 -0700
    comments
commit 7f685ce7ba 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:20:05 2023 -0700
    adjust APIs
commit 436d99443b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 14 23:49:05 2023 -0700
    receive broker stats
commit b771fefa37 
Merge: 0a851ec00  890881037 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 13 00:03:47 2023 -0700
    Merge branch 'master' into sub
commit 0a851ec00b 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Sep 10 22:01:25 2023 -0700
    Create balancer.go
commit 39941edc0b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 7 23:55:19 2023 -0700
    add publisher shutdown
commit 875f562779 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:16:41 2023 -0700
    server side send response at least once per second
commit 984b6c54cf 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:15:29 2023 -0700
    ack interval 128
commit 2492a45499 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 22:39:46 2023 -0700
    ack interval
commit ba67e6ca29 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:50 2023 -0700
    api for sub
commit 9e4f985698 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:30 2023 -0700
    publish, benchmark
commit cb470d44df 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 1 00:36:51 2023 -0700
    can pub and sub
commit 1eb2da46d5 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:02:12 2023 -0700
    connect and publish
commit 504ae8383a 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:01:25 2023 -0700
    protoc version
commit dbcba75271 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:59:04 2023 -0700
    rename to lookup
commit c9caf33119 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:33:46 2023 -0700
    move functions
commit 4d6c18d86f 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 17:50:59 2023 -0700
    pub sub initial tests
commit 4eb8e8624d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:14:39 2023 -0700
    rename
commit 1990456670 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:13:14 2023 -0700
    sub
commit 905911853d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Aug 26 13:39:21 2023 -0700
    adjust proto 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4827425146 
								
							
								 
							
						 
						
							
							
								
								balancer works  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								436d99443b 
								
							
								 
							
						 
						
							
							
								
								receive broker stats  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4d6c18d86f 
								
							
								 
							
						 
						
							
							
								
								pub sub initial tests  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Nico D'Cotta
							
						 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								01d70c21f3 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 32f4b1a130 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:52:19 2023 -0700
    fix compilation
commit e77ad33b7c 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:46:44 2023 -0700
    pub
commit f431f30cc7 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 13:27:39 2023 -0700
    fix generic type
commit 4e9dcb1829 
Merge: 30f942580 16e3f2d52
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 12:47:14 2023 -0700
    Merge branch 'master' into pubsub
commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 11:10:58 2023 -0700
    wip
commit f8b00980bc2f3879bb43decffd9a08d842f196f2
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:35 2023 -0700
    add design document
commit 08d2bebe42a26ebc39f1542f54d99e73620727dd
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:06 2023 -0700
    minor
commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:13:49 2023 -0700
    rename 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								81fdf3651b 
								
							
								 
							
						 
						
							
							
								
								grpc connection to filer add sw-client-id header  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								e90ab4ac60 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid race conditions for OnPeerUpdate ( #3525 )  
							
							 
							
							 
							
							
								
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/3524  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								askeipx
							
						 
						
							
							
								
								
							
							
								
							
								2e78a522ab 
								
									
								
							
								 
							
						 
						
							
							
								
								remove old raft servers if they don't answer to pings for too long ( #3398 )  
							
							 
							
							 
							
							
								
 
							
							
							* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								4d08393b7c 
								
									
								
							
								 
							
						 
						
							
							
								
								filer prefer volume server in same data center ( #3405 )  
							
							 
							
							 
							
							
								
 
							
							
							* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404 
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								aa4a22ad47 
								
							
								 
							
						 
						
							
							
								
								segment serde  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								74f60f246f 
								
							
								 
							
						 
						
							
							
								
								dynamically connect to a filer  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								9f479aab98 
								
							
								 
							
						 
						
							
							
								
								allocate brokers to serve segments  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								8060fdcac5 
								
							
								 
							
						 
						
							
							
								
								remove old code  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								f25e273e32 
								
							
								 
							
						 
						
							
							
								
								display data center and rack in cluster.ps  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								68065128b8 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								87ccef72db 
								
							
								 
							
						 
						
							
							
								
								cluster.ps can list brokers  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ac66227798 
								
							
								 
							
						 
						
							
							
								
								renaming  
							
							 
							
							
								
 
							
							
						 
						3 years ago