cc05874d06 
								
									
								
							
								 
							
						 
						
							
							
								
								Add message queue agent ( #6463 )  
							
							
 
							
							
							* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent 
							
						 
						9 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								25b2850e7d 
								
							
								 
							
						 
						
							
							
								
								refactor out FilerClientAccessor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f0b9e163a0 
								
							
								 
							
						 
						
							
							
								
								avoid nil stopChan  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								edc87c16f9 
								
							
								 
							
						 
						
							
							
								
								balance subscribers  
							
							
 
							
							
							need to ensure the offsets are persisted 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								96b326a304 
								
							
								 
							
						 
						
							
							
								
								use type ConsumerGroupInstanceId  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								37d1ee562d 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d40b350f54 
								
							
								 
							
						 
						
							
							
								
								coordinator receives unassignment ack  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d5abffa42c 
								
							
								 
							
						 
						
							
							
								
								rename Balancer to PubBalancer  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2190d59bc3 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
 
							
							
							ToDo
1. handle unassignment on client side
2. get notified of completed unassignment
3. in consumer_group.go, balance and send unassignment 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3622196881 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c6db3f31a1 
								
							
								 
							
						 
						
							
							
								
								start consuming ASAP  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b1871427c3 
								
							
								 
							
						 
						
							
							
								
								persist consumer group offset  
							
							
 
							
							
							1. use one follower
2. read write consumer group offset 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								759a8e50cf 
								
							
								 
							
						 
						
							
							
								
								remove logs  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								972e9faaa2 
								
							
								 
							
						 
						
							
							
								
								move initial assignment to rebalance logic  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6e5075e14e 
								
							
								 
							
						 
						
							
							
								
								move read write topic config into filer client accessor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ac63f2b5a1 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								844a1a0192 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								372bd8d71d 
								
							
								 
							
						 
						
							
							
								
								consumer instance passing MaxPartitionCount to coordinator  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								205d2285f3 
								
							
								 
							
						 
						
							
							
								
								setup follower by publisher  
							
							
 
							
							
							* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages. 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1b4484bf0a 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f750a5e03b 
								
							
								 
							
						 
						
							
							
								
								passing timestamp  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								35869b5c80 
								
							
								 
							
						 
						
							
							
								
								subscriber can be notified of the assignment change when topic is just configured  
							
							
 
							
							
							Next: Subscriber needs to read by the timestamp offset. 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2845230329 
								
							
								 
							
						 
						
							
							
								
								passing broker into the assignments  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								093fdc1621 
								
							
								 
							
						 
						
							
							
								
								subscriber can get assignments  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c950a40aad 
								
							
								 
							
						 
						
							
							
								
								subscriber keep connected to the balancer  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e0727071c8 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								580940bf82 
								
									
								
							
								 
							
						 
						
							
							
								
								Merge accumulated changes related to message queue ( #5098 )  
							
							
 
							
							
							* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment 
							
						 
						2 years ago