chrislu
d5abffa42c
rename Balancer to PubBalancer
12 months ago
chrislu
2190d59bc3
refactor
ToDo
1. handle unassignment on client side
2. get notified of completed unassignment
3. in consumer_group.go, balance and send unassignment
12 months ago
chrislu
3622196881
go fmt
12 months ago
chrislu
c6db3f31a1
start consuming ASAP
1 year ago
chrislu
b1871427c3
persist consumer group offset
1. use one follower
2. read write consumer group offset
1 year ago
chrislu
759a8e50cf
remove logs
1 year ago
chrislu
972e9faaa2
move initial assignment to rebalance logic
1 year ago
chrislu
6e5075e14e
move read write topic config into filer client accessor
1 year ago
chrislu
ac63f2b5a1
refactor
1 year ago
chrislu
844a1a0192
rename
1 year ago
chrislu
372bd8d71d
consumer instance passing MaxPartitionCount to coordinator
1 year ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
1 year ago
chrislu
1b4484bf0a
go fmt
1 year ago
chrislu
f750a5e03b
passing timestamp
1 year ago
chrislu
35869b5c80
subscriber can be notified of the assignment change when topic is just configured
Next: Subscriber needs to read by the timestamp offset.
1 year ago
chrislu
2845230329
passing broker into the assignments
1 year ago
chrislu
093fdc1621
subscriber can get assignments
1 year ago
chrislu
c950a40aad
subscriber keep connected to the balancer
1 year ago
chrislu
e0727071c8
go fmt
1 year ago
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
1 year ago