Chris Lu
|
cc05874d06
|
Add message queue agent (#6463)
* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent
|
3 weeks ago |
chrislu
|
edc87c16f9
|
balance subscribers
need to ensure the offsets are persisted
|
9 months ago |
chrislu
|
554ae09f82
|
rename
|
9 months ago |
chrislu
|
b5099263a4
|
rename file
|
9 months ago |
chrislu
|
d5abffa42c
|
rename Balancer to PubBalancer
|
9 months ago |
chrislu
|
b1871427c3
|
persist consumer group offset
1. use one follower
2. read write consumer group offset
|
9 months ago |
chrislu
|
1b4484bf0a
|
go fmt
|
12 months ago |
chrislu
|
9ce7c482b3
|
refactor
|
1 year ago |
chrislu
|
34839237ab
|
refactor
|
1 year ago |
chrislu
|
2828ccbb30
|
refactor
|
1 year ago |
chrislu
|
35869b5c80
|
subscriber can be notified of the assignment change when topic is just configured
Next: Subscriber needs to read by the timestamp offset.
|
1 year ago |
chrislu
|
093fdc1621
|
subscriber can get assignments
|
1 year ago |
chrislu
|
e0727071c8
|
go fmt
|
1 year ago |
Chris Lu
|
580940bf82
|
Merge accumulated changes related to message queue (#5098)
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
|
1 year ago |