chrislu
b485b9695c
fix passing sub follower offset
8 months ago
chrislu
af19256dbf
skip control messages
8 months ago
chrislu
ad2b878130
fix inflight message tracker
8 months ago
chrislu
edc87c16f9
balance subscribers
need to ensure the offsets are persisted
8 months ago
chrislu
cdeaaf95b4
go fmt
8 months ago
chrislu
d40b350f54
coordinator receives unassignment ack
8 months ago
chrislu
554ae09f82
rename
8 months ago
chrislu
67e6051585
rename Coordinator to SubCoordinator
8 months ago
chrislu
d5abffa42c
rename Balancer to PubBalancer
8 months ago
chrislu
3148dec1f6
avoid concurrent processing for the same key
8 months ago
chrislu
65dd5ac6fb
fix
8 months ago
chrislu
3622196881
go fmt
8 months ago
chrislu
d218fe54fa
go fmt
8 months ago
chrislu
7a4ace5dfb
adjust logs
8 months ago
chrislu
d8ab22012a
track offset
8 months ago
chrislu
8ce2cced47
less logs
8 months ago
chrislu
c21b32dd20
logs
8 months ago
chrislu
b1871427c3
persist consumer group offset
1. use one follower
2. read write consumer group offset
8 months ago
chrislu
94742b8ace
add subscribe follower
8 months ago
chrislu
279cb2b85e
consumer acks received messages
8 months ago
chrislu
faffb2973c
adjust errors
8 months ago
chrislu
972e9faaa2
move initial assignment to rebalance logic
8 months ago
chrislu
6e5075e14e
move read write topic config into filer client accessor
8 months ago
chrislu
2142842f82
refactor
8 months ago
chrislu
53d1d2b78a
save schema when configuring topic
9 months ago
chrislu
ccdd9cd8de
refactor
9 months ago
chrislu
f37c0d0d7a
comment out println
9 months ago
chrislu
d935f70e3c
shutdown follower when leader stops
9 months ago
chrislu
f07875e8e1
send flush message to follower before shutting down logBuffer
9 months ago
chrislu
e568e742c9
renaming
9 months ago
chrislu
66a878af39
add control message to data message
9 months ago
chrislu
c9df613b6b
add publisher name for debugging
10 months ago
chrislu
0d55bddc75
logs
10 months ago
chrislu
ab9fc0ad70
simplify
10 months ago
chrislu
dab5454332
publish and send to follower
10 months ago
chrislu
059a120708
refactor
10 months ago
chrislu
7d87c1d2bb
refactor
10 months ago
chrislu
5cc94a05b9
separate goroutine to send ack to publisher
10 months ago
chrislu
17806cde2a
separate context
If using the same context, the downstream grpc would be cancelled when the parent grpc is cancelled.
10 months ago
chrislu
f67c8309d8
rename
10 months ago
chrislu
d6a066495b
adjust logs
10 months ago
chrislu
1b1b96ea1e
close local partition if no more publishers and subscribers
10 months ago
chrislu
4f5c4c3388
refactor
10 months ago
chrislu
d558a58946
refactor
10 months ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
10 months ago
chrislu
7003ce7425
publisher is able to fully send data and receive acks
still needs to close the pipes cleanly
10 months ago
chrislu
516cba7053
remove FollowInMemoryMessages
10 months ago
chrislu
a8b73296d7
fix test3
10 months ago
chrislu
8e5068fd2f
notify
10 months ago
chrislu
44ab42d03c
unnecessary
10 months ago