chrislu
d558a58946
refactor
1 year ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
1 year ago
chrislu
7003ce7425
publisher is able to fully send data and receive acks
still needs to close the pipes cleanly
1 year ago
chrislu
516cba7053
remove FollowInMemoryMessages
1 year ago
chrislu
a8b73296d7
fix test3
1 year ago
chrislu
8e5068fd2f
notify
1 year ago
chrislu
44ab42d03c
unnecessary
1 year ago
chrislu
3f2dd8cc3e
add follower id info
1 year ago
chrislu
529fa8c4c8
go fmt
1 year ago
chrislu
1b5c547cfe
logs
1 year ago
chrislu
55714f54ab
local partition is generated or not
1 year ago
chrislu
549455c30d
streaming mode
1 year ago
chrislu
f653838f34
follower receive a hello message before actual data
the leader can ensure the follower has connected
1 year ago
chrislu
6f75a0af55
ask follower to follow
1 year ago
chrislu
e7823ee967
retry connecting to broker leader
1 year ago
chrislu
28f8f33d6a
include key in LogEntry
1 year ago
chrislu
34f2b600ac
each log function adds a "done" return parameter
1 year ago
chrislu
62397f2371
adjust error
1 year ago
chrislu
7598922b41
assign followers
1 year ago
chrislu
1b4484bf0a
go fmt
1 year ago
Chris Lu
16b4f9d9ab
subscriber find broker leader first
1 year ago
Chris Lu
656b78d1af
proxy to broker leader
1 year ago
Chris Lu
4dc6681833
proxy requests to lock owner
1 year ago
Chris Lu
f9131de43f
fix lock TTL
1 year ago
Chris Lu
0a12301b3d
avoid too large expiration time
1 year ago
chrislu
d41792461c
lock returns host and owner
1 year ago
chrislu
d30150dde1
use a short-lived lock
1 year ago
chrislu
ac50d8a822
re-lock if the lock owner is not found
1 year ago
chrislu
0b2e5ddc7c
wait 3 seconds before shutting down publish client, to wait for all messages to be received
1 year ago
chrislu
a507069d19
lock for creating local partition
1 year ago
chrislu
9e6ea80dff
read existing topic conf
1 year ago
chrislu
d40225ecd2
return the lookup results
1 year ago
chrislu
841fafd0a8
publish to input buffer
currently, the input buffer may not exist when start to publish
1 year ago
chrislu
d268fbe18a
when configure, cancel existing assignments
1 year ago
chrislu
3ff6b31d94
sub broker wait for partition
1 year ago
chrislu
2beaa2d0b3
pub/sub brokers check filer for assigned partitions
1 year ago
chrislu
c3f8530f97
refactor
1 year ago
chrislu
5f35857cd0
no need to assign partitions explicitly
1 year ago
chrislu
428fea45f3
updated and added assignments
1 year ago
chrislu
e8b05ecc91
add/remove assigned partitions
1 year ago
chrislu
861ad732ca
refactor
1 year ago
chrislu
47924afa1c
refactor
1 year ago
chrislu
581cf6644c
lookup reads from filer instead of local memory
1 year ago
chrislu
7121ae9617
separate out read topic conf and ensure topic active assignments
1 year ago
chrislu
c77d35313e
pub/sub broker only check local assigned partitions
1 year ago
chrislu
b0a2e9aea3
fix assignments if brokers changed
1 year ago
chrislu
a5b906c0dd
refactor
1 year ago
chrislu
34839237ab
refactor
1 year ago
chrislu
2828ccbb30
refactor
1 year ago
chrislu
541140f735
rename
1 year ago