chrislu
4f5c4c3388
refactor
9 months ago
chrislu
d558a58946
refactor
9 months ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
9 months ago
chrislu
7003ce7425
publisher is able to fully send data and receive acks
still needs to close the pipes cleanly
9 months ago
chrislu
516cba7053
remove FollowInMemoryMessages
9 months ago
chrislu
a8b73296d7
fix test3
9 months ago
chrislu
8e5068fd2f
notify
9 months ago
chrislu
44ab42d03c
unnecessary
9 months ago
chrislu
3f2dd8cc3e
add follower id info
9 months ago
chrislu
529fa8c4c8
go fmt
9 months ago
chrislu
1b5c547cfe
logs
9 months ago
chrislu
55714f54ab
local partition is generated or not
9 months ago
chrislu
549455c30d
streaming mode
9 months ago
chrislu
f653838f34
follower receive a hello message before actual data
the leader can ensure the follower has connected
9 months ago
chrislu
6f75a0af55
ask follower to follow
10 months ago
chrislu
e7823ee967
retry connecting to broker leader
10 months ago
chrislu
28f8f33d6a
include key in LogEntry
10 months ago
chrislu
34f2b600ac
each log function adds a "done" return parameter
10 months ago
chrislu
62397f2371
adjust error
10 months ago
chrislu
7598922b41
assign followers
10 months ago
chrislu
1b4484bf0a
go fmt
10 months ago
Chris Lu
16b4f9d9ab
subscriber find broker leader first
11 months ago
Chris Lu
656b78d1af
proxy to broker leader
11 months ago
Chris Lu
4dc6681833
proxy requests to lock owner
11 months ago
Chris Lu
f9131de43f
fix lock TTL
11 months ago
Chris Lu
0a12301b3d
avoid too large expiration time
11 months ago
chrislu
d41792461c
lock returns host and owner
11 months ago
chrislu
d30150dde1
use a short-lived lock
11 months ago
chrislu
ac50d8a822
re-lock if the lock owner is not found
11 months ago
chrislu
0b2e5ddc7c
wait 3 seconds before shutting down publish client, to wait for all messages to be received
11 months ago
chrislu
a507069d19
lock for creating local partition
11 months ago
chrislu
9e6ea80dff
read existing topic conf
11 months ago
chrislu
d40225ecd2
return the lookup results
11 months ago
chrislu
841fafd0a8
publish to input buffer
currently, the input buffer may not exist when start to publish
11 months ago
chrislu
d268fbe18a
when configure, cancel existing assignments
11 months ago
chrislu
3ff6b31d94
sub broker wait for partition
11 months ago
chrislu
2beaa2d0b3
pub/sub brokers check filer for assigned partitions
11 months ago
chrislu
c3f8530f97
refactor
11 months ago
chrislu
5f35857cd0
no need to assign partitions explicitly
11 months ago
chrislu
428fea45f3
updated and added assignments
11 months ago
chrislu
e8b05ecc91
add/remove assigned partitions
11 months ago
chrislu
861ad732ca
refactor
11 months ago
chrislu
47924afa1c
refactor
11 months ago
chrislu
581cf6644c
lookup reads from filer instead of local memory
11 months ago
chrislu
7121ae9617
separate out read topic conf and ensure topic active assignments
11 months ago
chrislu
c77d35313e
pub/sub broker only check local assigned partitions
11 months ago
chrislu
b0a2e9aea3
fix assignments if brokers changed
11 months ago
chrislu
a5b906c0dd
refactor
11 months ago
chrislu
34839237ab
refactor
11 months ago
chrislu
2828ccbb30
refactor
11 months ago