Tree: f833c2b2fa

Commit Graph

51 Commits (f833c2b2faa5324ec41776f9c6d66cfd505cae39)

Author	SHA1	Message	Date
chrislu	d218fe54fa	go fmt	10 months ago
chrislu	ccdd9cd8de	refactor	1 year ago
chrislu	f37c0d0d7a	comment out println	1 year ago
chrislu	f07875e8e1	send flush message to follower before shutting down logBuffer	1 year ago
chrislu	e568e742c9	renaming	1 year ago
chrislu	47975e75bf	purge old code	1 year ago
chrislu	237e68059d	shutdown follower if no clients, not only publishers to avoid overhead when a publisher repeatedly send one message and close	1 year ago
chrislu	c9df613b6b	add publisher name for debugging	1 year ago
chrislu	ca4f89a6f6	simplify	1 year ago
chrislu	0d55bddc75	logs	1 year ago
chrislu	e3c8be7f89	LocalPartition shutdown	1 year ago
chrislu	ab9fc0ad70	simplify	1 year ago
chrislu	7463058299	change visibility	1 year ago
chrislu	dab5454332	publish and send to follower	1 year ago
chrislu	f249f831b1	MaybeShutdownLocalPartition refactor	1 year ago
chrislu	2a0ab7e90d	fix	1 year ago
chrislu	059a120708	refactor	1 year ago
chrislu	7d87c1d2bb	refactor	1 year ago
chrislu	5cc94a05b9	separate goroutine to send ack to publisher	1 year ago
chrislu	f67c8309d8	rename	1 year ago
chrislu	205d2285f3	setup follower by publisher * the subscriber would getOrGen a local partition and wait * the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.	1 year ago
chrislu	6ef3e6bcad	logging	1 year ago
chrislu	8e5068fd2f	notify	1 year ago
chrislu	529fa8c4c8	go fmt	1 year ago
chrislu	64a32730a2	add size()	1 year ago
chrislu	6f75a0af55	ask follower to follow	1 year ago
chrislu	3b28433cb1	change LogBuffer visibility in LocalPartition	1 year ago
chrislu	1b4484bf0a	go fmt	1 year ago
chrislu	fdf0ea8e11	passing partition info	1 year ago
chrislu	3795d8dca8	release local topic partition if no publisher and subscribers	1 year ago
chrislu	ba73199174	reuse local partition	1 year ago
chrislu	fa59a5d67e	read from disk if not in memory	1 year ago
chrislu	45994641e9	lint	1 year ago
chrislu	6a7a679137	passing partition generation timestamp	1 year ago
chrislu	d51efddf5c	flush to disk Need to do: read from disk	1 year ago
chrislu	49428a303b	add batch index for each memory buffer	1 year ago
chrislu	093fdc1621	subscriber can get assignments	1 year ago
Chris Lu	580940bf82	Merge accumulated changes related to message queue (#5098) * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment	1 year ago
chrislu	bf13f3ced7	add subscriber coordinator	2 years ago
chrislu	734178093e	refactor TopicPartition struct	2 years ago
chrislu	23f334dd13	comment	2 years ago
chrislu	c7e05e4e71	ensure latest stats are reported	2 years ago
chrislu	1492bf7552	fix listing topics	2 years ago
chrislu	6c6655de9d	wip	2 years ago
chrislu	a65088d739	broker report stats to balancer	2 years ago
chrislu	89a1fd1751	Squashed commit of the following: commit 4827425146 Author: chrislu <chris.lu@gmail.com> Date: Sat Sep 16 15:05:38 2023 -0700 balancer works commit 3b50139f68 Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:22:32 2023 -0700 comments commit 7f685ce7ba Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:20:05 2023 -0700 adjust APIs commit 436d99443b Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 14 23:49:05 2023 -0700 receive broker stats commit b771fefa37 Merge: 0a851ec00 890881037 Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 13 00:03:47 2023 -0700 Merge branch 'master' into sub commit 0a851ec00b Author: chrislu <chris.lu@gmail.com> Date: Sun Sep 10 22:01:25 2023 -0700 Create balancer.go commit 39941edc0b Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 7 23:55:19 2023 -0700 add publisher shutdown commit 875f562779 Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:16:41 2023 -0700 server side send response at least once per second commit 984b6c54cf Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:15:29 2023 -0700 ack interval 128 commit 2492a45499 Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 22:39:46 2023 -0700 ack interval commit ba67e6ca29 Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:50 2023 -0700 api for sub commit 9e4f985698 Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:30 2023 -0700 publish, benchmark commit cb470d44df Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 1 00:36:51 2023 -0700 can pub and sub commit 1eb2da46d5 Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:02:12 2023 -0700 connect and publish commit 504ae8383a Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:01:25 2023 -0700 protoc version commit dbcba75271 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:59:04 2023 -0700 rename to lookup commit c9caf33119 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:33:46 2023 -0700 move functions commit 4d6c18d86f Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 17:50:59 2023 -0700 pub sub initial tests commit 4eb8e8624d Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:14:39 2023 -0700 rename commit 1990456670 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:13:14 2023 -0700 sub commit 905911853d Author: chrislu <chris.lu@gmail.com> Date: Sat Aug 26 13:39:21 2023 -0700 adjust proto	2 years ago
chrislu	4827425146	balancer works	2 years ago
chrislu	cb470d44df	can pub and sub	2 years ago
chrislu	1eb2da46d5	connect and publish	2 years ago
chrislu	dbcba75271	rename to lookup	2 years ago