seaweedfs

Commit Graph

Author	SHA1	Message	Date
Chris Lu	51543bbb87	Admin UI: Add message queue to admin UI (#6958 ) * add a menu item "Message Queue" * add a menu item "Message Queue" * move the "brokers" link under it. * add "topics", "subscribers". Add pages for them. * refactor * show topic details * admin display publisher and subscriber info * remove publisher and subscribers from the topic row pull down * collecting more stats from publishers and subscribers * fix layout * fix publisher name * add local listeners for mq broker and agent * render consumer group offsets * remove subscribers from left menu * topic with retention * support editing topic retention * show retention when listing topics * create bucket * Update s3_buckets_templ.go * embed the static assets into the binary fix https://github.com/seaweedfs/seaweedfs/issues/6964	4 months ago
chrislu	96632a34b1	add version to volume proto	5 months ago
Chris Lu	cc05874d06	Add message queue agent (#6463 ) * scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent	9 months ago
chrislu	ae5bd0667a	rename proto field from DestroyTime to expire_at_sec For TTL volume converted into EC volume, this change may leave the volumes staying.	1 year ago
chrislu	94742b8ace	add subscribe follower	1 year ago
chrislu	7003ce7425	publisher is able to fully send data and receive acks still needs to close the pipes cleanly	2 years ago
chrislu	516cba7053	remove FollowInMemoryMessages	2 years ago
chrislu	6f75a0af55	ask follower to follow	2 years ago
chrislu	1b4484bf0a	go fmt	2 years ago
Chris Lu	e27deed4bc	upgrade protoc	2 years ago
chrislu	ee41dbb7fc	rename functions	2 years ago
Chris Lu	580940bf82	Merge accumulated changes related to message queue (#5098 ) * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment	2 years ago
chrislu	deb86ff4a6	upgrading grpc	2 years ago
chrislu	de0b969b36	Revert "rename" This reverts commit `35b5264ab7`.	2 years ago
chrislu	35b5264ab7	rename	2 years ago
chrislu	ebd6f96d35	adjust mq.proto	2 years ago
chrislu	9d589b48e6	rename function	2 years ago
chrislu	3cf9b8d621	create topic and report topic	2 years ago
chrislu	b3f94feede	do create topic	2 years ago
chrislu	0361c321b4	add CreateTopic API	2 years ago
chrislu	89a1fd1751	Squashed commit of the following: commit `4827425146` Author: chrislu <chris.lu@gmail.com> Date: Sat Sep 16 15:05:38 2023 -0700 balancer works commit `3b50139f68` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:22:32 2023 -0700 comments commit `7f685ce7ba` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:20:05 2023 -0700 adjust APIs commit `436d99443b` Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 14 23:49:05 2023 -0700 receive broker stats commit `b771fefa37` Merge: `0a851ec00` `890881037` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 13 00:03:47 2023 -0700 Merge branch 'master' into sub commit `0a851ec00b` Author: chrislu <chris.lu@gmail.com> Date: Sun Sep 10 22:01:25 2023 -0700 Create balancer.go commit `39941edc0b` Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 7 23:55:19 2023 -0700 add publisher shutdown commit `875f562779` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:16:41 2023 -0700 server side send response at least once per second commit `984b6c54cf` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:15:29 2023 -0700 ack interval 128 commit `2492a45499` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 22:39:46 2023 -0700 ack interval commit `ba67e6ca29` Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:50 2023 -0700 api for sub commit `9e4f985698` Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:30 2023 -0700 publish, benchmark commit `cb470d44df` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 1 00:36:51 2023 -0700 can pub and sub commit `1eb2da46d5` Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:02:12 2023 -0700 connect and publish commit `504ae8383a` Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:01:25 2023 -0700 protoc version commit `dbcba75271` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:59:04 2023 -0700 rename to lookup commit `c9caf33119` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:33:46 2023 -0700 move functions commit `4d6c18d86f` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 17:50:59 2023 -0700 pub sub initial tests commit `4eb8e8624d` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:14:39 2023 -0700 rename commit `1990456670` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:13:14 2023 -0700 sub commit `905911853d` Author: chrislu <chris.lu@gmail.com> Date: Sat Aug 26 13:39:21 2023 -0700 adjust proto	2 years ago
chrislu	436d99443b	receive broker stats	2 years ago
chrislu	dbcba75271	rename to lookup	2 years ago
chrislu	1990456670	sub	2 years ago
chrislu	905911853d	adjust proto	2 years ago
chrislu	01d70c21f3	Squashed commit of the following: commit `32f4b1a130` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 22:52:19 2023 -0700 fix compilation commit `e77ad33b7c` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 22:46:44 2023 -0700 pub commit `f431f30cc7` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 13:27:39 2023 -0700 fix generic type commit `4e9dcb1829` Merge: 30f942580 16e3f2d52 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 12:47:14 2023 -0700 Merge branch 'master' into pubsub commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 11:10:58 2023 -0700 wip commit f8b00980bc2f3879bb43decffd9a08d842f196f2 Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:14:35 2023 -0700 add design document commit 08d2bebe42a26ebc39f1542f54d99e73620727dd Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:14:06 2023 -0700 minor commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:13:49 2023 -0700 rename	2 years ago
chrislu	8ec1bc2c99	remove unused cluster node leader	2 years ago
wusong	26f15d0079	Fix no more writable volumes by delay judgment (#4548 ) * fix nomore writables volumes while disk free space is sufficient by time delay * reset --------- Co-authored-by: wang wusong <wangwusong@virtaitech.com>	2 years ago
Muhammad Hallaj bin Subery	9bd422d2c9	adding support for B2 region (#4177 ) Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>	3 years ago
Guo Lei	d8cfa1552b	support enable/disable vacuum (#4087 ) * stop vacuum * suspend/resume vacuum * remove unused code * rename * rename param	3 years ago
Eric Yang	51d462f204	ADHOC: volume fsck using append at ns (#3906 ) * ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	3 years ago
chrislu	21c0587900	go fmt	3 years ago
Eric Yang	b324a6536c	ADHOC: add read needle meta grpc (#3581 ) * ADHOC: add read needle meta grpc * add test * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	3 years ago
Konstantin Lebedev	634bc97840	fix conflicts	3 years ago
chrislu	afef014832	scaffold	3 years ago
chrislu	9f479aab98	allocate brokers to serve segments	3 years ago
chrislu	94b8c42b2c	clean up	3 years ago
chrislu	8060fdcac5	remove old code	3 years ago
chrislu	68065128b8	add dc and rack	3 years ago
chrislu	21b6b07dd8	renaming	3 years ago
chrislu	5536ed85e5	renaming	3 years ago
guol-fnst	8e2426a879	revert changes of pb file orignal protoc-gen-go-grpc verion is 1.1.0	4 years ago
guol-fnst	de6aa9cce8	avoid duplicated volume directory	4 years ago
chrislu	94635e9b5c	filer: add filer group	4 years ago
Konstantin Lebedev	1e35b4929f	shell vacuum volume by collection and volume id	4 years ago
chrislu	b4be56bb3b	add timing info during ping operation	4 years ago
Konstantin Lebedev	357aa818fe	add raft shell cmds	4 years ago
chrislu	b70cb3e0b2	upgrade protoc to 3.17.3 $brew install protobuf $ protoc --version libprotoc 3.17.3 $ go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.26 $ go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@v1.1	4 years ago

3 Commits (aa438b45159a1f46363dc6161b26232d65be805f)