chrislu
							
						 
						
							
							
							
								
							
								c950a40aad 
								
							
								 
							
						 
						
							
							
								
								subscriber keep connected to the balancer  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
								
								
							
							
								
							
								580940bf82 
								
									
								
							
								 
							
						 
						
							
							
								
								Merge accumulated changes related to message queue ( #5098 )  
							
							 
							
							 
							
							
								
 
							
							
							* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								deb86ff4a6 
								
							
								 
							
						 
						
							
							
								
								upgrading grpc  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								de0b969b36 
								
							
								 
							
						 
						
							
							
								
								Revert "rename"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit 35b5264ab7 . 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								1cac5d983d 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: disallow file name too long when writing a file ( #4881 )  
							
							 
							
							 
							
							
								
 
							
							
							* fix: disallow file name too long when writing a file
* bool LongerName to MaxFilenameLength
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								35b5264ab7 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								2b3e39397e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: skipping checking active volumes with the same number of files at the moment ( #4893 )  
							
							 
							
							 
							
							
								
 
							
							
							* fix: skipping checking active volumes with the same number of files at the moment
 https://github.com/seaweedfs/seaweedfs/issues/4140 
* refactor with comments
https://github.com/seaweedfs/seaweedfs/issues/4140 
* add TestShouldSkipVolume
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								b02fdeabff 
								
							
								 
							
						 
						
							
							
								
								RetryForever => RetryUntil  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ebd6f96d35 
								
							
								 
							
						 
						
							
							
								
								adjust mq.proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								358cba43ef 
								
							
								 
							
						 
						
							
							
								
								update proto generated files  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								d7c211fe8c 
								
							
								 
							
						 
						
							
							
								
								adjust mq proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								9d589b48e6 
								
							
								 
							
						 
						
							
							
								
								rename function  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								f8b94cac0e 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )  
							
							 
							
							 
							
							
								
 
							
							
							* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519 
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3cf9b8d621 
								
							
								 
							
						 
						
							
							
								
								create topic and report topic  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								b3f94feede 
								
							
								 
							
						 
						
							
							
								
								do create topic  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								0361c321b4 
								
							
								 
							
						 
						
							
							
								
								add CreateTopic API  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								6c6655de9d 
								
							
								 
							
						 
						
							
							
								
								wip  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								340aea9b34 
								
							
								 
							
						 
						
							
							
								
								add broker leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								a65088d739 
								
							
								 
							
						 
						
							
							
								
								broker report stats to balancer  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								89a1fd1751 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 4827425146 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Sep 16 15:05:38 2023 -0700
    balancer works
commit 3b50139f68 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:22:32 2023 -0700
    comments
commit 7f685ce7ba 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:20:05 2023 -0700
    adjust APIs
commit 436d99443b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 14 23:49:05 2023 -0700
    receive broker stats
commit b771fefa37 
Merge: 0a851ec00  890881037 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 13 00:03:47 2023 -0700
    Merge branch 'master' into sub
commit 0a851ec00b 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Sep 10 22:01:25 2023 -0700
    Create balancer.go
commit 39941edc0b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 7 23:55:19 2023 -0700
    add publisher shutdown
commit 875f562779 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:16:41 2023 -0700
    server side send response at least once per second
commit 984b6c54cf 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:15:29 2023 -0700
    ack interval 128
commit 2492a45499 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 22:39:46 2023 -0700
    ack interval
commit ba67e6ca29 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:50 2023 -0700
    api for sub
commit 9e4f985698 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:30 2023 -0700
    publish, benchmark
commit cb470d44df 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 1 00:36:51 2023 -0700
    can pub and sub
commit 1eb2da46d5 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:02:12 2023 -0700
    connect and publish
commit 504ae8383a 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:01:25 2023 -0700
    protoc version
commit dbcba75271 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:59:04 2023 -0700
    rename to lookup
commit c9caf33119 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:33:46 2023 -0700
    move functions
commit 4d6c18d86f 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 17:50:59 2023 -0700
    pub sub initial tests
commit 4eb8e8624d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:14:39 2023 -0700
    rename
commit 1990456670 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:13:14 2023 -0700
    sub
commit 905911853d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Aug 26 13:39:21 2023 -0700
    adjust proto 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4827425146 
								
							
								 
							
						 
						
							
							
								
								balancer works  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								436d99443b 
								
							
								 
							
						 
						
							
							
								
								receive broker stats  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								2492a45499 
								
							
								 
							
						 
						
							
							
								
								ack interval  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ba67e6ca29 
								
							
								 
							
						 
						
							
							
								
								api for sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								cb470d44df 
								
							
								 
							
						 
						
							
							
								
								can pub and sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								504ae8383a 
								
							
								 
							
						 
						
							
							
								
								protoc version  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								dbcba75271 
								
							
								 
							
						 
						
							
							
								
								rename to lookup  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4d6c18d86f 
								
							
								 
							
						 
						
							
							
								
								pub sub initial tests  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								1990456670 
								
							
								 
							
						 
						
							
							
								
								sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								905911853d 
								
							
								 
							
						 
						
							
							
								
								adjust proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Nico D'Cotta
							
						 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								010c5e91e3 
								
							
								 
							
						 
						
							
							
								
								add stream assign proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								01d70c21f3 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 32f4b1a130 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:52:19 2023 -0700
    fix compilation
commit e77ad33b7c 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:46:44 2023 -0700
    pub
commit f431f30cc7 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 13:27:39 2023 -0700
    fix generic type
commit 4e9dcb1829 
Merge: 30f942580 16e3f2d52
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 12:47:14 2023 -0700
    Merge branch 'master' into pubsub
commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 11:10:58 2023 -0700
    wip
commit f8b00980bc2f3879bb43decffd9a08d842f196f2
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:35 2023 -0700
    add design document
commit 08d2bebe42a26ebc39f1542f54d99e73620727dd
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:06 2023 -0700
    minor
commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:13:49 2023 -0700
    rename 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								f8aa5ea844 
								
							
								 
							
						 
						
							
							
								
								adjust filer.proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								5149b3d07b 
								
							
								 
							
						 
						
							
							
								
								filer can proxy to peer filer holding the lock  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								464a71a373 
								
							
								 
							
						 
						
							
							
								
								add distributed lock manager  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3fd659df2a 
								
							
								 
							
						 
						
							
							
								
								add distributed lock manager  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								8ec1bc2c99 
								
							
								 
							
						 
						
							
							
								
								remove unused cluster node leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								25535e9c36 
								
									
								
							
								 
							
						 
						
							
							
								
								Delete volume is empty ( #4561 )  
							
							 
							
							 
							
							
								
 
							
							
							* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559 
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								wusong
							
						 
						
							
							
								
								
							
							
								
							
								26f15d0079 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix no more writable volumes by delay judgment ( #4548 )  
							
							 
							
							 
							
							
								
 
							
							
							* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								mervynzhang
							
						 
						
							
							
								
								
							
							
								
							
								1ebb549f77 
								
									
								
							
								 
							
						 
						
							
							
								
								support swift ( #4480 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								d75a7b7f62 
								
									
								
							
								 
							
						 
						
							
							
								
								allow deleting only older empty  dir without recursion ( #4430 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								5db9fcccd4 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Muhammad Hallaj bin Subery
							
						 
						
							
							
								
								
							
							
								
							
								9bd422d2c9 
								
									
								
							
								 
							
						 
						
							
							
								
								adding support for B2 region ( #4177 )  
							
							 
							
							 
							
							
								
 
							
							
							Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io> 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								81fdf3651b 
								
							
								 
							
						 
						
							
							
								
								grpc connection to filer add sw-client-id header  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Guo Lei
							
						 
						
							
							
								
								
							
							
								
							
								d8cfa1552b 
								
									
								
							
								 
							
						 
						
							
							
								
								support enable/disable vacuum ( #4087 )  
							
							 
							
							 
							
							
								
 
							
							
							* stop vacuum
* suspend/resume vacuum
* remove unused code
* rename
* rename param 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								e1ca6308cb 
								
							
								 
							
						 
						
							
							
								
								add chunk etag when downloading from remote storage  
							
							 
							
							 
							
							
								
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3987  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								James Hartig
							
						 
						
							
							
								
								
							
							
								
							
								81624de27b 
								
									
								
							
								 
							
						 
						
							
							
								
								Include name/mime in ReadAllNeedles ( #4005 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								James Hartig
							
						 
						
							
							
								
								
							
							
								
							
								4c85da7844 
								
									
								
							
								 
							
						 
						
							
							
								
								Include meta in ReadAllNeedles ( #3991 )  
							
							 
							
							 
							
							
								
 
							
							
							This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice. 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								70a4c98b00 
								
							
								 
							
						 
						
							
							
								
								refactor filer_pb.Entry and filer.Entry to use GetChunks()  
							
							 
							
							 
							
							
								
 
							
							
							for later locking on reading chunks 
							
						 
						3 years ago