chrislu
							
						 
						
							
							
							
								
							
								5e22524351 
								
							
								 
							
						 
						
							
							
								
								prototyping  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								f8b94cac0e 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )  
							
							 
							
							 
							
							
								
 
							
							
							* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519 
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3cf9b8d621 
								
							
								 
							
						 
						
							
							
								
								create topic and report topic  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								b3f94feede 
								
							
								 
							
						 
						
							
							
								
								do create topic  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								0361c321b4 
								
							
								 
							
						 
						
							
							
								
								add CreateTopic API  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								6c6655de9d 
								
							
								 
							
						 
						
							
							
								
								wip  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								340aea9b34 
								
							
								 
							
						 
						
							
							
								
								add broker leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								a65088d739 
								
							
								 
							
						 
						
							
							
								
								broker report stats to balancer  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								89a1fd1751 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 4827425146 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Sep 16 15:05:38 2023 -0700
    balancer works
commit 3b50139f68 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:22:32 2023 -0700
    comments
commit 7f685ce7ba 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:20:05 2023 -0700
    adjust APIs
commit 436d99443b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 14 23:49:05 2023 -0700
    receive broker stats
commit b771fefa37 
Merge: 0a851ec00  890881037 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 13 00:03:47 2023 -0700
    Merge branch 'master' into sub
commit 0a851ec00b 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Sep 10 22:01:25 2023 -0700
    Create balancer.go
commit 39941edc0b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 7 23:55:19 2023 -0700
    add publisher shutdown
commit 875f562779 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:16:41 2023 -0700
    server side send response at least once per second
commit 984b6c54cf 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:15:29 2023 -0700
    ack interval 128
commit 2492a45499 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 22:39:46 2023 -0700
    ack interval
commit ba67e6ca29 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:50 2023 -0700
    api for sub
commit 9e4f985698 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:30 2023 -0700
    publish, benchmark
commit cb470d44df 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 1 00:36:51 2023 -0700
    can pub and sub
commit 1eb2da46d5 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:02:12 2023 -0700
    connect and publish
commit 504ae8383a 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:01:25 2023 -0700
    protoc version
commit dbcba75271 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:59:04 2023 -0700
    rename to lookup
commit c9caf33119 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:33:46 2023 -0700
    move functions
commit 4d6c18d86f 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 17:50:59 2023 -0700
    pub sub initial tests
commit 4eb8e8624d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:14:39 2023 -0700
    rename
commit 1990456670 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:13:14 2023 -0700
    sub
commit 905911853d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Aug 26 13:39:21 2023 -0700
    adjust proto 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4827425146 
								
							
								 
							
						 
						
							
							
								
								balancer works  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								436d99443b 
								
							
								 
							
						 
						
							
							
								
								receive broker stats  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								2492a45499 
								
							
								 
							
						 
						
							
							
								
								ack interval  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ba67e6ca29 
								
							
								 
							
						 
						
							
							
								
								api for sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								cb470d44df 
								
							
								 
							
						 
						
							
							
								
								can pub and sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								504ae8383a 
								
							
								 
							
						 
						
							
							
								
								protoc version  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								dbcba75271 
								
							
								 
							
						 
						
							
							
								
								rename to lookup  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4d6c18d86f 
								
							
								 
							
						 
						
							
							
								
								pub sub initial tests  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								1990456670 
								
							
								 
							
						 
						
							
							
								
								sub  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								905911853d 
								
							
								 
							
						 
						
							
							
								
								adjust proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Nico D'Cotta
							
						 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								010c5e91e3 
								
							
								 
							
						 
						
							
							
								
								add stream assign proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								01d70c21f3 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 32f4b1a130 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:52:19 2023 -0700
    fix compilation
commit e77ad33b7c 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:46:44 2023 -0700
    pub
commit f431f30cc7 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 13:27:39 2023 -0700
    fix generic type
commit 4e9dcb1829 
Merge: 30f942580 16e3f2d52
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 12:47:14 2023 -0700
    Merge branch 'master' into pubsub
commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 11:10:58 2023 -0700
    wip
commit f8b00980bc2f3879bb43decffd9a08d842f196f2
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:35 2023 -0700
    add design document
commit 08d2bebe42a26ebc39f1542f54d99e73620727dd
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:06 2023 -0700
    minor
commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:13:49 2023 -0700
    rename 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								f8aa5ea844 
								
							
								 
							
						 
						
							
							
								
								adjust filer.proto  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								5149b3d07b 
								
							
								 
							
						 
						
							
							
								
								filer can proxy to peer filer holding the lock  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								464a71a373 
								
							
								 
							
						 
						
							
							
								
								add distributed lock manager  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3fd659df2a 
								
							
								 
							
						 
						
							
							
								
								add distributed lock manager  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								8ec1bc2c99 
								
							
								 
							
						 
						
							
							
								
								remove unused cluster node leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								25535e9c36 
								
									
								
							
								 
							
						 
						
							
							
								
								Delete volume is empty ( #4561 )  
							
							 
							
							 
							
							
								
 
							
							
							* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559 
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								wusong
							
						 
						
							
							
								
								
							
							
								
							
								26f15d0079 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix no more writable volumes by delay judgment ( #4548 )  
							
							 
							
							 
							
							
								
 
							
							
							* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com> 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								mervynzhang
							
						 
						
							
							
								
								
							
							
								
							
								1ebb549f77 
								
									
								
							
								 
							
						 
						
							
							
								
								support swift ( #4480 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								d75a7b7f62 
								
									
								
							
								 
							
						 
						
							
							
								
								allow deleting only older empty  dir without recursion ( #4430 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								5db9fcccd4 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Muhammad Hallaj bin Subery
							
						 
						
							
							
								
								
							
							
								
							
								9bd422d2c9 
								
									
								
							
								 
							
						 
						
							
							
								
								adding support for B2 region ( #4177 )  
							
							 
							
							 
							
							
								
 
							
							
							Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io> 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								81fdf3651b 
								
							
								 
							
						 
						
							
							
								
								grpc connection to filer add sw-client-id header  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Guo Lei
							
						 
						
							
							
								
								
							
							
								
							
								d8cfa1552b 
								
									
								
							
								 
							
						 
						
							
							
								
								support enable/disable vacuum ( #4087 )  
							
							 
							
							 
							
							
								
 
							
							
							* stop vacuum
* suspend/resume vacuum
* remove unused code
* rename
* rename param 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								e1ca6308cb 
								
							
								 
							
						 
						
							
							
								
								add chunk etag when downloading from remote storage  
							
							 
							
							 
							
							
								
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3987  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								James Hartig
							
						 
						
							
							
								
								
							
							
								
							
								81624de27b 
								
									
								
							
								 
							
						 
						
							
							
								
								Include name/mime in ReadAllNeedles ( #4005 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								James Hartig
							
						 
						
							
							
								
								
							
							
								
							
								4c85da7844 
								
									
								
							
								 
							
						 
						
							
							
								
								Include meta in ReadAllNeedles ( #3991 )  
							
							 
							
							 
							
							
								
 
							
							
							This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice. 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								70a4c98b00 
								
							
								 
							
						 
						
							
							
								
								refactor filer_pb.Entry and filer.Entry to use GetChunks()  
							
							 
							
							 
							
							
								
 
							
							
							for later locking on reading chunks 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ea2637734a 
								
							
								 
							
						 
						
							
							
								
								refactor filer proto chunk variable from mtime to modified_ts_ns  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Eric Yang
							
						 
						
							
							
								
								
							
							
								
							
								51d462f204 
								
									
								
							
								 
							
						 
						
							
							
								
								ADHOC: volume fsck using append at ns ( #3906 )  
							
							 
							
							 
							
							
								
 
							
							
							* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local> 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								de286fe662 
								
							
								 
							
						 
						
							
							
								
								shell: volume.move handles volume moved to cloud tier  
							
							 
							
							 
							
							
								
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3803  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								e20f0dbd2d 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid data race of TraverseBfs ( #3856 )  
							
							 
							
							 
							
							
								
 
							
							
							* avoid data race of TraverseBfs
* close is enough
avoid panic
I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255
I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c]
goroutine 287 [running]:
github.com/seaweedfs/seaweedfs/weed/storage.(*SortedFileNeedleMap).Close(0x0)
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load.func1()
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?)
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c
github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...)
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1)
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes.func2()
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9
created by github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes
        /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								f476cf3403 
								
									
								
							
								 
							
						 
						
							
							
								
								fix volume_server.proto conflict ( #3858 )  
							
							 
							
							 
							
							
								
 
							
							
							fix conflict
https://github.com/seaweedfs/seaweedfs/pull/3841  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								2f72103c83 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid load volume file with BytesOffset mismatch ( #3841 )  
							
							 
							
							 
							
							
								
 
							
							
							* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966 
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								dcd0743a35 
								
							
								 
							
						 
						
							
							
								
								remove unused ReadNeedleBlobRequest.needle_id  
							
							 
							
							 
							
							
								
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3853  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								36daa7709d 
								
									
								
							
								 
							
						 
						
							
							
								
								show raft leader via shell ( #3796 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								LHHDZ
							
						 
						
							
							
								
								
							
							
								
							
								e00a12b099 
								
									
								
							
								 
							
						 
						
							
							
								
								associate `Account` and `Identity` by accountId ( #3754 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								31922b2bf2 
								
							
								 
							
						 
						
							
							
								
								s3 to watch specific directories  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								b90d92fca9 
								
							
								 
							
						 
						
							
							
								
								grpc: watch metadata changes by directory  
							
							 
							
							
								
 
							
							
						 
						3 years ago