ca042bd067 
								
							
								 
							
						 
						
							
							
								
								simplify  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4dce1e9d29 
								
							
								 
							
						 
						
							
							
								
								Revert "remove github.com/golang/protobuf/proto"  
							
							
 
							
							
							This reverts commit 1516e0249f 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1516e0249f 
								
							
								 
							
						 
						
							
							
								
								remove github.com/golang/protobuf/proto  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5c0f01c0eb 
								
							
								 
							
						 
						
							
							
								
								purge cluster id  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								872b5161e6 
								
									
								
							
								 
							
						 
						
							
							
								
								[shell] fs log purge ( #5344 )  
							
							
 
							
							
							* fix: install cronie
* chore: shell delete old logs
* Revert "fix: install cronie"
This reverts commit 920832b04b 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								6181aa7594 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: fs verify error counter ( #5261 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fa72761bb8 
								
							
								 
							
						 
						
							
							
								
								fix on finding lock owner  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								56287bd07d 
								
									
								
							
								 
							
						 
						
							
							
								
								weed/shell: Cluster check other disk types ( #5245 )  
							
							
 
							
							
							* week/shell: Cluster check other disk types
The `cluster.check` command only took the empty (`""`) and `hdd` disk types
into consideration, but a cluster with only `ssd` or `nvme` disk types would be
equally valid.
This commit simply checks that _any_ disk type is defined, and that some
volumes are available for it.
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
* weed/shell: Replace loop that copies slice
Use the following construct instead of a `for` loop:
```golang
x = append(x, y...)
```
See https://staticcheck.dev/docs/checks#S1011 .
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
* weed/shell: Check disk types when filer is in use
Filer stores its metadata logs in generic (i.e. `""`) or HDD disk type volumes,
so make sure those disk types exist and have volumes associated with them when
Filer is deployed in the cluster.
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
---------
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								1f08010ef0 
								
									
								
							
								 
							
						 
						
							
							
								
								weed/shell: Cleanup volume balance logic ( #5241 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a6aee847b9 
								
									
								
							
								 
							
						 
						
							
							
								
								weed/shell: Fix volume.balance logic ( #5238 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								34a78ffad0 
								
							
								 
							
						 
						
							
							
								
								remove isForPublish from LookupTopicBrokers  
							
							
 
							
							
							also adds a return parameter: whether the topic exists or not 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								183352c796 
								
									
								
							
								 
							
						 
						
							
							
								
								shell meta load add concurrency ( #4529 )  
							
							
 
							
							
							* fix: increase speed cmd fs meta load
* fix: add wg 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								97236389e8 
								
									
								
							
								 
							
						 
						
							
							
								
								Add modifyTimeAgo to volume.fsck ( #5133 )  
							
							
 
							
							
							* Add modifyTimeAgo to volume.fsck
* Fix AppendAtNs 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								54ba2c8868 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix cutoffTimeAgo in findMissingChunksInFiler ( #5132 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								580940bf82 
								
									
								
							
								 
							
						 
						
							
							
								
								Merge accumulated changes related to message queue ( #5098 )  
							
							
 
							
							
							* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d818ca9631 
								
							
								 
							
						 
						
							
							
								
								fix TestMisplacedChecking() and add test-case  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6f559fe838 
								
							
								 
							
						 
						
							
							
								
								fs.mergeVolumes: change dir to a named parameter  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d3556479be 
								
							
								 
							
						 
						
							
							
								
								Fix typo (dist => dest)  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								bb274ea8a3 
								
							
								 
							
						 
						
							
							
								
								fs.mergeVolumes: Make a plan based on volumes size  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b05d682c48 
								
							
								 
							
						 
						
							
							
								
								make help command in shell case insensitive  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								47112917ff 
								
							
								 
							
						 
						
							
							
								
								ec.decode: mount the collected ec shards  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2b9dda7d2e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix isMisplaced() in command_volume_fix_replication.go ( #4988 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2bc05f70e7 
								
							
								 
							
						 
						
							
							
								
								log full percentage  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								1cac5d983d 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: disallow file name too long when writing a file ( #4881 )  
							
							
 
							
							
							* fix: disallow file name too long when writing a file
* bool LongerName to MaxFilenameLength
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								edee91ef0e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix has changes false if deleted result size eq zero ( #4909 )  
							
							
 
							
							
							* fix has changes false if deleted result size eq zero
https://github.com/seaweedfs/seaweedfs/issues/4171 
* fix change respos status 202 to 304 if the file has already been deleted
https://github.com/seaweedfs/seaweedfs/issues/4171 
* fix delete if set apply changes
https://github.com/seaweedfs/seaweedfs/issues/4171 
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3e8604a4c5 
								
									
								
							
								 
							
						 
						
							
							
								
								add fs.mergeVolumes command into shell ( #4907 )  
							
							
 
							
							
							* add fs.compact command into shell
* rename fs.compact to fs.mergeVolumes 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2b3e39397e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: skipping checking active volumes with the same number of files at the moment ( #4893 )  
							
							
 
							
							
							* fix: skipping checking active volumes with the same number of files at the moment
 https://github.com/seaweedfs/seaweedfs/issues/4140 
* refactor with comments
https://github.com/seaweedfs/seaweedfs/issues/4140 
* add TestShouldSkipVolume
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0fd7222d65 
								
							
								 
							
						 
						
							
							
								
								default to skip if less than 4 nodes  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								dffe00a822 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: logger place msg ( #4880 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								dd580190b4 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: avoid deleting one replica without sync ( #4875 )  
							
							
 
							
							
							* fix: avoid deleting one replica without sync
https://github.com/seaweedfs/seaweedfs/issues/4647 
* Update weed/shell/command_volume_fix_replication.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* fix: revert this existing do option to positive
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9d589b48e6 
								
							
								 
							
						 
						
							
							
								
								rename function  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								df4ded758e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: avoid deleting more than one replica ( #4873 )  
							
							
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/4647 
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								19505c1cf4 
								
							
								 
							
						 
						
							
							
								
								describe a topic  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								78dbac7702 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(ec): volumes created by foreign collection due to bug in ec balance ( #4864 )  
							
							
 
							
							
							* fix(ec): ignore 0 byte data files
refers to parts of #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
* fix(ec): ignore volumes not from the current collection during balance
fixes  #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
---------
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								645ae8c57b 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs ""  
							
							
 
							
							
							This reverts commit 8cb42c39 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3cf9b8d621 
								
							
								 
							
						 
						
							
							
								
								create topic and report topic  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b3f94feede 
								
							
								 
							
						 
						
							
							
								
								do create topic  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0361c321b4 
								
							
								 
							
						 
						
							
							
								
								add CreateTopic API  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8cb42c39ad 
								
							
								 
							
						 
						
							
							
								
								Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs "  
							
							
 
							
							
							This reverts commit 2e5aa060264d414f54a2 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a04bd4d26f 
								
									
								
							
								 
							
						 
						
							
							
								
								Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )  
							
							
 
							
							
							* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								1e72579ac7 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix s3.clean.uploads ( #4766 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3365468d0d 
								
							
								 
							
						 
						
							
							
								
								added an error message  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3ec977cd6c 
								
									
								
							
								 
							
						 
						
							
							
								
								minor ( #4723 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								31b2751aff 
								
							
								 
							
						 
						
							
							
								
								clone volume locations in case they are changed  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4642  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1ce725728d 
								
							
								 
							
						 
						
							
							
								
								minor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8ec1bc2c99 
								
							
								 
							
						 
						
							
							
								
								remove unused cluster node leader  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0b0fb9b9e4 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid data race read volume.IsEmpty ( #4574 )  
							
							
 
							
							
							* avoid data race read volume.IsEmpty
-   avoid phantom read isEmpty for onlyEmpty
-   use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope
* add Destroy(onlyEmpty: true) test
* add Destroy(onlyEmpty: false) test
* remove unused `IsEmpty()`
* change literal `8` to `SuperBlockSize` 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								25535e9c36 
								
									
								
							
								 
							
						 
						
							
							
								
								Delete volume is empty ( #4561 )  
							
							
 
							
							
							* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559 
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								5caff2c0f0 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: deletes newly created volumes ( #4551 )  
							
							
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/4531 
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
						2 years ago