050efe6c08 
								
							
								 
							
						 
						
							
							
								
								factor in existing ec volume count when estimating max volume count  
							
							
 
							
							
							related to https://github.com/seaweedfs/seaweedfs/issues/5191  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a7fc723ae0 
								
									
								
							
								 
							
						 
						
							
							
								
								chore: add status code for request_total metrics ( #5188 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								43a5973a66 
								
							
								 
							
						 
						
							
							
								
								weed/storage: fix dropped test errors  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								81f11883e3 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7a50762b9e 
								
							
								 
							
						 
						
							
							
								
								reduce binary size by skipping rclone  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6c1ce18541 
								
							
								 
							
						 
						
							
							
								
								Fix weed fix  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6ebe26a765 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Revert "Add disk type to prometheus metrics" ( #4777 )""  
							
							
 
							
							
							This reverts commit 567d788928 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7540d43ee9 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "fix compilation""  
							
							
 
							
							
							This reverts commit f9abfd0b03 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								249c0e06ef 
								
							
								 
							
						 
						
							
							
								
								Revert "fix compilation"  
							
							
 
							
							
							This reverts commit 451ec6504d 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								451ec6504d 
								
							
								 
							
						 
						
							
							
								
								fix compilation  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f9abfd0b03 
								
							
								 
							
						 
						
							
							
								
								Revert "fix compilation"  
							
							
 
							
							
							This reverts commit 0483ba3889 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0483ba3889 
								
							
								 
							
						 
						
							
							
								
								fix compilation  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								567d788928 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Add disk type to prometheus metrics" ( #4777 )"  
							
							
 
							
							
							This reverts commit 9215ba24be 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								78dbac7702 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(ec): volumes created by foreign collection due to bug in ec balance ( #4864 )  
							
							
 
							
							
							* fix(ec): ignore 0 byte data files
refers to parts of #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
* fix(ec): ignore volumes not from the current collection during balance
fixes  #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
---------
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								645ae8c57b 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs ""  
							
							
 
							
							
							This reverts commit 8cb42c39 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								27af11f1e8 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Merge branch 'master' into sub""  
							
							
 
							
							
							This reverts commit 0bb97709d4 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0bb97709d4 
								
							
								 
							
						 
						
							
							
								
								Revert "Merge branch 'master' into sub"  
							
							
 
							
							
							This reverts commit 4d414f54a24827425146 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8cb42c39ad 
								
							
								 
							
						 
						
							
							
								
								Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs "  
							
							
 
							
							
							This reverts commit 2e5aa060264d414f54a2 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a04bd4d26f 
								
									
								
							
								 
							
						 
						
							
							
								
								Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )  
							
							
 
							
							
							* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d83107efe5 
								
							
								 
							
						 
						
							
							
								
								fix: weed/storage: dropped error  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f24c7e803f 
								
							
								 
							
						 
						
							
							
								
								weed/storage/erasure_coding: Close() after error handling  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d762b12e11 
								
							
								 
							
						 
						
							
							
								
								weed/storage/erasure_coding: fix dropped test error  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a879e1bbb5 
								
							
								 
							
						 
						
							
							
								
								weed/storage/erasure_coding: remove unused err from encodeDatFile() signature  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								9215ba24be 
								
									
								
							
								 
							
						 
						
							
							
								
								Revert "Add disk type to prometheus metrics" ( #4777 )  
							
							
 
							
							
							Revert "Add disk type to prometheus metrics (#4736 )"
This reverts commit 9956d93a40 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								9956d93a40 
								
									
								
							
								 
							
						 
						
							
							
								
								Add disk type to prometheus metrics ( #4736 )  
							
							
 
							
							
							* Add disk type to prometheus metrics
* Del metrics
* Disk type as readable string
---------
Co-authored-by: Dima Mishin <dimm@dimm.dev> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4b1ba7f5b2 
								
									
								
							
								 
							
						 
						
							
							
								
								Save disk space metrics immediately ( #4740 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								e6a49dc533 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix resource leaks ( #4737 )  
							
							
 
							
							
							* Fix division by zero
* Fix file handle leak
* Fix file handle leak
* Fix file handle leak
* Fix goroutine leak 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3730772e05 
								
									
								
							
								 
							
						 
						
							
							
								
								refresh max volume count after adjust ( #4662 )  
							
							
 
							
							
							Signed-off-by: changlin.shi <changlin.shi@ly.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c278bac263 
								
							
								 
							
						 
						
							
							
								
								avoid nil needle map  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4640  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								14546f0ad8 
								
							
								 
							
						 
						
							
							
								
								minor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								61553beba2 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix DataBackend nil pointer ( #4641 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2aa59ab37c 
								
							
								 
							
						 
						
							
							
								
								fix copying level db files during commi  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4635  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0d9ba8c612 
								
									
								
							
								 
							
						 
						
							
							
								
								Support templating name of files stored via Rclone backend ( #4606 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3b88ab42aa 
								
									
								
							
								 
							
						 
						
							
							
								
								remove duplicate `fileCount` query ( #4588 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								44b9d72ef0 
								
									
								
							
								 
							
						 
						
							
							
								
								doIsEmpty() return error if v.DataBackend is nil ( #4587 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0b0fb9b9e4 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid data race read volume.IsEmpty ( #4574 )  
							
							
 
							
							
							* avoid data race read volume.IsEmpty
-   avoid phantom read isEmpty for onlyEmpty
-   use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope
* add Destroy(onlyEmpty: true) test
* add Destroy(onlyEmpty: false) test
* remove unused `IsEmpty()`
* change literal `8` to `SuperBlockSize` 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								1e22d5caf2 
								
									
								
							
								 
							
						 
						
							
							
								
								fix get file stats for IsEmpty ( #4576 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4527ead295 
								
									
								
							
								 
							
						 
						
							
							
								
								fix from comment delete volume is empty ( #4573 )  
							
							
 
							
							
							* fix from coments
https://github.com/seaweedfs/seaweedfs/pull/4561 
* fix tests
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								25535e9c36 
								
									
								
							
								 
							
						 
						
							
							
								
								Delete volume is empty ( #4561 )  
							
							
 
							
							
							* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559 
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								26f15d0079 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix no more writable volumes by delay judgment ( #4548 )  
							
							
 
							
							
							* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e23f3d6eca 
								
							
								 
							
						 
						
							
							
								
								set df.File to nil after it is closed  
							
							
 
							
							
							possibly fix https://github.com/seaweedfs/seaweedfs/issues/4530  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ff7b6d779e 
								
							
								 
							
						 
						
							
							
								
								avoid overwriting variables  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4365  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								9f55c7c90e 
								
									
								
							
								 
							
						 
						
							
							
								
								Rclone storage backend ( #4402 )  
							
							
 
							
							
							* Add Rclone storage backend
* Support templating the name of files stored via Rclone
* Enable Rclone accounting
* Remove redundant type conversion
* Provide progress information for Rclone download/upload operations
* Log error when Rclone can't instantiate filesystem
* Remove filename templating functionality for Rclone storage
To (maybe) be later reintroduced as a generic functionality for all
storage backends.
* Remove S3 specific check
* Move Rclone config initialisation to init() method 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0a22eea55d 
								
							
								 
							
						 
						
							
							
								
								collect ec shard from multiple locations  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4365  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f5854d13df 
								
							
								 
							
						 
						
							
							
								
								fix test  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0454bb2d88 
								
							
								 
							
						 
						
							
							
								
								fix test  
							
							
 
							
							
							when size is zero, the "LastModified" is not written 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c589e9837c 
								
							
								 
							
						 
						
							
							
								
								fix tests  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bd6f2716d3 
								
									
								
							
								 
							
						 
						
							
							
								
								fix_read_tomb_needle_meta ( #4263 )  
							
							
 
							
							
							Co-authored-by: zemul <zhouzemiao@ihuman.com> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								81624de27b 
								
									
								
							
								 
							
						 
						
							
							
								
								Include name/mime in ReadAllNeedles ( #4005 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4c85da7844 
								
									
								
							
								 
							
						 
						
							
							
								
								Include meta in ReadAllNeedles ( #3991 )  
							
							
 
							
							
							This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice. 
							
						 
						3 years ago