dddb0f0ae5 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards are unmounted ( #6776 )  
							
							
								
 
							
							
						 
						6 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2ae5b480a6 
								
									
								
							
								 
							
						 
						
							
							
								
								Use the correct constant when computing the offset in SearchNeedleFromSortedIndex ( #6771 )  
							
							
 
							
							
							NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes)
Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com> 
							
						 
						6 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0e08b83521 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix volume ttl ( #6683 )  
							
							
								
 
							
							
						 
						7 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								216c52e377 
								
									
								
							
								 
							
						 
						
							
							
								
								chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 ( #6679 )  
							
							
 
							
							
							* chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0
Bumps [gocloud.dev](https://github.com/google/go-cloud ) from 0.40.0 to 0.41.0.
- [Release notes](https://github.com/google/go-cloud/releases )
- [Commits](https://github.com/google/go-cloud/compare/v0.40.0...v0.41.0 )
---
updated-dependencies:
- dependency-name: gocloud.dev
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix error
* fix printing errors
* Update go.mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com> 
							
						 
						7 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								271505717e 
								
									
								
							
								 
							
						 
						
							
							
								
								chore: make function comment match function name ( #6607 )  
							
							
								
 
							
							
						 
						8 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								ef4eda0761 
								
									
								
							
								 
							
						 
						
							
							
								
								added re-generating and writing the Volume UUID if it is empty ( #6568 )  
							
							
								
 
							
							
						 
						8 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								7913681297 
								
									
								
							
								 
							
						 
						
							
							
								
								`ec.encode`: Display a warning on EC balancing if no replica placement settings are found. ( #6487 )  
							
							
								
 
							
							
						 
						9 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								be15fee8e7 
								
							
								 
							
						 
						
							
							
								
								show error if backend is mis-configured  
							
							
 
							
							
							related to https://github.com/seaweedfs/seaweedfs/discussions/6472  
							
						 
						9 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								5452405a81 
								
									
								
							
								 
							
						 
						
							
							
								
								cloud tier: support for Alibaba Cloud OSS ( #6466 )  
							
							
								
 
							
							
						 
						9 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								de09a82a32 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						10 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								bfd59dd579 
								
							
								 
							
						 
						
							
							
								
								adjust import  
							
							
								
 
							
							
						 
						10 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec155022e7 
								
							
								 
							
						 
						
							
							
								
								"golang.org/x/exp/slices" => "slices" and go fmt  
							
							
								
 
							
							
						 
						10 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								c531e2eb0e 
								
									
								
							
								 
							
						 
						
							
							
								
								Update disk_location_ec.go ( #6359 )  
							
							
 
							
							
							Add lock for l.ecVolumes 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								7eb8257126 
								
									
								
							
								 
							
						 
						
							
							
								
								Update store.go ( #6358 )  
							
							
 
							
							
							Add lock for location.ecVolumes And single delete 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								ff1392f7f4 
								
									
								
							
								 
							
						 
						
							
							
								
								[shell] use constant for hdd of type ( #6337 )  
							
							
 
							
							
							use constant for hdd of type 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f3dde99796 
								
							
								 
							
						 
						
							
							
								
								adjust error message  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								fd6c787c02 
								
									
								
							
								 
							
						 
						
							
							
								
								fix EcVolumes sorting in volume UI ( #6275 )  
							
							
 
							
							
							* Update store_ec.go
* fix: EcVolume sorting not work
* use stdlib
* revert 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								75f5afa571 
								
							
								 
							
						 
						
							
							
								
								fix compilation  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1c143cfcea 
								
							
								 
							
						 
						
							
							
								
								display actual offset value  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c9f3448692 
								
							
								 
							
						 
						
							
							
								
								ReadAt may return io.EOF t end of file  
							
							
 
							
							
							related to https://github.com/seaweedfs/seaweedfs/issues/6219  
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								be09d08eb6 
								
							
								 
							
						 
						
							
							
								
								adjust error message  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								96f1a2e01a 
								
							
								 
							
						 
						
							
							
								
								adjust error message  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								f2db746690 
								
									
								
							
								 
							
						 
						
							
							
								
								Introduce logic to resolve volume replica placement within EC rebalancing. ( #6254 )  
							
							
 
							
							
							* Rename `command_ec_encode_test.go` to `command_ec_common_test.go`.
All tests defined in this file are now for `command_ec_common.go`.
* Minor code cleanups.
- Fix broken `ec.balance` test.
- Rework integer ceiling division to not use floats, which can introduce precision errors.
* Introduce logic to resolve volume replica placement within EC rebalancing.
This will be used to make rebalancing logic topology-aware.
* Give shell.EcNode.dc a dedicated DataCenterId type. 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4a0dc883cf 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix/parse upload filename ( #6241 )  
							
							
 
							
							
							* fix: parse filename in PUT + refactor
* fix: master iu public url with http
* fix: better parsing and handle disposition header
* fix: take mime type from file extension if not set 
							
						 
						12 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3003c9e17e 
								
									
								
							
								 
							
						 
						
							
							
								
								added backward compatible CRC check and extra explanatory comments ( #6233 )  
							
							
								
 
							
							
						 
						12 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9873b033d1 
								
							
								 
							
						 
						
							
							
								
								backward compatible vif loading  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ae5bd0667a 
								
							
								 
							
						 
						
							
							
								
								rename proto field from DestroyTime to expire_at_sec  
							
							
 
							
							
							For TTL volume converted into EC volume, this change may leave the volumes staying. 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d38456dc06 
								
							
								 
							
						 
						
							
							
								
								do not delete collection metrics when unmount a volume  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/6139  
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								1e13b6879c 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(volume): to avoid duplicate write a same needle ( #6138 )  
							
							
 
							
							
							fix WriteNeedleBlob to avoid duplicate write a same needle
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f11567816e 
								
							
								 
							
						 
						
							
							
								
								Revert "fix: volume data integrity check ( #6118 )"  
							
							
 
							
							
							This reverts commit e12b9ab746 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								e12b9ab746 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: volume data integrity check ( #6118 )  
							
							
 
							
							
							Co-authored-by: wang wusong <wangwusong@virtaitech.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7dd480acad 
								
							
								 
							
						 
						
							
							
								
								handle missing leading zero padding in replica  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4dc33cc143 
								
									
								
							
								 
							
						 
						
							
							
								
								fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )  
							
							
 
							
							
							the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								d056c0ddf2 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(volume): don't persist RO state in specific cases ( #6058 )  
							
							
 
							
							
							* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4ec6eab004 
								
							
								 
							
						 
						
							
							
								
								fix max volume count auto setting  
							
							
 
							
							
							related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182  
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								6d4f5c94ac 
								
									
								
							
								 
							
						 
						
							
							
								
								[volume] remove truncate idx file if size not healthy ( #6043 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bc01f09e37 
								
									
								
							
								 
							
						 
						
							
							
								
								Do CRC check if the buffer contains the full needle data before it is sent ( #5980 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								f9e141a412 
								
									
								
							
								 
							
						 
						
							
							
								
								persist readonly state to volume info ( #5977 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								310d41998d 
								
									
								
							
								 
							
						 
						
							
							
								
								Skip volume data integrity check for volume which has remote file ( #5976 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8e4bffc66b 
								
							
								 
							
						 
						
							
							
								
								copy ec shards to disks already having ec volumes  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/5615  
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								361e7ebc74 
								
									
								
							
								 
							
						 
						
							
							
								
								fix volume.move io.EOF ( #5960 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								220061573d 
								
									
								
							
								 
							
						 
						
							
							
								
								update metric for ErrorCRC if it happens during volume readNeedleDataInto ( #5957 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5535b60e8c 
								
							
								 
							
						 
						
							
							
								
								fix replication range check  
							
							
 
							
							
							fix for https://github.com/seaweedfs/seaweedfs/wiki/Replication#replication-string  
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e8462ba3ad 
								
							
								 
							
						 
						
							
							
								
								prevent compacting on the same volume  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0b00706454 
								
									
								
							
								 
							
						 
						
							
							
								
								EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )  
							
							
 
							
							
							* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fdf7193ae7 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								07f4998188 
								
							
								 
							
						 
						
							
							
								
								add dat file size into vif for EC  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3a2e21fee7 
								
							
								 
							
						 
						
							
							
								
								fix EC reading on nLargeBlockRows  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/5465  
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bd54669d58 
								
									
								
							
								 
							
						 
						
							
							
								
								Detect underflow when calculating unused space ( #5758 )  
							
							
 
							
							
							* Detect underflow when calculating unused space
* Detect underflow when calculating unused space 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								5ffacbb6ea 
								
									
								
							
								 
							
						 
						
							
							
								
								refactor all methods strings to const ( #5726 )  
							
							
								
 
							
							
						 
						1 year ago