ec155022e7 
								
							
								 
							
						 
						
							
							
								
								"golang.org/x/exp/slices" => "slices" and go fmt  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								65fb8fad99 
								
									
								
							
								 
							
						 
						
							
							
								
								Update filer_multipart.go ( #6188 )  
							
							
 
							
							
							fix the #6177  bug 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								33537ae29f 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3] fix s3  test_multipart_get_part ( #5476 )  
							
							
 
							
							
							* try fix s3  test_multipart_get_part
* add passed s3 tests
* fix SeaweedFSUploadId
* rm spaces
* convert part request to range
* add passed s3 tests of multipart 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3e25ed1b11 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3] add s3 pass test_multipart_upload_size_too_small ( #5475 )  
							
							
 
							
							
							* add s3 pass test_multipart_upload_size_too_small
* refactor metric names
* return ErrNoSuchUpload if empty parts
* fix test 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								35cba720a5 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3] add s3 pass test_multipart_upload ( #5474 )  
							
							
 
							
							
							add s3 pass test_multipart_upload 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								d42a04cceb 
								
									
								
							
								 
							
						 
						
							
							
								
								[s3] fix s3 test_multipart_resend_first_finishes_last  ( #5471 )  
							
							
 
							
							
							* try fix s3 test
https://github.com/seaweedfs/seaweedfs/pull/5466 
* add error handler metrics
* refactor
* refactor multipartExt
* delete bad entry parts 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								7aa25c1137 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: correctly form partNumber from new entry.Name format in "listObjectParts" ( #5470 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b19c9847c6 
								
									
								
							
								 
							
						 
						
							
							
								
								fix completed multiupload lost data ( #5460 )  
							
							
 
							
							
							If there are putObjectPart requests with the same uploadId during
completeMultiPart, it can result in data loss. putObjectPart requests
might be due to timeout retries.
Co-authored-by: Yang Wang <yangwang@weride.ai> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								645ae8c57b 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs ""  
							
							
 
							
							
							This reverts commit 8cb42c39 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8cb42c39ad 
								
							
								 
							
						 
						
							
							
								
								Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs "  
							
							
 
							
							
							This reverts commit 2e5aa060264d414f54a2 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a04bd4d26f 
								
									
								
							
								 
							
						 
						
							
							
								
								Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )  
							
							
 
							
							
							* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6792db21dc 
								
							
								 
							
						 
						
							
							
								
								ErrInvalidPart when completed parts has extra parts  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/discussions/4746  
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								89542db2d0 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix S3 API multipart upload on Windows ( #4666 )  
							
							
 
							
							
							The file paths were being having '/' changed to '\' by filepath.Dir()
resulting in a file being created with '\' separators, but when trying
to read the files, the same wasn't happening.
Co-authored-by: Hendrik Appel <happel@europe.altair.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								70a4c98b00 
								
							
								 
							
						 
						
							
							
								
								refactor filer_pb.Entry and filer.Entry to use GetChunks()  
							
							
 
							
							
							for later locking on reading chunks 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								df0662038c 
								
									
								
							
								 
							
						 
						
							
							
								
								feat:add a uuid after uploadid ( #3963 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8b9957d461 
								
							
								 
							
						 
						
							
							
								
								add back "/" prefix if it is missing in object  
							
							
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/3737  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ea2637734a 
								
							
								 
							
						 
						
							
							
								
								refactor filer proto chunk variable from mtime to modified_ts_ns  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b64411bda8 
								
									
								
							
								 
							
						 
						
							
							
								
								fix 0 size ( #3683 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bb880d6253 
								
									
								
							
								 
							
						 
						
							
							
								
								IsTruncated returned by the ListMultipartUploads method is set to false by default ( #3682 )  
							
							
 
							
							
							* simplify a bit
* fix: IsTruncated returned by the ListMultipartUploads method is set to false by default 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f17cd0d5cd 
								
							
								 
							
						 
						
							
							
								
								return false if not found  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/3011  
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								306cf70c4a 
								
							
								 
							
						 
						
							
							
								
								avoid empty listMultipartUploads response  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3551ca2fcf 
								
							
								 
							
						 
						
							
							
								
								enhancement: replace sort.Slice with slices.SortFunc to reduce reflection  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								180aa88a92 
								
							
								 
							
						 
						
							
							
								
								check uploadid using object name hash string  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								993283bb1d 
								
							
								 
							
						 
						
							
							
								
								revert sort.Search  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5b90a39954 
								
							
								 
							
						 
						
							
							
								
								fix s3 tests:  
							
							
 
							
							
							multipart_upload_incorrect_etag
multipart_resend_first_finishes_last 
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e48764be75 
								
							
								 
							
						 
						
							
							
								
								s3: multipart upload verifies uploaded parts  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								61811dc2f1 
								
							
								 
							
						 
						
							
							
								
								comments  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9014d00fd0 
								
							
								 
							
						 
						
							
							
								
								Revert "s3: listObjectParts return ErrNoSuchUpload if does not exist"  
							
							
 
							
							
							This reverts commit 6cf2e7d493 
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6cf2e7d493 
								
							
								 
							
						 
						
							
							
								
								s3: listObjectParts return ErrNoSuchUpload if does not exist  
							
							
 
							
							
							ubuntu@prod-master-1:~$ aws --endpoint http://10.244.15.66:8333  s3api abort-multipart-upload --bucket prod-cache --key multipart-test --upload-id 5347f936-6adc-43de-8e5c-1fd137c3b2bc
ubuntu@prod-master-1:~$ aws --endpoint http://10.244.15.66:8333  s3api list-parts --bucket prod-cache --key multipart-test --upload-id 5347f936-6adc-43de-8e5c-1fd137c3b2bc
{
    "Initiator": null,
    "Owner": null,
    "StorageClass": "STANDARD"
}
If we abort a multipart upload, it appears that records are left behind. We should get a 404 NoSuchKey error. 
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5c3b783310 
								
							
								 
							
						 
						
							
							
								
								s3: copy object API needs to escape special characters  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/2482  
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								309f46e3af 
								
							
								 
							
						 
						
							
							
								
								S3: fix upload limit if the size is more than 8GB  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8de7915950 
								
							
								 
							
						 
						
							
							
								
								s3 mime detect  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								458145425e 
								
							
								 
							
						 
						
							
							
								
								S3 MultipartUpload pass contentType to meta  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e5fc35ed0c 
								
							
								 
							
						 
						
							
							
								
								change server address from string to a type  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7359193e97 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1a4db87e19 
								
							
								 
							
						 
						
							
							
								
								fix s3 metadata error with multipart upload  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c6d4c16079 
								
							
								 
							
						 
						
							
							
								
								S3: add metadata with multipart upload  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/2173  
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b9c1f3e9de 
								
							
								 
							
						 
						
							
							
								
								s3: fixes for list multipart upload  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5b40a2690a 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3984c3962f 
								
							
								 
							
						 
						
							
							
								
								add comment  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								baa6bdf4d4 
								
							
								 
							
						 
						
							
							
								
								s3: listMultipartUploads fix output format  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3eda8d6dfc 
								
							
								 
							
						 
						
							
							
								
								s3: ListParts output xml format  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1461  
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								eb7929a971 
								
							
								 
							
						 
						
							
							
								
								rename filer2 to filer  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								83012f543a 
								
							
								 
							
						 
						
							
							
								
								s: avoid possible completeMultipartUpload re-tries that can overwrite the uploaded file  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c647deace1 
								
							
								 
							
						 
						
							
							
								
								file size support set file length  
							
							
 
							
							
							use Attr.FileSize and TotalChunkSize to determine file size 
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a25a8d8822 
								
							
								 
							
						 
						
							
							
								
								s3: print out time in UTC format  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1297  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d57559d3f7 
								
							
								 
							
						 
						
							
							
								
								chunk rememober encryption or not  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec2eb8bc48 
								
							
								 
							
						 
						
							
							
								
								add If-None-Match and If-Modified-Since  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1269  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c07bcd5065 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						6 years ago