165af32d6b 
								
									
								
							
								 
							
						 
						
							
							
								
								added context to filer_client method calls ( #6808 )  
							
							
 
							
							
							Co-authored-by: akosov <a.kosov@kryptonite.ru> 
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0df4a4298b 
								
							
								 
							
						 
						
							
							
								
								adjust comment  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								f77eee667d 
								
									
								
							
								 
							
						 
						
							
							
								
								add s3test for sql ( #5718 )  
							
							
 
							
							
							* add s3test for sql
* fix test test_bucket_listv2_delimiter_basic for s3
* fix action s3tests
* regen s3 api xsd
* rm minor s3 test test_bucket_listv2_fetchowner_defaultempty
* add docs
* without xmlns 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e6bfd061c7 
								
							
								 
							
						 
						
							
							
								
								AllowEmptyFolder checks during object deletion  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a1b59948cc 
								
							
								 
							
						 
						
							
							
								
								rename files  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								df9031e19a 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. ( #5441 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								61f4e40ad9 
								
									
								
							
								 
							
						 
						
							
							
								
								fix s3api: delimeter properly takes prefixes into account ( #5411 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3e3e0fa240 
								
									
								
							
								 
							
						 
						
							
							
								
								feat: add support for S3 ListObjects and ListObjectsV2 ( #5350 )  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7a0d1e7fc1 
								
							
								 
							
						 
						
							
							
								
								minor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								d75a7b7f62 
								
									
								
							
								 
							
						 
						
							
							
								
								allow deleting only older empty  dir without recursion ( #4430 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								5614ad0000 
								
									
								
							
								 
							
						 
						
							
							
								
								fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter ( #4399 )  
							
							
 
							
							
							* fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter
* fix list with delimiter and start token
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								88b2bbadd1 
								
									
								
							
								 
							
						 
						
							
							
								
								try fix s3test test_bucket_listv2_delimiter_prefix ( #4396 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								44ad07276c 
								
									
								
							
								 
							
						 
						
							
							
								
								s3 fix get list of dir object key with slash suffix ( #4391 )  
							
							
 
							
							
							* s3 fix get list of dir object key with slash suffix
https://github.com/seaweedfs/seaweedfs/issues/3086 
* list only entry dir eq prefix
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								db5515eada 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix s3api_object_list_handlers returning contents less than the specified limit when more data actually exists ( #4240 )  
							
							
 
							
							
							Fix when the stored data is actually enough but s3api_object_list_handlers returns less than the specified limit
Signed-off-by: changlin.shi <changlin.shi@ly.com> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2b910d1cf8 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid recursive deleting newly created empty directories ( #4016 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								34132b2c9f 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: isTruncated returns problematic ( #3907 )  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								e88392b50f 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix s3 pagination ( #3436 )  
							
							
 
							
							
							* Revert previous changes
* s3: use cursor to track tree traversal
fix https://github.com/seaweedfs/seaweedfs/issues/3166 
* special cases for empty prefix and empty directory
* use constants
* address empty folder
* undo local changes
* fix IsTruncated
* adjust counting directories
* fix cases when prefix is a directory
* s3: handle directory object
works for
aws --endpoint-url http://127.0.0.1:8333/  s3api list-objects-v2 --bucket test --prefix "fakedir" 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								90db4b5a44 
								
							
								 
							
						 
						
							
							
								
								minor  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								69ef6459c3 
								
							
								 
							
						 
						
							
							
								
								S3 ListObjectsV2 fix pagination under bucket root  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/3166  
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3d5f1cbc5e 
								
							
								 
							
						 
						
							
							
								
								fix pagination  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								bcbdc4cb37 
								
							
								 
							
						 
						
							
							
								
								use const multipart uploads folder  
							
							
 
							
							
							avoid error bucket NotEmpty if multipart uploads folder exist 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c07820178f 
								
							
								 
							
						 
						
							
							
								
								fix s3 tests  
							
							
 
							
							
							bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b86628f85d 
								
							
								 
							
						 
						
							
							
								
								fix show empty dir  
							
							
 
							
							
							https://github.com/chrislusf/seaweedfs/issues/3086  
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								27732ecfa4 
								
							
								 
							
						 
						
							
							
								
								move s3 related constants from package http to s3_constants  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								62e5e3822c 
								
							
								 
							
						 
						
							
							
								
								list self dir  
							
							
 
							
							
							https://github.com/chrislusf/seaweedfs/issues/3086  
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26f3646961 
								
							
								 
							
						 
						
							
							
								
								show fake dirs  
							
							
 
							
							
							https://github.com/chrislusf/seaweedfs/issues/3086  
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								54356211c2 
								
							
								 
							
						 
						
							
							
								
								list empty folder  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9f9ef1340c 
								
							
								 
							
						 
						
							
							
								
								use streaming mode for long poll grpc calls  
							
							
 
							
							
							streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed. 
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4ec8715f20 
								
							
								 
							
						 
						
							
							
								
								audit log  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6e999f1176 
								
							
								 
							
						 
						
							
							
								
								s3: fix ListObject if more than 10000 objects  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f17fa400d5 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								006b4ec0f8 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								71175461ef 
								
							
								 
							
						 
						
							
							
								
								add glog for s3 handlers  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8b382a8209 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								33b87244ef 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e87e6ef33c 
								
							
								 
							
						 
						
							
							
								
								s3: return 404 if bucket does not exist  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/2039  
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								050a7f9599 
								
							
								 
							
						 
						
							
							
								
								s3: count correction for the number of files in the dir  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ccbdb38c89 
								
							
								 
							
						 
						
							
							
								
								s3: fix for listing objects if more than 1000 in the folder  
							
							
 
							
							
							many existing tools have max key set to 1000 
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								389426bbb7 
								
							
								 
							
						 
						
							
							
								
								s3: listing may repeat on the edge  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8a7302ce37 
								
							
								 
							
						 
						
							
							
								
								s3: KeyCount is zero  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1741  
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								561a2ff0bc 
								
							
								 
							
						 
						
							
							
								
								s3: add option for "alllowEmptyFolder"  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8e48a235e2 
								
							
								 
							
						 
						
							
							
								
								s3: avoid looping if the directory is empty  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1701  
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1620de08ae 
								
							
								 
							
						 
						
							
							
								
								added more logs  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a09cd28986 
								
							
								 
							
						 
						
							
							
								
								add debug messages  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3be3635799 
								
							
								 
							
						 
						
							
							
								
								just log error when checking empty dir failed  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0ca9d89589 
								
							
								 
							
						 
						
							
							
								
								s3: break loop if error  
							
							
 
							
							
							fix  #1701  
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								132f275d04 
								
							
								 
							
						 
						
							
							
								
								s3: log errors instead of stopping when checking isDirectoryAllEmpty has error  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								db62090f88 
								
							
								 
							
						 
						
							
							
								
								s3: break loop if error  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1701  
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5c465293e9 
								
							
								 
							
						 
						
							
							
								
								correctly determine whether a folder is empty  
							
							
 
							
							
							avoid edge cases that deleting the folder if previous 32 directories are all empty
early terminate if one file is found 
							
						 
						5 years ago