adasauce
61f4e40ad9
fix s3api: delimeter properly takes prefixes into account ( #5411 )
9 months ago
adasauce
3e3e0fa240
feat: add support for S3 ListObjects and ListObjectsV2 ( #5350 )
10 months ago
chrislu
7a0d1e7fc1
minor
1 year ago
Konstantin Lebedev
d75a7b7f62
allow deleting only older empty dir without recursion ( #4430 )
2 years ago
Konstantin Lebedev
5614ad0000
fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter ( #4399 )
* fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter
* fix list with delimiter and start token
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
Konstantin Lebedev
88b2bbadd1
try fix s3test test_bucket_listv2_delimiter_prefix ( #4396 )
2 years ago
Konstantin Lebedev
44ad07276c
s3 fix get list of dir object key with slash suffix ( #4391 )
* s3 fix get list of dir object key with slash suffix
https://github.com/seaweedfs/seaweedfs/issues/3086
* list only entry dir eq prefix
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
LHHDZ
db5515eada
Fix s3api_object_list_handlers returning contents less than the specified limit when more data actually exists ( #4240 )
Fix when the stored data is actually enough but s3api_object_list_handlers returns less than the specified limit
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
Konstantin Lebedev
2b910d1cf8
avoid recursive deleting newly created empty directories ( #4016 )
2 years ago
famosss
34132b2c9f
fix: isTruncated returns problematic ( #3907 )
2 years ago
Chris Lu
e88392b50f
Fix s3 pagination ( #3436 )
* Revert previous changes
* s3: use cursor to track tree traversal
fix https://github.com/seaweedfs/seaweedfs/issues/3166
* special cases for empty prefix and empty directory
* use constants
* address empty folder
* undo local changes
* fix IsTruncated
* adjust counting directories
* fix cases when prefix is a directory
* s3: handle directory object
works for
aws --endpoint-url http://127.0.0.1:8333/ s3api list-objects-v2 --bucket test --prefix "fakedir"
2 years ago
chrislu
90db4b5a44
minor
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
69ef6459c3
S3 ListObjectsV2 fix pagination under bucket root
fix https://github.com/chrislusf/seaweedfs/issues/3166
3 years ago
Konstantin Lebedev
3d5f1cbc5e
fix pagination
3 years ago
Konstantin Lebedev
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago
Konstantin Lebedev
c07820178f
fix s3 tests
bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter
3 years ago
Konstantin Lebedev
b86628f85d
fix show empty dir
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
chrislu
27732ecfa4
move s3 related constants from package http to s3_constants
3 years ago
Konstantin Lebedev
62e5e3822c
list self dir
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
Konstantin Lebedev
26f3646961
show fake dirs
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
Konstantin Lebedev
54356211c2
list empty folder
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Konstantin Lebedev
4ec8715f20
audit log
3 years ago
Chris Lu
6e999f1176
s3: fix ListObject if more than 10000 objects
3 years ago
Chris Lu
f17fa400d5
refactoring
3 years ago
Chris Lu
006b4ec0f8
refactoring
3 years ago
Chris Lu
71175461ef
add glog for s3 handlers
3 years ago
Chris Lu
8b382a8209
refactor
4 years ago
Chris Lu
33b87244ef
refactoring
4 years ago
Chris Lu
e87e6ef33c
s3: return 404 if bucket does not exist
fix https://github.com/chrislusf/seaweedfs/issues/2039
4 years ago
wuh-fnst
050a7f9599
s3: count correction for the number of files in the dir
4 years ago
Chris Lu
ccbdb38c89
s3: fix for listing objects if more than 1000 in the folder
many existing tools have max key set to 1000
4 years ago
Chris Lu
389426bbb7
s3: listing may repeat on the edge
4 years ago
Chris Lu
8a7302ce37
s3: KeyCount is zero
fix https://github.com/chrislusf/seaweedfs/issues/1741
4 years ago
Chris Lu
561a2ff0bc
s3: add option for "alllowEmptyFolder"
4 years ago
Chris Lu
8e48a235e2
s3: avoid looping if the directory is empty
fix https://github.com/chrislusf/seaweedfs/issues/1701
4 years ago
Chris Lu
1620de08ae
added more logs
4 years ago
Chris Lu
a09cd28986
add debug messages
4 years ago
Chris Lu
3be3635799
just log error when checking empty dir failed
4 years ago
Chris Lu
0ca9d89589
s3: break loop if error
fix #1701
4 years ago
Chris Lu
132f275d04
s3: log errors instead of stopping when checking isDirectoryAllEmpty has error
4 years ago
Chris Lu
db62090f88
s3: break loop if error
fix https://github.com/chrislusf/seaweedfs/issues/1701
4 years ago
Chris Lu
5c465293e9
correctly determine whether a folder is empty
avoid edge cases that deleting the folder if previous 32 directories are all empty
early terminate if one file is found
4 years ago
Chris Lu
f930c713fc
more efficient recursion
4 years ago
Chris Lu
03637d6f57
s3: move "delete-directory-if-empty" to read time
move "delete-directory-if-empty" to read time instead of entry deletion time
the listing speed for a s3 bucket folder will slow down if it has many sub folders
related to 0d345ac97d
fix https://github.com/chrislusf/seaweedfs/issues/1647
fix https://github.com/chrislusf/seaweedfs/issues/1670
4 years ago
Chris Lu
02a160c3fd
s3: recursively iterate all sub folders
fix https://github.com/chrislusf/seaweedfs/issues/1656
4 years ago
ruitao.liu
22a9ea0512
adjust s3 header file.
4 years ago
ruitao.liu
b917be7955
S3 bucket list, response with uploaded storageclass.
4 years ago
Chris Lu
5b40a2690a
refactoring
4 years ago