Konstantin Lebedev
2b910d1cf8
avoid recursive deleting newly created empty directories ( #4016 )
2 years ago
chrislu
70a4c98b00
refactor filer_pb.Entry and filer.Entry to use GetChunks()
for later locking on reading chunks
2 years ago
LHHDZ
39f0246deb
fix 'NoSuchUpload' when upload part ( #3968 )
2 years ago
famosss
df0662038c
feat:add a uuid after uploadid ( #3963 )
2 years ago
pavelzhurov
abe4a61659
Bug fix: empty key in DeleteMultipleObjects request caused bucket delete ( #3939 )
2 years ago
chrislu
8b9957d461
add back "/" prefix if it is missing in object
fix https://github.com/seaweedfs/seaweedfs/issues/3737
2 years ago
chrislu
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
famosss
34132b2c9f
fix: isTruncated returns problematic ( #3907 )
2 years ago
famosss
874fd197b5
feat: simplify a bit ( #3905 )
2 years ago
famosss
25e012d30b
fix: set user metadata key to lowercase ( #3894 )
* fix: set user metadata key to lowercase
* feat: simplify a bit
2 years ago
Guo Lei
97edb40275
Fix errinfo ( #3893 )
* types packages is imported more than onece
* Fix error response when format of --expires is wrong.
It MUST be in RFC 1123 date format.
2 years ago
LHHDZ
a5b867af69
don't skip empty value at `AssembleEntryWithAcp` ( #3855 )
* add acl helper functionalities
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* add tests
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* remove 0 when create map
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* delete when empty at `AssembleEntryWithAcp`
`PutBucketAcl/PutObjectAcl` allow request with empty grants, `AssembleEntryWithAcp` shouldn't skip empty value
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
LHHDZ
bf5e45b66a
add acl helper functionalities ( #3831 )
2 years ago
LHHDZ
d21e2f523d
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unn… ( #3824 )
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unnecessary `json.Unmarshal()` call
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
LHHDZ
3550692afc
change s3_account.go package to avoid cycle dependency ( #3813 )
2 years ago
Konstantin Lebedev
ec46a34f33
avoid increasing the coordinates of metric labels ( #3785 )
2 years ago
LHHDZ
e9584d9661
add ownership rest apis ( #3765 )
2 years ago
LHHDZ
3de1e19780
s3: sync bucket info from filer ( #3759 )
2 years ago
LHHDZ
aacdcc4cad
s3: add account ( #3753 )
associate `Account` and `Identity` by accountId
2 years ago
chrislu
31922b2bf2
s3 to watch specific directories
2 years ago
Ryan Russell
6f7ef8711a
docs(s3api): readability improvements ( #3696 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
ad3a3c8782
refactor(s3api_object_handlers): `deleteMultipleObjectsLimmit` -> `de… ( #3695 )
refactor(s3api_object_handlers): `deleteMultipleObjectsLimmit` -> `deleteMultipleObjectsLimit`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
ImFantuan
b64411bda8
fix 0 size ( #3683 )
2 years ago
famosss
bb880d6253
IsTruncated returned by the ListMultipartUploads method is set to false by default ( #3682 )
* simplify a bit
* fix: IsTruncated returned by the ListMultipartUploads method is set to false by default
2 years ago
chrislu
21c0587900
go fmt
2 years ago
Ryan Russell
d54eb9966f
refactor: `Directory` readability ( #3665 )
2 years ago
Konstantin Lebedev
8c3040db81
avoid DATA RACE on S3Options.localFilerSocket ( #3571 )
* avoid DATA RACE on S3Options.localFilerSocket
https://github.com/seaweedfs/seaweedfs/issues/3552
* copy localSocket
2 years ago
chrislu
a54f30b6c6
s3: close response body with copying object
2 years ago
Konstantin Lebedev
f7aeb06544
s3: report metadata if the directory is explicitly created ( #3498 )
* replace mkdir to mkFile
* ContentLength must be zero
* revert mkDir
* Seaweedfs-Is-Directory-Key return metadata
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
9fce75607d
s3: report http.StatusOK if the directory is explicitly created
fix https://github.com/seaweedfs/seaweedfs/issues/3457
2 years ago
famosss
7eb15b1969
fix:Handle preflight cors requests ( #3496 )
2 years ago
famosss
bdba3da2e4
Handle preflight cors requests ( #3481 )
2 years ago
chrislu
42c6e52513
s3: fix regression on HEAD directory operation
2 years ago
chrislu
4573c99ae3
fix tests
2 years ago
chrislu
2b580a7566
also migrate jsonpb
2 years ago
chrislu
eaeb141b09
move proto package
2 years ago
Andrey Triumfov
31faa6d43d
Remove duplicate slashes in object path to prevent 500 errors ( #3442 )
2 years ago
Chris Lu
e88392b50f
Fix s3 pagination ( #3436 )
* Revert previous changes
* s3: use cursor to track tree traversal
fix https://github.com/seaweedfs/seaweedfs/issues/3166
* special cases for empty prefix and empty directory
* use constants
* address empty folder
* undo local changes
* fix IsTruncated
* adjust counting directories
* fix cases when prefix is a directory
* s3: handle directory object
works for
aws --endpoint-url http://127.0.0.1:8333/ s3api list-objects-v2 --bucket test --prefix "fakedir"
2 years ago
chrislu
7457c746f0
s3: fix aws s3api head-object
2 years ago
chrislu
67814a5c79
refactor and fix strings.Split
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
chrislu
90db4b5a44
minor
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
LHHDZ
c08f6d0ff7
File upload should succeed should return `ETag` instead of `Etag`
at `/go-1.18.1/src/net/textproto/header.go:39`, header is canonicalized by `textproto.CanonicalMIMEHeaderKey`
2 years ago
guosj
ab1b9697e6
supplement check duplicate accesskey
2 years ago
chrislu
69ef6459c3
S3 ListObjectsV2 fix pagination under bucket root
fix https://github.com/chrislusf/seaweedfs/issues/3166
3 years ago
Konstantin Lebedev
3d5f1cbc5e
fix pagination
3 years ago
Konstantin Lebedev
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago