famosss
7eb15b1969
fix:Handle preflight cors requests ( #3496 )
2 years ago
famosss
bdba3da2e4
Handle preflight cors requests ( #3481 )
2 years ago
chrislu
42c6e52513
s3: fix regression on HEAD directory operation
2 years ago
chrislu
4573c99ae3
fix tests
2 years ago
chrislu
2b580a7566
also migrate jsonpb
2 years ago
chrislu
eaeb141b09
move proto package
2 years ago
Andrey Triumfov
31faa6d43d
Remove duplicate slashes in object path to prevent 500 errors ( #3442 )
2 years ago
Chris Lu
e88392b50f
Fix s3 pagination ( #3436 )
* Revert previous changes
* s3: use cursor to track tree traversal
fix https://github.com/seaweedfs/seaweedfs/issues/3166
* special cases for empty prefix and empty directory
* use constants
* address empty folder
* undo local changes
* fix IsTruncated
* adjust counting directories
* fix cases when prefix is a directory
* s3: handle directory object
works for
aws --endpoint-url http://127.0.0.1:8333/ s3api list-objects-v2 --bucket test --prefix "fakedir"
2 years ago
chrislu
7457c746f0
s3: fix aws s3api head-object
2 years ago
chrislu
67814a5c79
refactor and fix strings.Split
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
chrislu
90db4b5a44
minor
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
LHHDZ
c08f6d0ff7
File upload should succeed should return `ETag` instead of `Etag`
at `/go-1.18.1/src/net/textproto/header.go:39`, header is canonicalized by `textproto.CanonicalMIMEHeaderKey`
2 years ago
guosj
ab1b9697e6
supplement check duplicate accesskey
2 years ago
chrislu
69ef6459c3
S3 ListObjectsV2 fix pagination under bucket root
fix https://github.com/chrislusf/seaweedfs/issues/3166
3 years ago
Konstantin Lebedev
3d5f1cbc5e
fix pagination
3 years ago
Konstantin Lebedev
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago
Lapshin Vitaliy
7c3d9d0535
remove println
3 years ago
Lapshin Vitaliy
61b2e3f9a2
fix return
3 years ago
Lapshin Vitaliy
606252472c
fix return
3 years ago
Lapshin Vitaliy
e969370913
fix parseTagging function and add test for validate tags
3 years ago
Lapshin Vitaliy
1a5981d583
fix test
3 years ago
chrislu
b9f7b6fb9a
adjust log message
3 years ago
石昌林
15bfc60a88
Remove the collection query param of s3api and let the collection be determined by the filer
3 years ago
石昌林
be5c901bea
Fix global counter key is incorrect & Add read lock when reading counter map to avoid memory problems
3 years ago
Lapshin Vitaliy
5f5fd0bc48
validate tags on copy object and add regex for validating tags
3 years ago
guol-fnst
1d77deccd0
AbortMultipartUploadHandler should return 204 instead of 200
https://docs.aws.amazon.com/AmazonS3/latest/API/API_AbortMultipartUpload.html
3 years ago
石昌林
9e036df356
remove go.uber.org/atomic
3 years ago
石昌林
3dd60529c5
some code optimizations
3 years ago
石昌林
37df209195
add some unit tests and some code optimizes
3 years ago
zzq09494
62f74f5e3c
add bucket label to s3 prometheus metrics
3 years ago
石昌林
78b3728169
add s3 circuit breaker support for 'simultaneous request count' and 'simultaneous request bytes' limitations
configure s3 circuit breaker by 'command_s3_circuitbreaker.go':
usage eg:
# Configure the number of simultaneous global (current s3api node) requests
s3.circuit.breaker -global -type count -actions Write -values 1000 -apply
# Configure the number of simultaneous requests for bucket x read and write
s3.circuit.breaker -buckets -type count -actions Read,Write -values 1000 -apply
# Configure the total bytes of simultaneous requests for bucket write
s3.circuit.breaker -buckets -type bytes -actions Write -values 100MiB -apply
# Disable circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -enable false -apply
# Delete circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -delete -apply
3 years ago
shichanglin5
f01dd27752
fix: When there is no access permission configured before startup, the authentication does not take effect after configuring the permission after startup
3 years ago
Konstantin Lebedev
49f058da85
fix s3 tests:
ranged_request_invalid_range
ranged_request_empty_object
3 years ago
Konstantin Lebedev
c07820178f
fix s3 tests
bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter
3 years ago
creeew
02ae102731
fix filer.sync missing source srv uploaded files to target when target down
3 years ago
Konstantin Lebedev
b86628f85d
fix show empty dir
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
chrislu
27732ecfa4
move s3 related constants from package http to s3_constants
3 years ago
chrislu
596c3860ca
use final destination to resolve fs configuration
related to https://github.com/chrislusf/seaweedfs/issues/3075
3 years ago
chrislu
a2b101a737
subscribe metadata between a range
3 years ago
Konstantin Lebedev
af562e1a20
rm log info
3 years ago
Konstantin Lebedev
62e5e3822c
list self dir
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
Konstantin Lebedev
26f3646961
show fake dirs
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
chrislu
b8f3db0d46
s3: keep auth enabled in case identities are set to empty
fix https://github.com/chrislusf/seaweedfs/issues/3084
3 years ago
Konstantin Lebedev
54356211c2
list empty folder
3 years ago
chrislu
866fed1eab
avoid grpc name conflict
fix https://github.com/chrislusf/seaweedfs/issues/3055
3 years ago
chrislu
29198720f2
s3: add grpc server to accept configuration changes
3 years ago
shichanglin5
688d55488c
test(s3api_object_copy_handlers_test.go): some unit tests have been added to the processMetadata & processMetadataBytes methods of s3api_object_copy_handlers.go
3 years ago