steve.wei
88fa64a01a
change comment for expect header ( #6289 )
* remove case of expect
* Set the default value of the Expect header for compatibility.
3 months ago
chrislu
6b2612690b
consistent error message if auth is not setup
fix https://github.com/seaweedfs/seaweedfs/issues/6262
3 months ago
han
65fb8fad99
Update filer_multipart.go ( #6188 )
fix the #6177 bug
4 months ago
chrislu
1c2b10303a
remove X-Forwarded-For
fix https://github.com/seaweedfs/seaweedfs/issues/6136
4 months ago
chrislu
0df4a4298b
adjust comment
4 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
4 months ago
chrislu
6845e25318
set proxied request content length
5 months ago
Konstantin Lebedev
44b275879b
[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers ( #6088 )
* add {Get,Put,Delete}BucketTagging Handlers
* s3 add skip bucket PublicAccessBlock handlers
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
5 months ago
chrislu
a3a8f6217e
fix
5 months ago
Konstantin Lebedev
a3556acd98
[s3] add skip bucket encryption handlers ( #6091 )
s3 add skip bucket encryption handlers
5 months ago
Er2
5644bc8f01
s3api: Fix signature v4 with reverse proxy at sub-path ( #6092 )
5 months ago
chrislu
f747767aa1
support load balancer in front of s3
5 months ago
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
5 months ago
chrislu
50e22864cf
refactor
5 months ago
chrislu
43d9f68219
more consistent server header for s3 apis
6 months ago
Konstantin Lebedev
16984ef07a
[s3] reducing the number of metrics for 403 ( #5961 )
reducing the number of metrics
6 months ago
chrislu
6ce27affa4
also use `/healthz` for most consistent health check
6 months ago
Oleg Salionov
4cfc7d3b10
Dont try lazy decode content in proxyToFiler if no accept-encoding provided ( #5907 )
6 months ago
Kamran Sarwar
63c707f9c1
added access-control-expose-headers to put request ( #5876 )
7 months ago
chrislu
aed2a18223
get, set and add path conf
7 months ago
vadimartynov
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
7 months ago
Konstantin Lebedev
9c440d472c
[s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function ( #5760 )
* revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function
* fix response error
* fix test_lifecycle_get
* Revert "fix test_lifecycle_get"
This reverts commit 8f991bdcf9
.
8 months ago
chrislu
b8121e4b24
simplify
8 months ago
chrislu
f618121e63
Fix S3 deletion in deep folders, and names with empty spaces
fix https://github.com/seaweedfs/seaweedfs/issues/5748
8 months ago
Konstantin Lebedev
f77eee667d
add s3test for sql ( #5718 )
* add s3test for sql
* fix test test_bucket_listv2_delimiter_basic for s3
* fix action s3tests
* regen s3 api xsd
* rm minor s3 test test_bucket_listv2_fetchowner_defaultempty
* add docs
* without xmlns
8 months ago
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const ( #5726 )
8 months ago
Lê Hoàng Nam
1f2dc54647
fix(s3api): make post api upload object default return 204 ( #5648 )
9 months ago
Riccardo Bertossa
f6e8a9bf9c
added s3 iam DeleteBucket permission management ( #5599 )
9 months ago
chrislu
1917f70f78
also delete parent folder if empty
fix https://github.com/seaweedfs/seaweedfs/issues/5567
10 months ago
chrislu
e6bfd061c7
AllowEmptyFolder checks during object deletion
10 months ago
chrislu
d521466a37
split file
10 months ago
chrislu
a1b59948cc
rename files
10 months ago
Konstantin Lebedev
3d3ee04eb9
[s3] Put bucket lifecycle configuration ( #5510 )
10 months ago
Konstantin Lebedev
33537ae29f
[s3] fix s3 test_multipart_get_part ( #5476 )
* try fix s3 test_multipart_get_part
* add passed s3 tests
* fix SeaweedFSUploadId
* rm spaces
* convert part request to range
* add passed s3 tests of multipart
10 months ago
clonefetch
9e07a87fcb
chore: fix function names in comment ( #5478 )
11 months ago
Konstantin Lebedev
3e25ed1b11
[s3] add s3 pass test_multipart_upload_size_too_small ( #5475 )
* add s3 pass test_multipart_upload_size_too_small
* refactor metric names
* return ErrNoSuchUpload if empty parts
* fix test
11 months ago
Konstantin Lebedev
35cba720a5
[s3] add s3 pass test_multipart_upload ( #5474 )
add s3 pass test_multipart_upload
11 months ago
Konstantin Lebedev
d42a04cceb
[s3] fix s3 test_multipart_resend_first_finishes_last ( #5471 )
* try fix s3 test
https://github.com/seaweedfs/seaweedfs/pull/5466
* add error handler metrics
* refactor
* refactor multipartExt
* delete bad entry parts
11 months ago
Nikita Borzykh
7aa25c1137
fix: correctly form partNumber from new entry.Name format in "listObjectParts" ( #5470 )
11 months ago
skycope
b19c9847c6
fix completed multiupload lost data ( #5460 )
If there are putObjectPart requests with the same uploadId during
completeMultiPart, it can result in data loss. putObjectPart requests
might be due to timeout retries.
Co-authored-by: Yang Wang <yangwang@weride.ai>
11 months ago
Nikita Borzykh
df9031e19a
fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. ( #5441 )
11 months ago
adasauce
61f4e40ad9
fix s3api: delimeter properly takes prefixes into account ( #5411 )
11 months ago
Konstantin Lebedev
170b63d6f8
[filer.backup] add param uploader_part_size for S3sink ( #5352 )
* fix: install cronie
* chore: refactor configure S3Sink
* chore: refactor cinfig
* add filer-backup compose file
* fix: X-Amz-Meta-Mtime and resolve with comments
* fix: attr mtime
* fix: MaxUploadPartst is reduced to the maximum allowable
* fix: env and force set max MaxUploadParts
* fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
12 months ago
adasauce
3e3e0fa240
feat: add support for S3 ListObjects and ListObjectsV2 ( #5350 )
12 months ago
7y-9
41ec9d7759
refactor: put the auth outside ( #5313 )
1 year ago
7y-9
f037c09c11
fix: only admin auth can delete S3 bucket ( #5312 )
1 year ago
sxlehua
ffe5f19aa0
Add s3 postpolicy support header ( #5280 )
* Add s3 postpolicy support header
* optimized code
1 year ago
sxlehua
0b49c16361
Adapt S3 POST ContentType ( #5275 )
1 year ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
1 year ago
Konstantin Lebedev
4f6172f369
Fix missing VersionConfiguration node in get-bucket-versioning response ( #5162 )
* fix: s3 response for get bucket version
https://github.com/seaweedfs/seaweedfs/issues/5155
* fix: s3 response for get bucket version
https://github.com/seaweedfs/seaweedfs/issues/5155
1 year ago