steve.wei
88fa64a01a
change comment for expect header ( #6289 )
* remove case of expect
* Set the default value of the Expect header for compatibility.
4 weeks ago
chrislu
6b2612690b
consistent error message if auth is not setup
fix https://github.com/seaweedfs/seaweedfs/issues/6262
1 month ago
han
65fb8fad99
Update filer_multipart.go ( #6188 )
fix the #6177 bug
2 months ago
chrislu
1c2b10303a
remove X-Forwarded-For
fix https://github.com/seaweedfs/seaweedfs/issues/6136
2 months ago
chrislu
0df4a4298b
adjust comment
2 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
2 months ago
chrislu
6845e25318
set proxied request content length
2 months ago
Konstantin Lebedev
44b275879b
[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers ( #6088 )
* add {Get,Put,Delete}BucketTagging Handlers
* s3 add skip bucket PublicAccessBlock handlers
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 months ago
chrislu
a3a8f6217e
fix
3 months ago
Konstantin Lebedev
a3556acd98
[s3] add skip bucket encryption handlers ( #6091 )
s3 add skip bucket encryption handlers
3 months ago
Er2
5644bc8f01
s3api: Fix signature v4 with reverse proxy at sub-path ( #6092 )
3 months ago
chrislu
f747767aa1
support load balancer in front of s3
3 months ago
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
3 months ago
chrislu
50e22864cf
refactor
3 months ago
chrislu
43d9f68219
more consistent server header for s3 apis
3 months ago
Konstantin Lebedev
16984ef07a
[s3] reducing the number of metrics for 403 ( #5961 )
reducing the number of metrics
4 months ago
chrislu
6ce27affa4
also use `/healthz` for most consistent health check
4 months ago
Oleg Salionov
4cfc7d3b10
Dont try lazy decode content in proxyToFiler if no accept-encoding provided ( #5907 )
4 months ago
Kamran Sarwar
63c707f9c1
added access-control-expose-headers to put request ( #5876 )
5 months ago
chrislu
aed2a18223
get, set and add path conf
5 months ago
vadimartynov
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
5 months ago
Konstantin Lebedev
9c440d472c
[s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function ( #5760 )
* revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function
* fix response error
* fix test_lifecycle_get
* Revert "fix test_lifecycle_get"
This reverts commit 8f991bdcf9
.
6 months ago
chrislu
b8121e4b24
simplify
6 months ago
chrislu
f618121e63
Fix S3 deletion in deep folders, and names with empty spaces
fix https://github.com/seaweedfs/seaweedfs/issues/5748
6 months ago
Konstantin Lebedev
f77eee667d
add s3test for sql ( #5718 )
* add s3test for sql
* fix test test_bucket_listv2_delimiter_basic for s3
* fix action s3tests
* regen s3 api xsd
* rm minor s3 test test_bucket_listv2_fetchowner_defaultempty
* add docs
* without xmlns
6 months ago
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const ( #5726 )
6 months ago
Lê Hoàng Nam
1f2dc54647
fix(s3api): make post api upload object default return 204 ( #5648 )
7 months ago
Riccardo Bertossa
f6e8a9bf9c
added s3 iam DeleteBucket permission management ( #5599 )
7 months ago
chrislu
1917f70f78
also delete parent folder if empty
fix https://github.com/seaweedfs/seaweedfs/issues/5567
8 months ago
chrislu
e6bfd061c7
AllowEmptyFolder checks during object deletion
8 months ago
chrislu
d521466a37
split file
8 months ago
chrislu
a1b59948cc
rename files
8 months ago
Konstantin Lebedev
3d3ee04eb9
[s3] Put bucket lifecycle configuration ( #5510 )
8 months ago
Konstantin Lebedev
33537ae29f
[s3] fix s3 test_multipart_get_part ( #5476 )
* try fix s3 test_multipart_get_part
* add passed s3 tests
* fix SeaweedFSUploadId
* rm spaces
* convert part request to range
* add passed s3 tests of multipart
8 months ago
clonefetch
9e07a87fcb
chore: fix function names in comment ( #5478 )
9 months ago
Konstantin Lebedev
3e25ed1b11
[s3] add s3 pass test_multipart_upload_size_too_small ( #5475 )
* add s3 pass test_multipart_upload_size_too_small
* refactor metric names
* return ErrNoSuchUpload if empty parts
* fix test
9 months ago
Konstantin Lebedev
35cba720a5
[s3] add s3 pass test_multipart_upload ( #5474 )
add s3 pass test_multipart_upload
9 months ago
Konstantin Lebedev
d42a04cceb
[s3] fix s3 test_multipart_resend_first_finishes_last ( #5471 )
* try fix s3 test
https://github.com/seaweedfs/seaweedfs/pull/5466
* add error handler metrics
* refactor
* refactor multipartExt
* delete bad entry parts
9 months ago
Nikita Borzykh
7aa25c1137
fix: correctly form partNumber from new entry.Name format in "listObjectParts" ( #5470 )
9 months ago
skycope
b19c9847c6
fix completed multiupload lost data ( #5460 )
If there are putObjectPart requests with the same uploadId during
completeMultiPart, it can result in data loss. putObjectPart requests
might be due to timeout retries.
Co-authored-by: Yang Wang <yangwang@weride.ai>
9 months ago
Nikita Borzykh
df9031e19a
fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. ( #5441 )
9 months ago
adasauce
61f4e40ad9
fix s3api: delimeter properly takes prefixes into account ( #5411 )
9 months ago
Konstantin Lebedev
170b63d6f8
[filer.backup] add param uploader_part_size for S3sink ( #5352 )
* fix: install cronie
* chore: refactor configure S3Sink
* chore: refactor cinfig
* add filer-backup compose file
* fix: X-Amz-Meta-Mtime and resolve with comments
* fix: attr mtime
* fix: MaxUploadPartst is reduced to the maximum allowable
* fix: env and force set max MaxUploadParts
* fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
10 months ago
adasauce
3e3e0fa240
feat: add support for S3 ListObjects and ListObjectsV2 ( #5350 )
10 months ago
7y-9
41ec9d7759
refactor: put the auth outside ( #5313 )
10 months ago
7y-9
f037c09c11
fix: only admin auth can delete S3 bucket ( #5312 )
10 months ago
sxlehua
ffe5f19aa0
Add s3 postpolicy support header ( #5280 )
* Add s3 postpolicy support header
* optimized code
11 months ago
sxlehua
0b49c16361
Adapt S3 POST ContentType ( #5275 )
11 months ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
12 months ago
Konstantin Lebedev
4f6172f369
Fix missing VersionConfiguration node in get-bucket-versioning response ( #5162 )
* fix: s3 response for get bucket version
https://github.com/seaweedfs/seaweedfs/issues/5155
* fix: s3 response for get bucket version
https://github.com/seaweedfs/seaweedfs/issues/5155
12 months ago