cbc24c7b24
disconnect from old subscribers
1 year ago
7b3c63a8af
handle wrapped errors
1 year ago
4e493d596c
minor
1 year ago
b02fdeabff
RetryForever => RetryUntil
1 year ago
645ae8c57b
Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs ""
This reverts commit 8cb42c39
1 year ago
f8b94cac0e
[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )
* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
750a0ba1b2
[iam] Replace action read/write to readAcp/writeAcp for handlers with acl ( #4858 )
Replace action read/write to readAcp/writeAcp for handlers with acl query
https://github.com/seaweedfs/seaweedfs/issues/4519
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
1 year ago
a46f873edd
[s3acl] Step 0: Put bucket ACL only responds success if the ACL is private. ( #4856 )
* Passing test:
test_bucket_acl_default
test_bucket_acl_canned_private_to_private
https://github.com/seaweedfs/seaweedfs/issues/4519
* Update weed/s3api/s3api_bucket_handlers.go
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
d8b424d123
[s3] optimization iam lookup for reducing algorithm complexity ( #4857 )
optimization iam lookup for reducing algorithm complexity
https://github.com/seaweedfs/seaweedfs/issues/4519
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
1 year ago
cf28108ea4
fix grpd dial option
1 year ago
8cb42c39ad
Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs "
This reverts commit 2e5aa060264d414f54a2
1 year ago
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 year ago
98dcec0ee2
Clean up old signature hash pools
1 year ago
cdd817edf9
Improve S3 request signing performance
This change is caching HMAC hashers for repeated use in subsequent
requests and chunks, so they don't have to be initialized from
scratch every time.
On my local computer this gives me ~5-6 times faster signature
calculation and ~5-6.5% more throughput in S3 requests. The smaller
the payload the better the throughput gets.
2 years ago
f61490966f
Add time to first byte metric for s3 ( #4768 )
* Add time to first byte metric for s3
* Change second to millisecond
2 years ago
6792db21dc
ErrInvalidPart when completed parts has extra parts
fix https://github.com/seaweedfs/seaweedfs/discussions/4746
2 years ago
51bcc219ea
s3api should return 500 code from filer ( #4699 )
2 years ago
89542db2d0
Fix S3 API multipart upload on Windows ( #4666 )
The file paths were being having '/' changed to '\' by filepath.Dir()
resulting in a file being created with '\' separators, but when trying
to read the files, the same wasn't happening.
Co-authored-by: Hendrik Appel <happel@europe.altair.com>
2 years ago
17e91d2917
Use filerGroup for s3 buckets collection prefix ( #4465 )
* Use filerGroup for s3 buckets collection prefix
* Fix templates
* Remove flags
* Remove s3CollectionPrefix
2 years ago
d75a7b7f62
allow deleting only older empty dir without recursion ( #4430 )
2 years ago
fa8698f6c3
perf(fix): fix bugs
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
5614ad0000
fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter ( #4399 )
* fix s3test test_bucket_listv2_delimiter_prefix_ends_with_delimiter
* fix list with delimiter and start token
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
88b2bbadd1
try fix s3test test_bucket_listv2_delimiter_prefix ( #4396 )
2 years ago
095cdb0c7f
fix test prefix is a directory ( #4393 )
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
44ad07276c
s3 fix get list of dir object key with slash suffix ( #4391 )
* s3 fix get list of dir object key with slash suffix
https://github.com/seaweedfs/seaweedfs/issues/3086
* list only entry dir eq prefix
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
130bc3e668
s3 fix get fake dir object key ( #4390 )
2 years ago
6bfb91b539
update entry Attributes.Mtime = time.Now().Unix()
fix https://github.com/seaweedfs/seaweedfs/issues/4337
2 years ago
5db9fcccd4
refactoring
2 years ago
0bf56298d5
fix chunk.ModifiedTsNs ( #4264 )
* fix
* fix mtime s > ns
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2 years ago
db5515eada
Fix s3api_object_list_handlers returning contents less than the specified limit when more data actually exists ( #4240 )
Fix when the stored data is actually enough but s3api_object_list_handlers returns less than the specified limit
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
af40b7d7a2
Fix when the stored data is actually enough but s3api_object_list_handlers returns less than the specified limit
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
d393937c90
compatible with aws-sdk-go's cxpect header
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
79d68a81fd
text change
2 years ago
999a126a3f
typo
2 years ago
1c2364936a
detect invalid bucket name
fix https://github.com/seaweedfs/seaweedfs/issues/4143
2 years ago
5de93fe442
refactoring
2 years ago
81fdf3651b
grpc connection to filer add sw-client-id header
2 years ago
6f40451e4e
optimize marshal
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
7fec1a97e2
fix tests
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
5f993a5f20
Fix ide warning ( #4082 )
fix warning message from IDE
"redundant type from array, slice, or map composite literal"
2 years ago
d2792c5618
clear cache when put bucket
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
f84c13dabd
fix response not allowed ( #4057 )
2 years ago
0c3009911e
optimize readability
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
bb289d7d69
sort tags by key ( #4047 )
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
5d582ab848
set bucket ownership if not empty
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
c2c4158238
create bucket with ownership
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
89942cf015
fix nil pointer when no identity config init
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
2769a96f13
dont't set destination when copy object
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
2b910d1cf8
avoid recursive deleting newly created empty directories ( #4016 )
2 years ago
3b69ce6c3d
set accept-encoding if empty
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
chrislu
Konstantin Lebedev
dependabot[bot]
Patrick Schmidt
SmsS4
SmoothDenis
Henco Appel
changlin.shi
zemul
Guo Lei