84b8f8f66d
build(deps): bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.116 ( #3870 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.44.114 to 1.44.116.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.114...v1.44.116 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
b0f80e0262
build(deps): bump docker/metadata-action from 4.0.1 to 4.1.0 ( #3869 )
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 4.0.1 to 4.1.0.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](69f6fc9d46
2 years ago
144ba3996a
build(deps): bump actions/dependency-review-action from 2.4.0 to 2.5.0 ( #3868 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 2.4.0 to 2.5.0.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](375c537008
2 years ago
23d85745c6
build(deps): bump docker/build-push-action from 3.1.1 to 3.2.0 ( #3867 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 3.1.1 to 3.2.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](c84f382811
2 years ago
2fa43f6948
build(deps): bump docker/setup-qemu-action from 2.0.0 to 2.1.0 ( #3866 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](8b122486ce
2 years ago
b889f734ec
build(deps): bump docker/login-action from 2.0.0 to 2.1.0 ( #3865 )
Bumps [docker/login-action](https://github.com/docker/login-action ) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/docker/login-action/releases )
- [Commits](49ed152c8e
2 years ago
1f2883f771
merge
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
4c280c06dc
Merge branch '1_bucket_write' into 10_acl_merged
# Conflicts:
# weed/s3api/s3api_acp.go
# weed/s3api/s3api_bucket_handlers.go
2 years ago
3a01ccd0fa
Merge branch '4_object_write' into 10_acl_merged
# Conflicts:
# weed/s3api/s3api_acp.go
# weed/s3api/s3api_object_handlers.go
# weed/s3api/s3err/s3api_errors.go
2 years ago
3a90a3279a
Merge branch '5_objectWriteAcl' into 10_acl_merged
# Conflicts:
# weed/s3api/s3api_acp.go
# weed/s3api/s3api_object_skip_handlers.go
# weed/s3api/s3err/s3api_errors.go
2 years ago
758d70bdc0
3.32
2 years ago
a05785edc9
Merge branch '6_object_read' into 10_acl_merged
# Conflicts:
# weed/s3api/s3acl/acl_helper.go
# weed/s3api/s3api_acp.go
2 years ago
ff6fabc000
Merge branch '7_object_read_acl' into 10_acl_merged
# Conflicts:
# weed/s3api/s3api_acp.go
2 years ago
714132dfe0
Merge branch '8_anonymous_access' into 10_acl_merged
2 years ago
c5804b99a0
Merge branch 'add_acl_hepler' into 10_acl_merged
2 years ago
de286fe662
shell: volume.move handles volume moved to cloud tier
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2 years ago
52e0a88a15
shell: volume.tier.upload clean up replicated copies
fix https://github.com/seaweedfs/seaweedfs/issues/3804
2 years ago
949607fe90
refactor(compose)!: upgrade to v2 closes #3699 ( #3705 )
* docs(compose): Update readme for compose v2 upgrade
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade `Makefile` for compose v2
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade yml from version 2 -> 3.9
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
e20f0dbd2d
avoid data race of TraverseBfs ( #3856 )
* avoid data race of TraverseBfs
* close is enough
avoid panic
I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255
I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c]
goroutine 287 [running]:
github.com/seaweedfs/seaweedfs/weed/storage.(*SortedFileNeedleMap).Close(0x0)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load.func1()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c
github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes.func2()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9
created by github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150
2 years ago
ee38ab8581
avoid data race of LogBuffer isStopping ( #3859 )
2 years ago
7836f7574e
[volume.fsck] hotfix apply purging and add option verifyNeedle #3860 ( #3861 )
* fix apply purging and add verifyNeedle
* common readSourceNeedleBlob
* use consts
2 years ago
f476cf3403
fix volume_server.proto conflict ( #3858 )
fix conflict
https://github.com/seaweedfs/seaweedfs/pull/3841
2 years ago
5c2eb602c9
Revert "mount: remove mount directory from generating cache directory id"
This reverts commit 109dc7fdf6
2 years ago
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
f19c9e3d9d
Volume fsck by volume ( #3851 )
* refactor
* refactor args verbose and writer
* refactor readFilerFileIdFile
* fix filter by collectMtime
* skip system log collection
2 years ago
9c8678ded9
ensure monotonic n.AppendAtNs
fix https://github.com/seaweedfs/seaweedfs/issues/3852
2 years ago
e05637c42c
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2 years ago
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2 years ago
a5b867af69
don't skip empty value at `AssembleEntryWithAcp` ( #3855 )
* add acl helper functionalities
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* add tests
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* remove 0 when create map
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* delete when empty at `AssembleEntryWithAcp`
`PutBucketAcl/PutObjectAcl` allow request with empty grants, `AssembleEntryWithAcp` shouldn't skip empty value
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
54d8255d5b
Merge branch 'master' into add_acl_hepler
# Conflicts:
# weed/s3api/s3acl/acl_helper.go
# weed/s3api/s3acl/acl_helper_test.go
2 years ago
b8f7e75c3d
delete when empty at `AssembleEntryWithAcp`
`PutBucketAcl/PutObjectAcl` allow request with empty grants, `AssembleEntryWithAcp` shouldn't skip empty value
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
f3a57c1623
Merge branch '3_bucket_read'
# Conflicts:
# weed/s3api/s3api_acp.go
2 years ago
96f39f2fa8
Merge branch '2_bucket_write_acl'
# Conflicts:
# weed/s3api/s3api_bucket_handlers.go
# weed/s3api/s3err/s3api_errors.go
2 years ago
2227888acc
validate grants when setting ownership to `OwnershipBucketOwnerEnforced`
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
e576e4cee8
enable anonymous access when bucket acl is enabled
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
4b36721323
implement `GetObjectAclHandler`
2 years ago
f79a3a73ee
add acl support for `PutObjectAcl`
2 years ago
af093721a2
add acl support for `PutObject` and `PutObjectPart`
2 years ago
e76f66a0d0
add acl validation for s3 bucket read api
2 years ago
558ba1094a
implement `PutBucketAclHandler`
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
bbecba266d
extract and save acl when create bucket
2 years ago
daf5b4d59b
add acl validation for s3 GetObjectHandler
2 years ago
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
2 years ago
f5d4952d73
filer: redis store reduce from 2 redis operations to 1 for updates.
2 years ago
f95c25e113
types packages is imported more than onece ( #3838 )
2 years ago
9a339a9cfb
default hasSlowRead to true
2 years ago
cacc3e883b
volume server:set the default value of "hasSlowRead" to true ( #3710 )
* simplify a bit
* feat: volume: add "readBufSize" option to customize read optimization
* refactor : redbufSIze -> readBufferSize
* simplify a bit
* simplify a bit
* volume server:set the default value of "hasSlowRead" to true
2 years ago
bf5e45b66a
add acl helper functionalities ( #3831 )
2 years ago
f1c05eb2fb
remove 0 when create map
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
401315f337
master fix interruption through ctrl+c ( #3834 )
2 years ago
dependabot[bot]
changlin.shi
chrislu
Ryan Russell
Konstantin Lebedev
Guo Lei
famosss