c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
4 days ago
eab2e0e112
`ec.encode`: Fix bug causing source volumes not being deleted after EC conversion. ( #6447 )
This logic was originally part of `spreadEcShards()`, which got removed during
the unification effort with `ec.balance` (https://github.com/seaweedfs/seaweedfs/pull/6344 ),
accidentally breaking functionality in the process.
The commit restores the deletion code for EC'd volumes - with parallelization support.
4 days ago
c7ae969c06
Add bucket's traffic metrics ( #6444 )
* Add bucket's traffic metrics
* Add bucket traffic to dashboards
* Fix bucket metrics help messages
* Fix variable names
5 days ago
aa299462f2
improve iam error handling ( #6446 )
* improve iam error handling
* Delete docker/test.py
5 days ago
2304d2b472
Bugfix s3 audit missing requester for PUT requests ( #6434 )
fix s3 audit missing requster for PUT
5 days ago
1609682ac2
chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1 ( #6437 )
* chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.30.0 to 0.31.1.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.30.0...v0.31.1 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix compilation
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 week ago
12365ec6ae
chore(deps): bump google.golang.org/api from 0.214.0 to 0.216.0 ( #6439 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.214.0 to 0.216.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.214.0...v0.216.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 week ago
a0cf717432
chore(deps): bump github.com/hashicorp/raft from 1.7.1 to 1.7.2 ( #6438 )
Bumps [github.com/hashicorp/raft](https://github.com/hashicorp/raft ) from 1.7.1 to 1.7.2.
- [Release notes](https://github.com/hashicorp/raft/releases )
- [Changelog](https://github.com/hashicorp/raft/blob/main/CHANGELOG.md )
- [Commits](https://github.com/hashicorp/raft/compare/v1.7.1...v1.7.2 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/raft
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 week ago
caf5c05dc0
chore(deps): bump modernc.org/mathutil from 1.7.0 to 1.7.1 ( #6436 )
Bumps [modernc.org/mathutil](https://gitlab.com/cznic/mathutil ) from 1.7.0 to 1.7.1.
- [Commits](https://gitlab.com/cznic/mathutil/compare/v1.7.0...v1.7.1 )
---
updated-dependencies:
- dependency-name: modernc.org/mathutil
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 week ago
8e694c0512
chore(deps): bump cloud.google.com/go/storage from 1.49.0 to 1.50.0 ( #6435 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.49.0 to 1.50.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.49.0...spanner/v1.50.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 week ago
e7f2936dcc
fix force arg dropped during volume balance command ( #6432 )
1 week ago
da2a234b00
[weed] change -n to -force ( #6421 )
2 weeks ago
39c1dde9df
3.81
2 weeks ago
d6459d74f4
chore(deps): bump github.com/rdleal/intervalst from 1.4.0 to 1.4.1 ( #6414 )
Bumps [github.com/rdleal/intervalst](https://github.com/rdleal/intervalst ) from 1.4.0 to 1.4.1.
- [Commits](https://github.com/rdleal/intervalst/compare/v1.4.0...v1.4.1 )
---
updated-dependencies:
- dependency-name: github.com/rdleal/intervalst
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
630aa6fff6
chore(deps): bump golang.org/x/sys from 0.28.0 to 0.29.0 ( #6413 )
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.28.0 to 0.29.0.
- [Commits](https://github.com/golang/sys/compare/v0.28.0...v0.29.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
568c5df50b
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.71.1 to 1.72.0 ( #6412 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.71.1 to 1.72.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.71.1...service/s3/v1.72.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
b0977c11ec
chore(deps): bump cloud.google.com/go/storage from 1.48.0 to 1.49.0 ( #6410 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.48.0 to 1.49.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.48.0...spanner/v1.49.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
bc3640ee64
Update command_fs_merge_volumes.go ( #6406 )
3 weeks ago
56123d1b03
Update LICENSE, fix copyright license year ( #6405 )
3 weeks ago
3b1ac77e1f
worm grace period and retention time support ( #6404 )
Signed-off-by: lou <alex1988@outlook.com>
3 weeks ago
0e8e6122d5
chore(deps): bump golang.org/x/image from 0.21.0 to 0.23.0 ( #6399 )
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.21.0 to 0.23.0.
- [Commits](https://github.com/golang/image/compare/v0.21.0...v0.23.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
bbf745d4e1
chore(deps): bump github.com/linxGnu/grocksdb from 1.9.7 to 1.9.8 ( #6398 )
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.9.7 to 1.9.8.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.9.7...v1.9.8 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
abc92e7338
chore(deps): bump github.com/parquet-go/parquet-go from 0.23.1-0.20241011155651-6446d1d0d2fe to 0.24.0 ( #6400 )
chore(deps): bump github.com/parquet-go/parquet-go
Bumps [github.com/parquet-go/parquet-go](https://github.com/parquet-go/parquet-go ) from 0.23.1-0.20241011155651-6446d1d0d2fe to 0.24.0.
- [Release notes](https://github.com/parquet-go/parquet-go/releases )
- [Changelog](https://github.com/parquet-go/parquet-go/blob/main/CHANGELOG.md )
- [Commits](https://github.com/parquet-go/parquet-go/commits/v0.24.0 )
---
updated-dependencies:
- dependency-name: github.com/parquet-go/parquet-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
276cc7802f
chore(deps): bump golang.org/x/net from 0.32.0 to 0.33.0 ( #6401 )
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.32.0 to 0.33.0.
- [Commits](https://github.com/golang/net/compare/v0.32.0...v0.33.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
824e183347
chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.46 to 1.17.48 ( #6402 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials
Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2 ) from 1.17.46 to 1.17.48.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/credentials/v1.17.46...credentials/v1.17.48 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/credentials
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
0594006c81
use same time format in volume volume UI and filter UI ( #6395 )
use same time format in volume server UI with filter UI
4 weeks ago
ab1984a852
chore(deps): bump google.golang.org/grpc from 1.67.2 to 1.69.2 ( #6391 )
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.67.2 to 1.69.2.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.67.2...v1.69.2 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
e4d0dce904
Replace bolt dependency with bbolt ( #6387 )
There are some dependencies that still depends on the unmaintained bolt after
https://github.com/seaweedfs/seaweedfs/pull/3554 . Replace it so that we can
have one less dependency, and build on newer architecture like RISC-V.
Two lines of `replace` are required because Go refuses to replace
`github.com/boltdb/bolt` with `go.etcd.io/bbolt` when the latter is also
present in the dependency tree. Replace it again with
`github.com/etcd-io/bbolt` solves the issue.
4 weeks ago
9b9101b46b
chore(deps): bump modernc.org/mathutil from 1.6.0 to 1.7.0 ( #6389 )
Bumps [modernc.org/mathutil](https://gitlab.com/cznic/mathutil ) from 1.6.0 to 1.7.0.
- [Commits](https://gitlab.com/cznic/mathutil/compare/v1.6.0...v1.7.0 )
---
updated-dependencies:
- dependency-name: modernc.org/mathutil
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
28a4f73033
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.71.0 to 1.71.1 ( #6390 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.71.0 to 1.71.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.71.0...service/s3/v1.71.1 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
87fdaa3451
chore(deps): bump modernc.org/sqlite from 1.34.1 to 1.34.4 ( #6392 )
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.34.1 to 1.34.4.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.34.1...v1.34.4 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
b3ccc095ba
chore(deps): bump google.golang.org/protobuf from 1.35.2 to 1.36.1 ( #6393 )
Bumps google.golang.org/protobuf from 1.35.2 to 1.36.1.
---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
20cbc9e4eb
skip error while executing volume.fix.replication ( #6382 )
1 month ago
d7dfb11be9
fix compilation
1 month ago
de09a82a32
go fmt
1 month ago
bfd59dd579
adjust import
1 month ago
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
1 month ago
a1a76ccb8c
Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders ( #6380 )
What problem are we solving?
Fix : #6379
How are we solving the problem?
We check for the AllowEmptyFolders option prior to cascade
deleting parent folders in S3 DeleteMultipleObjectsHandler.
How is the PR tested?
We ran SeaweedFS in a Kubernetes Cluster with a joint Filer
and S3 server in one container, with leveldb2 as the filer storage,
and AllowEmptyFolders set to true.
When using the Distribution Registry as the S3 client, it calls the
DeleteMultipleObjectsHandler as part of the artifact upload process
(uploads to a temp location, then performs a copy and delete).
Without this fix, the deletion cascade deleted parent folder until
the entire contents of the bucket were gone.
With this fix, the existing content of the bucket remained, and the
newly uploaded content was added.
Checks
[ ] I have added unit tests if possible.
[ ] I will add related wiki document changes and link to this PR after merging.
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 month ago
4d91ec359b
Fix volume replica parallelization within `ec.encode`. ( #6377 )
See 826edd5d
1 month ago
ba0707af64
Allow configuring the maximum number of concurrent tasks for EC parallelization. ( #6376 )
Follow-up to b0210df0
1 month ago
44c48c929a
Parallelize volume replica operations within `ec.encode`. ( #6374 )
1 month ago
72af97162f
[shell] feat:stop vacuum immediately once volume.vacuum.disable was executed ( #6375 )
stop vacuum immediately once volume.vacuum.disable was executed
Co-authored-by: dsd <dsd2019@foxmail.com>
1 month ago
9fbc4ea417
Rework `shell.EcBalance()`'s waitgroup code into a standalone type. ( #6373 )
Rework `shell.EcBalance()`'s waitgroup with errors code into a standalone type.
We'll re-use this for other EC jobs - for example, volume creation. Also fixes
potential concurrency issues when collecting error results.
1 month ago
e77e50886e
mount metacache add ttl ( #6360 )
* fix:mount deadlock
* fix
* feat: metaCache ttl
* Update weed/command/mount.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* fix InodeEntry
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 month ago
b2f26804a0
chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 ( #6369 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.7.1 to 3.8.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](c47758b77c
1 month ago
52cf759a96
chore(deps): bump golang.org/x/crypto from 0.30.0 to 0.31.0 ( #6370 )
Bumps [golang.org/x/crypto](https://github.com/golang/crypto ) from 0.30.0 to 0.31.0.
- [Commits](https://github.com/golang/crypto/compare/v0.30.0...v0.31.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/crypto
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
93da4fe4d5
chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 ( #6368 )
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action ) from 1.52 to 1.53.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases )
- [Commits](2aa2977ad6
1 month ago
fa2d28c998
chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 ( #6367 )
Bumps [helm/kind-action](https://github.com/helm/kind-action ) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/helm/kind-action/releases )
- [Commits](https://github.com/helm/kind-action/compare/v1.10.0...v1.11.0 )
---
updated-dependencies:
- dependency-name: helm/kind-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
641fbc7a80
chore(deps): bump cloud.google.com/go/storage from 1.45.0 to 1.48.0 ( #6366 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.45.0 to 1.48.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.45.0...spanner/v1.48.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
ab7b81bbad
chore(deps): bump github.com/schollz/progressbar/v3 from 3.16.0 to 3.17.1 ( #6365 )
chore(deps): bump github.com/schollz/progressbar/v3
Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar ) from 3.16.0 to 3.17.1.
- [Release notes](https://github.com/schollz/progressbar/releases )
- [Commits](https://github.com/schollz/progressbar/compare/v3.16.0...v3.17.1 )
---
updated-dependencies:
- dependency-name: github.com/schollz/progressbar/v3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
Tom Crasset
Lisandro Pin
Hadi Zamani
ftong2020
dependabot[bot]
dsd
chrislu
Brad Murray
Jason N. White
Guang Jiong Lou
Trim21
Eric Long
Warren Hodgkinson
zemul