a7b964af96
add s3 signature tests and prepare implementation of STREAMING-UNSIGNED-PAYLOAD-TRAILER ( #6525 )
* add tests for s3 signature
* add test for newSignV4ChunkedReader.Read()
* add glog import
9 months ago
e8d8bfcccc
Nit: remove missing newlines on `weed shell` commands output. ( #6524 )
Nit: remove missing newlines on `weed` commands output.
9 months ago
8eab76c5db
fix: record and delete bucket metrics after inactive ( #6523 )
Co-authored-by: XYZ <XYZ>
9 months ago
9ebc132ffc
fix: bucket-hook fails with gnu wget ( #6521 )
9 months ago
29c2d9b965
Remove warning on EC balancing if no replica placement settings are found. ( #6516 )
Effectively undoes c9399a68; with ff8bd862
9 months ago
a250699225
use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS signature ( #6514 )
9 months ago
68f547bdf2
Nit: fix missing newline on EC balancing warnings regarding replica settings ( #6509 )
Nit: fix missing newline on EC balancing warnings regarding replica settings.
See 79136812
9 months ago
5e46960651
use golang:1.23 image
9 months ago
95d8f4415a
3.84
9 months ago
7fd42f5d06
Revert "Add content length to filer's requests ( #6489 )"
This reverts commit 9f42ce3f01
9 months ago
8f45e4589c
chore(deps): bump cloud.google.com/go/pubsub from 1.45.3 to 1.47.0 ( #6501 )
* chore(deps): bump cloud.google.com/go/pubsub from 1.45.3 to 1.47.0
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go ) from 1.45.3 to 1.47.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.45.3...pubsub/v1.47.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
9 months ago
c105f5a1b8
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.72.0 to 1.75.2 ( #6503 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.72.0 to 1.75.2.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.72.0...service/s3/v1.75.2 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months ago
fc649018b0
chore(deps): bump golang.org/x/tools from 0.27.0 to 0.29.0 ( #6502 )
Bumps [golang.org/x/tools](https://github.com/golang/tools ) from 0.27.0 to 0.29.0.
- [Release notes](https://github.com/golang/tools/releases )
- [Commits](https://github.com/golang/tools/compare/v0.27.0...v0.29.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/tools
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months ago
bc5aadd8af
chore(deps): bump github.com/schollz/progressbar/v3 from 3.17.1 to 3.18.0 ( #6504 )
chore(deps): bump github.com/schollz/progressbar/v3
Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar ) from 3.17.1 to 3.18.0.
- [Release notes](https://github.com/schollz/progressbar/releases )
- [Commits](https://github.com/schollz/progressbar/compare/v3.17.1...v3.18.0 )
---
updated-dependencies:
- dependency-name: github.com/schollz/progressbar/v3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months ago
568c0e4a6e
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.34.0 to 1.36.0 ( #6505 )
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2 ) from 1.34.0 to 1.36.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.34.0...v1.36.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months ago
5c3d7e6ae6
3.83
10 months ago
42efade0dc
adjust fix
fix https://github.com/seaweedfs/seaweedfs/issues/6497
10 months ago
a75271dd43
ensure correct auto bucket creation
fix https://github.com/seaweedfs/seaweedfs/issues/6497
10 months ago
fc4df944a0
Remove rate limit semaphore on master's leader selection logic. ( #6494 )
This was introduced by 054374c7
10 months ago
331c1f0f3f
Improve EC shards balancing logic regarding replica placement settings. ( #6491 )
The replica placement type specifies numebr of _replicas_ on the same/different rack;
that means we can have one EC shard copy on each, even if the replica setting is zero.
This PR reworks replica placement parsing for EC rebalancing, so we check allow
(replica placement + 1) when selecting racks and nodes to balance EC shards into.
10 months ago
551baa44b2
verify if bucket exists in GetBucketLocationHandler ( #6485 )
10 months ago
9f42ce3f01
Add content length to filer's requests ( #6489 )
10 months ago
250fbbb3db
`ec.balance`: Allow EC balancing without collections. ( #6488 )
10 months ago
7913681297
`ec.encode`: Display a warning on EC balancing if no replica placement settings are found. ( #6487 )
10 months ago
33ba88df9c
fix from ensure() before actual deletion, within the b2 client library
fix https://github.com/seaweedfs/seaweedfs/issues/6483
10 months ago
7c3a0ed874
return error on invalid action in PutUserPolicy ( #6482 )
10 months ago
be5f6b3565
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.17 to 3.5.18 ( #6476 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.5.17 to 3.5.18.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.5.17...v3.5.18 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
50ae91a3cb
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 ( #6478 )
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2 ) from 1.33.0 to 1.34.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.33.0...v1.34.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
5058879eff
chore(deps): bump docker/build-push-action from 6.12.0 to 6.13.0 ( #6481 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.12.0 to 6.13.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](67a2d409c0
10 months ago
82f50d5033
chore(deps): bump modernc.org/sqlite from 1.34.4 to 1.34.5 ( #6480 )
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.34.4 to 1.34.5.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.34.4...v1.34.5 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
793f527feb
chore(deps): bump go.mongodb.org/mongo-driver from 1.17.1 to 1.17.2 ( #6479 )
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver ) from 1.17.1 to 1.17.2.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases )
- [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.17.1...v1.17.2 )
---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
18a4ca0da2
chore(deps): bump google.golang.org/api from 0.216.0 to 0.218.0 ( #6477 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.216.0 to 0.218.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.216.0...v0.218.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
a2330f624b
Add metrics for uploaded and deleted s3 objects ( #6475 )
10 months ago
be15fee8e7
show error if backend is mis-configured
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
10 months ago
95357df8dd
Update README.md - space for label creation ( #6471 )
10 months ago
4fe1248aa8
filer store YDB: fix upsert with TTL ( #6469 )
10 months ago
5452405a81
cloud tier: support for Alibaba Cloud OSS ( #6466 )
10 months ago
ca4dca14d8
3.82
10 months ago
cc05874d06
Add message queue agent ( #6463 )
* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent
10 months ago
b2f56d9add
Add JWT authentication to fs.mergeVolumes command ( #6461 )
Add jwt authentication to fs.mergeVolumes command
10 months ago
b305b9fd11
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.28.4 to 1.29.1 ( #6454 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.28.4 to 1.29.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.28.4...config/v1.29.1 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
8a78c4efa3
chore(deps): bump helm/kind-action from 1.11.0 to 1.12.0 ( #6460 )
Bumps [helm/kind-action](https://github.com/helm/kind-action ) from 1.11.0 to 1.12.0.
- [Release notes](https://github.com/helm/kind-action/releases )
- [Commits](https://github.com/helm/kind-action/compare/v1.11.0...v1.12.0 )
---
updated-dependencies:
- dependency-name: helm/kind-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
8a922eb518
chore(deps): bump docker/setup-qemu-action from 3.2.0 to 3.3.0 ( #6459 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](49b3bc8e6b
10 months ago
56876ac654
chore(deps): bump docker/build-push-action from 6.10.0 to 6.12.0 ( #6458 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.10.0 to 6.12.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](48aba3b46d
10 months ago
f7950a9baa
chore(deps): bump helm/chart-testing-action from 2.6.1 to 2.7.0 ( #6457 )
Bumps [helm/chart-testing-action](https://github.com/helm/chart-testing-action ) from 2.6.1 to 2.7.0.
- [Release notes](https://github.com/helm/chart-testing-action/releases )
- [Commits](https://github.com/helm/chart-testing-action/compare/v2.6.1...v2.7.0 )
---
updated-dependencies:
- dependency-name: helm/chart-testing-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
af1d7d0b38
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.91.0 to 3.98.0 ( #6456 )
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk ) from 3.91.0 to 3.98.0.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases )
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.91.0...v3.98.0 )
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
f722910b78
chore(deps): bump github.com/hashicorp/raft-boltdb/v2 from 2.3.0 to 2.3.1 ( #6455 )
chore(deps): bump github.com/hashicorp/raft-boltdb/v2
Bumps [github.com/hashicorp/raft-boltdb/v2](https://github.com/hashicorp/raft-boltdb ) from 2.3.0 to 2.3.1.
- [Release notes](https://github.com/hashicorp/raft-boltdb/releases )
- [Commits](https://github.com/hashicorp/raft-boltdb/compare/v2.3.0...v2.3.1 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/raft-boltdb/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
b9e9f21132
chore(deps): bump github.com/aws/aws-sdk-go from 1.55.5 to 1.55.6 ( #6453 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.55.5 to 1.55.6.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG_PENDING.md )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.55.5...v1.55.6 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
2ecf915af2
chore(deps): bump github.com/arangodb/go-driver from 1.6.4 to 1.6.5 ( #6452 )
Bumps [github.com/arangodb/go-driver](https://github.com/arangodb/go-driver ) from 1.6.4 to 1.6.5.
- [Release notes](https://github.com/arangodb/go-driver/releases )
- [Changelog](https://github.com/arangodb/go-driver/blob/master/CHANGELOG.md )
- [Commits](https://github.com/arangodb/go-driver/compare/v1.6.4...v1.6.5 )
---
updated-dependencies:
- dependency-name: github.com/arangodb/go-driver
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
10 months ago
Tom Crasset
Lisandro Pin
zouyixiong
Ethan Mosbaugh
chrislu
dependabot[bot]
Hadi Zamani
Marc MAURICE
MaratKarimov
ludwigxia
Chris Lu