Lisandro Pin
392656d59e
`ec.encode`: Explictly mount EC shards after volume conversion. ( #6528 )
This guarantees EC shards are immediately available after encoding,
even if not affected by subsequent re-balancing.
1 week ago
Tom Crasset
9ca2b0b763
omit http and https ports when using X-Forwarded-Port ( #6527 )
2 weeks ago
Tom Crasset
a7b964af96
add s3 signature tests and prepare implementation of STREAMING-UNSIGNED-PAYLOAD-TRAILER ( #6525 )
* add tests for s3 signature
* add test for newSignV4ChunkedReader.Read()
* add glog import
2 weeks ago
Lisandro Pin
e8d8bfcccc
Nit: remove missing newlines on `weed shell` commands output. ( #6524 )
Nit: remove missing newlines on `weed` commands output.
2 weeks ago
zouyixiong
8eab76c5db
fix: record and delete bucket metrics after inactive ( #6523 )
Co-authored-by: XYZ <XYZ>
2 weeks ago
Ethan Mosbaugh
9ebc132ffc
fix: bucket-hook fails with gnu wget ( #6521 )
2 weeks ago
Lisandro Pin
29c2d9b965
Remove warning on EC balancing if no replica placement settings are found. ( #6516 )
Effectively undoes c9399a68; with ff8bd862
, a replica placement type `000`
will no longer break shards re-balancing.
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 weeks ago
Tom Crasset
a250699225
use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS signature ( #6514 )
2 weeks ago
Lisandro Pin
68f547bdf2
Nit: fix missing newline on EC balancing warnings regarding replica settings ( #6509 )
Nit: fix missing newline on EC balancing warnings regarding replica settings.
See 79136812
.
2 weeks ago
chrislu
95d8f4415a
3.84
2 weeks ago
chrislu
7fd42f5d06
Revert "Add content length to filer's requests ( #6489 )"
This reverts commit 9f42ce3f01
.
2 weeks ago
chrislu
5c3d7e6ae6
3.83
2 weeks ago
chrislu
42efade0dc
adjust fix
fix https://github.com/seaweedfs/seaweedfs/issues/6497
2 weeks ago
chrislu
a75271dd43
ensure correct auto bucket creation
fix https://github.com/seaweedfs/seaweedfs/issues/6497
3 weeks ago
Lisandro Pin
fc4df944a0
Remove rate limit semaphore on master's leader selection logic. ( #6494 )
This was introduced by 054374c7
(2024-03-12) and serves no practical purpose,
yet it caps the maximum QPS master servers can handle.
3 weeks ago
Lisandro Pin
331c1f0f3f
Improve EC shards balancing logic regarding replica placement settings. ( #6491 )
The replica placement type specifies numebr of _replicas_ on the same/different rack;
that means we can have one EC shard copy on each, even if the replica setting is zero.
This PR reworks replica placement parsing for EC rebalancing, so we check allow
(replica placement + 1) when selecting racks and nodes to balance EC shards into.
3 weeks ago
Tom Crasset
551baa44b2
verify if bucket exists in GetBucketLocationHandler ( #6485 )
3 weeks ago
Hadi Zamani
9f42ce3f01
Add content length to filer's requests ( #6489 )
3 weeks ago
Lisandro Pin
250fbbb3db
`ec.balance`: Allow EC balancing without collections. ( #6488 )
3 weeks ago
Lisandro Pin
7913681297
`ec.encode`: Display a warning on EC balancing if no replica placement settings are found. ( #6487 )
3 weeks ago
chrislu
33ba88df9c
fix from ensure() before actual deletion, within the b2 client library
fix https://github.com/seaweedfs/seaweedfs/issues/6483
3 weeks ago
Tom Crasset
7c3a0ed874
return error on invalid action in PutUserPolicy ( #6482 )
3 weeks ago
Hadi Zamani
a2330f624b
Add metrics for uploaded and deleted s3 objects ( #6475 )
3 weeks ago
chrislu
be15fee8e7
show error if backend is mis-configured
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
4 weeks ago
MaratKarimov
4fe1248aa8
filer store YDB: fix upsert with TTL ( #6469 )
4 weeks ago
ludwigxia
5452405a81
cloud tier: support for Alibaba Cloud OSS ( #6466 )
4 weeks ago
chrislu
ca4dca14d8
3.82
4 weeks ago
Chris Lu
cc05874d06
Add message queue agent ( #6463 )
* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent
4 weeks ago
Hadi Zamani
b2f56d9add
Add JWT authentication to fs.mergeVolumes command ( #6461 )
Add jwt authentication to fs.mergeVolumes command
4 weeks ago
Tom Crasset
c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 month ago
Lisandro Pin
eab2e0e112
`ec.encode`: Fix bug causing source volumes not being deleted after EC conversion. ( #6447 )
This logic was originally part of `spreadEcShards()`, which got removed during
the unification effort with `ec.balance` (https://github.com/seaweedfs/seaweedfs/pull/6344 ),
accidentally breaking functionality in the process.
The commit restores the deletion code for EC'd volumes - with parallelization support.
1 month ago
Hadi Zamani
c7ae969c06
Add bucket's traffic metrics ( #6444 )
* Add bucket's traffic metrics
* Add bucket traffic to dashboards
* Fix bucket metrics help messages
* Fix variable names
1 month ago
Tom Crasset
aa299462f2
improve iam error handling ( #6446 )
* improve iam error handling
* Delete docker/test.py
1 month ago
ftong2020
2304d2b472
Bugfix s3 audit missing requester for PUT requests ( #6434 )
fix s3 audit missing requster for PUT
1 month ago
dependabot[bot]
1609682ac2
chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1 ( #6437 )
* chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.30.0 to 0.31.1.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.30.0...v0.31.1 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix compilation
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 month ago
ftong2020
e7f2936dcc
fix force arg dropped during volume balance command ( #6432 )
1 month ago
dsd
da2a234b00
[weed] change -n to -force ( #6421 )
1 month ago
chrislu
39c1dde9df
3.81
1 month ago
Brad Murray
bc3640ee64
Update command_fs_merge_volumes.go ( #6406 )
2 months ago
Guang Jiong Lou
3b1ac77e1f
worm grace period and retention time support ( #6404 )
Signed-off-by: lou <alex1988@outlook.com>
2 months ago
Trim21
0594006c81
use same time format in volume volume UI and filter UI ( #6395 )
use same time format in volume server UI with filter UI
2 months ago
dsd
20cbc9e4eb
skip error while executing volume.fix.replication ( #6382 )
2 months ago
chrislu
d7dfb11be9
fix compilation
2 months ago
chrislu
de09a82a32
go fmt
2 months ago
chrislu
bfd59dd579
adjust import
2 months ago
chrislu
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
2 months ago
Warren Hodgkinson
a1a76ccb8c
Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders ( #6380 )
What problem are we solving?
Fix : #6379
How are we solving the problem?
We check for the AllowEmptyFolders option prior to cascade
deleting parent folders in S3 DeleteMultipleObjectsHandler.
How is the PR tested?
We ran SeaweedFS in a Kubernetes Cluster with a joint Filer
and S3 server in one container, with leveldb2 as the filer storage,
and AllowEmptyFolders set to true.
When using the Distribution Registry as the S3 client, it calls the
DeleteMultipleObjectsHandler as part of the artifact upload process
(uploads to a temp location, then performs a copy and delete).
Without this fix, the deletion cascade deleted parent folder until
the entire contents of the bucket were gone.
With this fix, the existing content of the bucket remained, and the
newly uploaded content was added.
Checks
[ ] I have added unit tests if possible.
[ ] I will add related wiki document changes and link to this PR after merging.
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 months ago
Lisandro Pin
4d91ec359b
Fix volume replica parallelization within `ec.encode`. ( #6377 )
See 826edd5d
.
2 months ago
Lisandro Pin
ba0707af64
Allow configuring the maximum number of concurrent tasks for EC parallelization. ( #6376 )
Follow-up to b0210df0
.
2 months ago
Lisandro Pin
44c48c929a
Parallelize volume replica operations within `ec.encode`. ( #6374 )
2 months ago