33ba88df9c
fix from ensure() before actual deletion, within the b2 client library
fix https://github.com/seaweedfs/seaweedfs/issues/6483
10 months ago
7c3a0ed874
return error on invalid action in PutUserPolicy ( #6482 )
10 months ago
a2330f624b
Add metrics for uploaded and deleted s3 objects ( #6475 )
10 months ago
be15fee8e7
show error if backend is mis-configured
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
10 months ago
4fe1248aa8
filer store YDB: fix upsert with TTL ( #6469 )
10 months ago
5452405a81
cloud tier: support for Alibaba Cloud OSS ( #6466 )
10 months ago
ca4dca14d8
3.82
10 months ago
cc05874d06
Add message queue agent ( #6463 )
* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent
10 months ago
b2f56d9add
Add JWT authentication to fs.mergeVolumes command ( #6461 )
Add jwt authentication to fs.mergeVolumes command
10 months ago
c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
10 months ago
eab2e0e112
`ec.encode`: Fix bug causing source volumes not being deleted after EC conversion. ( #6447 )
This logic was originally part of `spreadEcShards()`, which got removed during
the unification effort with `ec.balance` (https://github.com/seaweedfs/seaweedfs/pull/6344 ),
accidentally breaking functionality in the process.
The commit restores the deletion code for EC'd volumes - with parallelization support.
10 months ago
c7ae969c06
Add bucket's traffic metrics ( #6444 )
* Add bucket's traffic metrics
* Add bucket traffic to dashboards
* Fix bucket metrics help messages
* Fix variable names
10 months ago
aa299462f2
improve iam error handling ( #6446 )
* improve iam error handling
* Delete docker/test.py
10 months ago
2304d2b472
Bugfix s3 audit missing requester for PUT requests ( #6434 )
fix s3 audit missing requster for PUT
10 months ago
1609682ac2
chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1 ( #6437 )
* chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.30.0 to 0.31.1.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.30.0...v0.31.1 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix compilation
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
10 months ago
e7f2936dcc
fix force arg dropped during volume balance command ( #6432 )
10 months ago
da2a234b00
[weed] change -n to -force ( #6421 )
10 months ago
39c1dde9df
3.81
10 months ago
bc3640ee64
Update command_fs_merge_volumes.go ( #6406 )
11 months ago
3b1ac77e1f
worm grace period and retention time support ( #6404 )
Signed-off-by: lou <alex1988@outlook.com>
11 months ago
0594006c81
use same time format in volume volume UI and filter UI ( #6395 )
use same time format in volume server UI with filter UI
11 months ago
20cbc9e4eb
skip error while executing volume.fix.replication ( #6382 )
11 months ago
d7dfb11be9
fix compilation
11 months ago
de09a82a32
go fmt
11 months ago
bfd59dd579
adjust import
11 months ago
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
11 months ago
a1a76ccb8c
Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders ( #6380 )
What problem are we solving?
Fix : #6379
How are we solving the problem?
We check for the AllowEmptyFolders option prior to cascade
deleting parent folders in S3 DeleteMultipleObjectsHandler.
How is the PR tested?
We ran SeaweedFS in a Kubernetes Cluster with a joint Filer
and S3 server in one container, with leveldb2 as the filer storage,
and AllowEmptyFolders set to true.
When using the Distribution Registry as the S3 client, it calls the
DeleteMultipleObjectsHandler as part of the artifact upload process
(uploads to a temp location, then performs a copy and delete).
Without this fix, the deletion cascade deleted parent folder until
the entire contents of the bucket were gone.
With this fix, the existing content of the bucket remained, and the
newly uploaded content was added.
Checks
[ ] I have added unit tests if possible.
[ ] I will add related wiki document changes and link to this PR after merging.
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
11 months ago
4d91ec359b
Fix volume replica parallelization within `ec.encode`. ( #6377 )
See 826edd5d
11 months ago
ba0707af64
Allow configuring the maximum number of concurrent tasks for EC parallelization. ( #6376 )
Follow-up to b0210df0
11 months ago
44c48c929a
Parallelize volume replica operations within `ec.encode`. ( #6374 )
11 months ago
72af97162f
[shell] feat:stop vacuum immediately once volume.vacuum.disable was executed ( #6375 )
stop vacuum immediately once volume.vacuum.disable was executed
Co-authored-by: dsd <dsd2019@foxmail.com>
11 months ago
9fbc4ea417
Rework `shell.EcBalance()`'s waitgroup code into a standalone type. ( #6373 )
Rework `shell.EcBalance()`'s waitgroup with errors code into a standalone type.
We'll re-use this for other EC jobs - for example, volume creation. Also fixes
potential concurrency issues when collecting error results.
11 months ago
e77e50886e
mount metacache add ttl ( #6360 )
* fix:mount deadlock
* fix
* feat: metaCache ttl
* Update weed/command/mount.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* fix InodeEntry
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
11 months ago
c531e2eb0e
Update disk_location_ec.go ( #6359 )
Add lock for l.ecVolumes
11 months ago
7eb8257126
Update store.go ( #6358 )
Add lock for location.ecVolumes And single delete
11 months ago
9b48ce0613
Parallelize EC shards balancing within racks ( #6354 )
Parallelize EC shards balancing within racks.
11 months ago
926cfea3dc
Parallelize EC shards balancing across racks. ( #6352 )
11 months ago
b81def5e5c
Parallelize EC balancing for racks. ( #6351 )
11 months ago
d6f3e1970d
fix: filer may crash by bucketLastActiveTsNs concurrency access. ( #6350 )
11 months ago
0a4b1909a2
[shell] only apply the balancing for writable volumes ( #6346 )
11 months ago
9987a65e8a
fix: record and delete bucket metrics after inactive ( #6349 )
11 months ago
b0210df081
Begin implementing EC balancing parallelization support. ( #6342 )
* Begin implementing EC balancing parallelization support.
Impacts both `ec.encode` and `ec.balance`,
* Nit: improve type naming.
* Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof.
* Nit: unify naming for `ecBalancer` wait group methods with the rest of the module.
* Fix concurrency bug.
* Fix whitespace after Gitlab automerge.
* Delete stray TODO.
11 months ago
23ffbb083c
Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID argument is provided. ( #6347 )
Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID is provided.
11 months ago
6320036c56
Delete legacy balancing code for `ec.encode`. ( #6344 )
11 months ago
700b95304b
[shell] volume.list show only writable volumes ( #6338 )
* show only writable volumes
* fix import
11 months ago
c37281735e
volume.list avoid output empty data center and rack and disk info ( #6341 )
11 months ago
8c82c037b9
Unify the re-balancing logic for `ec.encode` with `ec.balance`. ( #6339 )
Among others, this enables recent changes related to topology aware
re-balancing at EC encoding time.
11 months ago
ff1392f7f4
[shell] use constant for hdd of type ( #6337 )
use constant for hdd of type
11 months ago
522a25790a
Remove average constraints when selecting nodes/racks to balance EC shards into. ( #6325 )
11 months ago
914ff0e718
Replaced https.client.enabled with false in scaffold/security ( #6320 )
11 months ago
chrislu
Tom Crasset
Hadi Zamani
MaratKarimov
ludwigxia
Chris Lu
Lisandro Pin
ftong2020
dependabot[bot]
dsd
Brad Murray
Guang Jiong Lou
Trim21
Warren Hodgkinson
zemul
coffeecloudgit
zouyixiong
Konstantin Lebedev
vadimartynov