seaweedfs

Commit Graph

Author	SHA1	Message	Date
Lisandro Pin	29c2d9b965	Remove warning on EC balancing if no replica placement settings are found. (#6516 ) Effectively undoes c9399a68; with `ff8bd862`, a replica placement type `000` will no longer break shards re-balancing. Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	9 months ago
Tom Crasset	a250699225	use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS signature (#6514 )	9 months ago
Lisandro Pin	68f547bdf2	Nit: fix missing newline on EC balancing warnings regarding replica settings (#6509 ) Nit: fix missing newline on EC balancing warnings regarding replica settings. See `79136812`.	9 months ago
chrislu	95d8f4415a	3.84	9 months ago
chrislu	7fd42f5d06	Revert "Add content length to filer's requests (#6489 )" This reverts commit `9f42ce3f01`.	9 months ago
chrislu	5c3d7e6ae6	3.83	10 months ago
chrislu	42efade0dc	adjust fix fix https://github.com/seaweedfs/seaweedfs/issues/6497	10 months ago
chrislu	a75271dd43	ensure correct auto bucket creation fix https://github.com/seaweedfs/seaweedfs/issues/6497	10 months ago
Lisandro Pin	fc4df944a0	Remove rate limit semaphore on master's leader selection logic. (#6494 ) This was introduced by `054374c7` (2024-03-12) and serves no practical purpose, yet it caps the maximum QPS master servers can handle.	10 months ago
Lisandro Pin	331c1f0f3f	Improve EC shards balancing logic regarding replica placement settings. (#6491 ) The replica placement type specifies numebr of _replicas_ on the same/different rack; that means we can have one EC shard copy on each, even if the replica setting is zero. This PR reworks replica placement parsing for EC rebalancing, so we check allow (replica placement + 1) when selecting racks and nodes to balance EC shards into.	10 months ago
Tom Crasset	551baa44b2	verify if bucket exists in GetBucketLocationHandler (#6485 )	10 months ago
Hadi Zamani	9f42ce3f01	Add content length to filer's requests (#6489 )	10 months ago
Lisandro Pin	250fbbb3db	`ec.balance`: Allow EC balancing without collections. (#6488 )	10 months ago
Lisandro Pin	7913681297	`ec.encode`: Display a warning on EC balancing if no replica placement settings are found. (#6487 )	10 months ago
chrislu	33ba88df9c	fix from ensure() before actual deletion, within the b2 client library fix https://github.com/seaweedfs/seaweedfs/issues/6483	10 months ago
Tom Crasset	7c3a0ed874	return error on invalid action in PutUserPolicy (#6482 )	10 months ago
Hadi Zamani	a2330f624b	Add metrics for uploaded and deleted s3 objects (#6475 )	10 months ago
chrislu	be15fee8e7	show error if backend is mis-configured related to https://github.com/seaweedfs/seaweedfs/discussions/6472	10 months ago
MaratKarimov	4fe1248aa8	filer store YDB: fix upsert with TTL (#6469 )	10 months ago
ludwigxia	5452405a81	cloud tier: support for Alibaba Cloud OSS (#6466 )	10 months ago
chrislu	ca4dca14d8	3.82	10 months ago
Chris Lu	cc05874d06	Add message queue agent (#6463 ) * scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent	10 months ago
Hadi Zamani	b2f56d9add	Add JWT authentication to fs.mergeVolumes command (#6461 ) Add jwt authentication to fs.mergeVolumes command	10 months ago
Tom Crasset	c5f21b2b01	fix S3 per-user-directory Policy (#6443 ) * fix S3 per-user-directory Policy * Delete docker/config.json * add tests * remove logs * undo modifications of weed/shell/command_volume_balance.go * remove modifications of docker-compose * fix failing test --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	10 months ago
Lisandro Pin	eab2e0e112	`ec.encode`: Fix bug causing source volumes not being deleted after EC conversion. (#6447 ) This logic was originally part of `spreadEcShards()`, which got removed during the unification effort with `ec.balance` (https://github.com/seaweedfs/seaweedfs/pull/6344), accidentally breaking functionality in the process. The commit restores the deletion code for EC'd volumes - with parallelization support.	10 months ago
Hadi Zamani	c7ae969c06	Add bucket's traffic metrics (#6444 ) * Add bucket's traffic metrics * Add bucket traffic to dashboards * Fix bucket metrics help messages * Fix variable names	10 months ago
Tom Crasset	aa299462f2	improve iam error handling (#6446 ) * improve iam error handling * Delete docker/test.py	10 months ago
ftong2020	2304d2b472	Bugfix s3 audit missing requester for PUT requests (#6434 ) fix s3 audit missing requster for PUT	10 months ago
dependabot[bot]	1609682ac2	chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1 (#6437 ) * chore(deps): bump github.com/getsentry/sentry-go from 0.30.0 to 0.31.1 Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.30.0 to 0.31.1. - [Release notes](https://github.com/getsentry/sentry-go/releases) - [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-go/compare/v0.30.0...v0.31.1) --- updated-dependencies: - dependency-name: github.com/getsentry/sentry-go dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix compilation --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>	10 months ago
ftong2020	e7f2936dcc	fix force arg dropped during volume balance command (#6432 )	10 months ago
dsd	da2a234b00	[weed] change -n to -force (#6421 )	10 months ago
chrislu	39c1dde9df	3.81	10 months ago
Brad Murray	bc3640ee64	Update command_fs_merge_volumes.go (#6406 )	11 months ago
Guang Jiong Lou	3b1ac77e1f	worm grace period and retention time support (#6404 ) Signed-off-by: lou <alex1988@outlook.com>	11 months ago
Trim21	0594006c81	use same time format in volume volume UI and filter UI (#6395 ) use same time format in volume server UI with filter UI	11 months ago
dsd	20cbc9e4eb	skip error while executing volume.fix.replication (#6382 )	11 months ago
chrislu	d7dfb11be9	fix compilation	11 months ago
chrislu	de09a82a32	go fmt	11 months ago
chrislu	bfd59dd579	adjust import	11 months ago
chrislu	ec155022e7	"golang.org/x/exp/slices" => "slices" and go fmt	11 months ago
Warren Hodgkinson	a1a76ccb8c	Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders (#6380 ) What problem are we solving? Fix: #6379 How are we solving the problem? We check for the AllowEmptyFolders option prior to cascade deleting parent folders in S3 DeleteMultipleObjectsHandler. How is the PR tested? We ran SeaweedFS in a Kubernetes Cluster with a joint Filer and S3 server in one container, with leveldb2 as the filer storage, and AllowEmptyFolders set to true. When using the Distribution Registry as the S3 client, it calls the DeleteMultipleObjectsHandler as part of the artifact upload process (uploads to a temp location, then performs a copy and delete). Without this fix, the deletion cascade deleted parent folder until the entire contents of the bucket were gone. With this fix, the existing content of the bucket remained, and the newly uploaded content was added. Checks [ ] I have added unit tests if possible. [ ] I will add related wiki document changes and link to this PR after merging. Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	11 months ago
Lisandro Pin	4d91ec359b	Fix volume replica parallelization within `ec.encode`. (#6377 ) See `826edd5d`.	11 months ago
Lisandro Pin	ba0707af64	Allow configuring the maximum number of concurrent tasks for EC parallelization. (#6376 ) Follow-up to `b0210df0`.	11 months ago
Lisandro Pin	44c48c929a	Parallelize volume replica operations within `ec.encode`. (#6374 )	11 months ago
dsd	72af97162f	[shell] feat:stop vacuum immediately once volume.vacuum.disable was executed (#6375 ) stop vacuum immediately once volume.vacuum.disable was executed Co-authored-by: dsd <dsd2019@foxmail.com>	11 months ago
Lisandro Pin	9fbc4ea417	Rework `shell.EcBalance()`'s waitgroup code into a standalone type. (#6373 ) Rework `shell.EcBalance()`'s waitgroup with errors code into a standalone type. We'll re-use this for other EC jobs - for example, volume creation. Also fixes potential concurrency issues when collecting error results.	11 months ago
zemul	e77e50886e	mount metacache add ttl (#6360 ) * fix:mount deadlock * fix * feat: metaCache ttl * Update weed/command/mount.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * fix InodeEntry --------- Co-authored-by: zemul <zhouzemiao@ihuman.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	11 months ago
coffeecloudgit	c531e2eb0e	Update disk_location_ec.go (#6359 ) Add lock for l.ecVolumes	11 months ago
coffeecloudgit	7eb8257126	Update store.go (#6358 ) Add lock for location.ecVolumes And single delete	11 months ago
Lisandro Pin	9b48ce0613	Parallelize EC shards balancing within racks (#6354 ) Parallelize EC shards balancing within racks.	11 months ago

... 7 8 9 10 11 ...

7670 Commits (edeb9227493a8f93780d52a01f99a985fd28ac5a)