260d9f44a4
less logs
1 day ago
3481ad22cb
go vet
1 day ago
4518dc1056
less logs
1 day ago
48aec1956e
Seaweed-X-Amz-Allow-Empty-Folders
1 day ago
349aaa12ef
Switch empty-folder cleanup to bucket policy
1 day ago
eded9a29b5
more logs
1 day ago
428ef2b75f
logging
1 day ago
a57834196c
Keep explicit directory markers non-implicit
1 day ago
2737e20916
Fix Spark temp cleanup with implicit directory markers
1 day ago
74c80aa441
Fix Spark temp marker cleanup in async folder cleaner
1 day ago
d4f2355b9a
Add actionable empty-folder cleanup diagnostics
1 day ago
d40154f36e
Revert synchronous folder pruning and add cleanup diagnostics
1 day ago
bd77d9f9b3
Generalize empty folder cleanup for Spark temp artifacts
1 day ago
692b3a6e07
Fix Spark _temporary cleanup and add issue #8285 regression test
1 day ago
17f85361e9
Remove unsupported iceberg rest signing-region from tests and docs ( #8289 )
1 day ago
b261c89675
Fix RocksDB container build compatibility and add manual rocksdb dispatch ( #8288 )
* Fix RocksDB build compatibility and add manual rocksdb trigger
* Upgrade RocksDB defaults and keep grocksdb v1.10.7
* Add manual latest-image trigger inputs for ref and variant
* Allow manual latest build to set image tag and source ref
* Fix manual variant selection using setup job matrix output
1 day ago
0385acba02
s3tables: fix shared table-location bucket mapping collisions ( #8286 )
* s3tables: prevent shared table-location bucket mapping overwrite
* Update weed/s3api/bucket_paths.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 day ago
d6825ffce2
Iceberg: implement stage-create finalize flow (phase 1) ( #8279 )
* iceberg: implement stage-create and create-on-commit finalize
* iceberg: add create validation error typing and stage-create integration test
* tests: merge stage-create integration check into catalog suite
* tests: cover stage-create finalize lifecycle in catalog integration
* iceberg: persist and cleanup stage-create markers
* iceberg: add stage-create rollout flag and marker pruning
* docs: add stage-create support design and rollout plan
* docs: drop stage-create design draft from PR
* iceberg: use conservative 72h stage-marker retention
* iceberg: address review comments on create-on-commit and tests
* iceberg: keep stage-create metadata out of table location
* refactor(iceberg): split iceberg.go into focused files
2 days ago
d88f6ed0af
Iceberg commit reliability: preserve statistics updates and return 409 conflicts ( #8277 )
* iceberg: harden table commit updates and conflict handling
* iceberg: refine commit retry and statistics patching
* iceberg: cleanup metadata on non-conflict commit errors
2 days ago
5ae3be44d1
iceberg: persist namespace properties for create/get ( #8276 )
* iceberg: persist namespace properties via s3tables metadata
* iceberg: simplify namespace properties normalization
* s3tables: broaden namespace properties round-trip test
* adjust logs
* adjust logs
2 days ago
1c62808c0e
iceberg: wire pagination for list namespaces/tables REST APIs ( #8275 )
* s3api/iceberg: wire list pagination tokens and page size
* fmt
* Update weed/s3api/iceberg/iceberg.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2 days ago
db76eb26e7
compile
2 days ago
4ccc7668ce
admin: resolve merge conflicts
2 days ago
aef2de3109
s3tables: support multi-level namespaces in parser/admin paths ( #8273 )
* s3tables: support multi-level namespace normalization
* admin: handle namespace parsing errors centrally
* admin: clean namespace validation duplication
2 days ago
be26ce74ce
s3tables: support multi-level namespace normalization
2 days ago
0b80f055c2
Merge branch 'fix/8270-leader-not-elected'
2 days ago
af8273386d
4.12
2 days ago
ba8e2aaae9
Fix master leader election when grpc ports change ( #8272 )
* Fix master leader detection when grpc ports change
* Canonicalize self peer entry to avoid raft self-alias panic
* Normalize and deduplicate master peer addresses
2 days ago
15d0a46679
Normalize and deduplicate master peer addresses
2 days ago
ae27e17e6f
Canonicalize self peer entry to avoid raft self-alias panic
2 days ago
02dac23119
Fix master leader detection when grpc ports change
2 days ago
f400fb44a0
Update `cluster.status` to resolve file details on EC volumes. ( #8268 )
Also parallelizes queries for file metrics collections when the `--files`
flag is specified, and improves the command's output for readability:
```
> cluster.status --files
collecting file stats: 100%
cluster:
id: topo
status: LOCKED
nodes: 10
topology: 1 DC, 10 disks on 1 rack
volumes:
total: 3 volumes, 1 collection
max size: 32 GB
regular: 1/80 volume on 3 replicas, 3 writable (100%), 0 read-only (0%)
EC: 2 EC volumes on 28 shards (14 shards/volume)
storage:
total: 269 MB (522 MB raw, 193.95%)
regular volumes: 91 MB (272 MB raw, 300%)
EC volumes: 178 MB (250 MB raw, 140%)
files:
total: 363 files, 300 readable (82.64%), 63 deleted (17.35%), avg 522 kB per file
regular: 168 files, 105 readable (62.5%), 63 deleted (37.5%), avg 540 kB per file
EC: 195 files, 195 readable (100%), 0 deleted (0%), avg 506 kB per file
```
2 days ago
30812b85f3
fix ec.encode skipping volumes when one replica is on a full disk ( #8227 )
* fix ec.encode skipping volumes when one replica is on a full disk
This fixes issue #8218 . Previously, ec.encode would skip a volume if ANY
of its replicas resided on a disk with low free volume count. Now it
accepts the volume if AT LEAST ONE replica is on a healthy disk.
* refine noFreeDisk counter logic in ec.encode
Ensure noFreeDisk is decremented if a volume initially marked as bad
is later found to have a healthy replica. This ensures accurate
summary statistics.
* defer noFreeDisk counting and refine logging in ec.encode
Updated logging to be replica-scoped and deferred noFreeDisk counting to
the final pass over vidMap. This ensures that the counter only reflects
volumes that are definitively excluded because all replicas are on full
disks.
* filter replicas by free space during ec.encode
Updated doEcEncode to filter out replicas on disks with
FreeVolumeCount < 2 before selecting the best replica for encoding.
This ensures that EC shards are not generated on healthy source
replicas that happen to be on disks with low free space.
2 days ago
6a61037333
fix issue #8230 : volume.fsck deletion logic to respect purgeAbsent flag ( #8266 )
* fix issue #8230 : volume.fsck deletion logic to respect purgeAbsent flag
This commit fixes two issues in volume.fsck:
1. Missing chunks in existing volumes are now deleted if -reallyDeleteFilerEntries is set.
2. Missing volumes are now properly handled when a -volumeId filter is specified, allowing deletion of filer entries for those volumes.
* address PR feedback for issue #8230
- Ensure volume filter is applied before reporting missing volumes
- Fix potential nil-pointer dereferences in httpDelete method
- Use proper error checking throughout httpDelete
* address second round PR feedback for issue #8230
- Use fmt.Fprintf(c.writer, ...) instead of fmt.Printf
- Add missing newline in "deleting path" log message
2 days ago
839028b2e0
Fix EC rebuild shard detection ( #8265 )
Fix EC rebuild shard counting
2 days ago
1a5679a5eb
Implement a `VolumeEcStatus()` RPC for volume servers. ( #8006 )
Just like `VolumeStatus()`, this call allows inspecting details for
a given EC volume - including number of files and their total size.
2 days ago
818a1ff8b1
build(deps): bump golang.org/x/crypto from 0.47.0 to 0.48.0 ( #8258 )
Bumps [golang.org/x/crypto](https://github.com/golang/crypto ) from 0.47.0 to 0.48.0.
- [Commits](https://github.com/golang/crypto/compare/v0.47.0...v0.48.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/crypto
dependency-version: 0.48.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 days ago
59b02e0cba
s3api: fix multipart Complete ETag matching and lower empty-upload log noise ( #8264 )
s3api: fix multipart part etag validation and reduce empty upload warning noise
2 days ago
d9987669cb
build(deps): bump github.com/jhump/protoreflect from 1.17.0 to 1.18.0 ( #8261 )
Bumps [github.com/jhump/protoreflect](https://github.com/jhump/protoreflect ) from 1.17.0 to 1.18.0.
- [Release notes](https://github.com/jhump/protoreflect/releases )
- [Commits](https://github.com/jhump/protoreflect/compare/v1.17.0...v1.18.0 )
---
updated-dependencies:
- dependency-name: github.com/jhump/protoreflect
dependency-version: 1.18.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 days ago
0c16663014
build(deps): bump golang.org/x/sys from 0.40.0 to 0.41.0 ( #8260 )
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.40.0 to 0.41.0.
- [Commits](https://github.com/golang/sys/compare/v0.40.0...v0.41.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-version: 0.41.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 days ago
ccf35459be
Explicitly disable signing for public buckets. ( #8263 )
2 days ago
88b1768814
build(deps): bump go.etcd.io/etcd/client/v3 from 3.6.6 to 3.6.7 ( #8257 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.6.6 to 3.6.7.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.6.6...v3.6.7 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-version: 3.6.7
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 days ago
62063de1ca
build(deps): bump github.com/linxGnu/grocksdb from 1.10.3 to 1.10.7 ( #8259 )
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.10.3 to 1.10.7.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.10.3...v1.10.7 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-version: 1.10.7
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 days ago
63b846b73b
Parallelize operations for the `volume.scrub` and `ec.scrub` commands ( #8247 )
Parallelize operations for the `volume.scrub` and `ec.scrub` commands.
3 days ago
c9428c2c0f
Modify AI review comments checklist in PR template
Updated AI code review checklist to include potential additional reviews.
3 days ago
cb9e21cdc5
Normalize hashicorp raft peer ids ( #8253 )
* Normalize raft voter ids
* 4.11
* Update raft_hashicorp.go
3 days ago
2ed5a8f65c
add tests
3 days ago
5a279c4d2f
fmt
3 days ago
0c89185291
4.10
3 days ago
458c12fb99
test: add Spark S3 integration regression for issue #8234 ( #8249 )
* test: add Spark S3 regression integration test for issue 8234
* Update test/s3/spark/setup_test.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
3 days ago
Chris Lu
Chris Lu
Lisandro Pin
dependabot[bot]