Commit Graph

  • 7b5296c10f add fix and tests chrislu 2025-10-28 13:17:57 -0700
  • 293e9a8168
    Merge branch 'master' into simplify-worker #7394 Mariano Ntrougkas 2025-10-28 15:45:49 +0200
  • ca6bbdc4f7
    Merge 9983f9db46 into b7ba6785a2 #5150 vivekkoya 2025-10-28 03:02:10 -0700
  • b7ba6785a2 go fmt chrislu 2025-10-27 23:04:55 -0700
  • 208d7f24f4
    Erasure Coding: Ec refactoring (#7396) Chris Lu 2025-10-27 22:13:31 -0700
  • 14e4fcadd3 style: make MaxShardCount type casting explicit in loops #7396 chrislu 2025-10-27 21:31:19 -0700
  • c47932713b fmt chrislu 2025-10-27 21:27:18 -0700
  • 33cfa8c194 fix: add defensive bounds checks and compute actual shard counts chrislu 2025-10-27 21:21:04 -0700
  • 004c804181 fix: critical bugs from code review + clean up comments chrislu 2025-10-27 21:11:22 -0700
  • 18a7fe228d fmt chrislu 2025-10-27 21:01:15 -0700
  • 8f4cdc5a87 improve: add defensive programming and better error messages for EC chrislu 2025-10-27 21:00:25 -0700
  • c4f970bfa6 refactor: move MaxShardCount constant to ec_encoder.go chrislu 2025-10-27 20:58:20 -0700
  • 1338df5e23 fix: replace TotalShardsCount with MaxShardCount in critical data structures chrislu 2025-10-27 20:54:52 -0700
  • 38626b6a56 fix: replace TotalShardsCount with MaxShardCount for custom EC ratio support chrislu 2025-10-27 20:50:32 -0700
  • 486496576f add: defensive validation for dataShards in VolumeEcShardsToVolume chrislu 2025-10-27 20:44:02 -0700
  • 80838c5f8f fix: RebuildEcFiles now loads EC config from .vif file chrislu 2025-10-27 20:35:53 -0700
  • 03f857dc2b fix: add validation for EC shard counts from VolumeInfo chrislu 2025-10-27 19:50:28 -0700
  • 57556041c8 refactor: rename MaxShardId to MaxShardCount for clarity chrislu 2025-10-27 19:46:54 -0700
  • f13e4da77a optimize: simplify VolumeEcShardsToVolume to use existing EC context chrislu 2025-10-27 19:38:34 -0700
  • 0cda3b9dc8 refactor: replace TotalShards field with Total() method chrislu 2025-10-27 19:22:13 -0700
  • cda4f4ac9e optimize: pre-calculate row sizes in EC encoding loop chrislu 2025-10-27 19:17:09 -0700
  • 7515c6d910 refactor: use EcShardConfig message instead of separate fields chrislu 2025-10-27 18:28:35 -0700
  • 484ce95669 refactor: update ec_test.go to use ECContext chrislu 2025-10-27 18:06:29 -0700
  • 97d1638342 fmt chrislu 2025-10-27 17:58:35 -0700
  • 0d76cd13fb refactor: update VolumeEcShardsGenerate to use ECContext chrislu 2025-10-27 17:55:09 -0700
  • 362b9013a8 refactor: regenerate protobuf Go files with EC shard count fields chrislu 2025-10-27 17:53:59 -0700
  • 6dc5dd53f1 refactor: add EC shard count fields to VolumeInfo protobuf chrislu 2025-10-27 17:53:39 -0700
  • 330e4bf20b refactor: update ec_volume.go to use ECContext chrislu 2025-10-27 17:53:16 -0700
  • b1de205d6c refactor: update ec_encoder.go to use ECContext chrislu 2025-10-27 17:52:18 -0700
  • adc660da72 refactor: add ECContext structure to encapsulate EC parameters chrislu 2025-10-27 17:50:27 -0700
  • decfb07eea fix nil chrislu 2025-10-27 17:33:10 -0700
  • f82c69b9a5 revert back s3 in helm chart to false chrislu 2025-10-27 17:23:31 -0700
  • f6cfa1a8dc Publish seaweedfs-4.0.399.tgz chrislusf 2025-10-28 00:22:14 +0000
  • a80b5eea5e 3.99 3.99 chrislu 2025-10-27 17:16:28 -0700
  • d981da9251
    🐛 fix(worker): initialize metrics query channel Mariano Ntrougkas 2025-10-27 21:17:42 +0200
  • f3428f3868
    🐛 fix(client): reconnect if initial attempt failed for any reason Mariano Ntrougkas 2025-10-27 21:08:58 +0200
  • 586c131350
    🐛 fix(worker): calculate success rate correctly Mariano Ntrougkas 2025-10-27 20:59:46 +0200
  • 679eaaf8f6
    ♻️ refactor(worker): follow CSP model Mariano Ntrougkas 2025-10-27 20:43:50 +0200
  • 51d16258fe
    chore(deps): bump github.com/rclone/rclone from 1.71.1 to 1.71.2 (#7393) dependabot[bot] 2025-10-27 10:50:34 -0700
  • e8a91aaf85
    chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.18.10 to 1.18.19 (#7392) dependabot[bot] 2025-10-27 10:50:20 -0700
  • 8667aa8e17
    chore(deps): bump github.com/prometheus/procfs from 0.17.0 to 0.19.1 (#7388) dependabot[bot] 2025-10-27 10:49:36 -0700
  • fe532592cc
    chore(deps): bump golang.org/x/net from 0.45.0 to 0.46.0 (#7386) dependabot[bot] 2025-10-27 10:49:17 -0700
  • 4a41fe0402
    chore(deps): bump github.com/rclone/rclone from 1.71.1 to 1.71.2 #7393 dependabot[bot] 2025-10-27 16:30:52 +0000
  • 85aebe4361 go mod tidy #7386 chrislu 2025-10-27 09:26:15 -0700
  • ff0dd9639d
    Merge branch 'master' into dependabot/go_modules/golang.org/x/net-0.46.0 Chris Lu 2025-10-27 09:25:50 -0700
  • 799730103f go mod tidy #7388 chrislu 2025-10-27 09:25:34 -0700
  • bfdb4a5fa7
    Merge branch 'master' into dependabot/go_modules/github.com/prometheus/procfs-0.19.1 Chris Lu 2025-10-27 09:25:08 -0700
  • 290c245095 go mod tidy chrislu 2025-10-27 09:24:20 -0700
  • 68710a93a0
    chore(deps): bump github.com/getsentry/sentry-go from 0.35.3 to 0.36.1 (#7389) dependabot[bot] 2025-10-27 09:22:57 -0700
  • c49748e498
    chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials #7392 dependabot[bot] 2025-10-27 16:22:56 +0000
  • f2c888c3fe
    chore(deps): bump github.com/tarantool/go-tarantool/v2 from 2.4.0 to 2.4.1 (#7391) dependabot[bot] 2025-10-27 09:22:38 -0700
  • a943c611ed
    chore(deps): bump github.com/pkg/sftp from 1.13.9 to 1.13.10 (#7390) dependabot[bot] 2025-10-27 09:22:28 -0700
  • 78b95b8320
    chore(deps): bump actions/upload-artifact from 4 to 5 (#7387) dependabot[bot] 2025-10-27 09:22:17 -0700
  • 39e13fd519
    chore(deps): bump github.com/tarantool/go-tarantool/v2 #7391 dependabot[bot] 2025-10-27 15:56:34 +0000
  • 39b6572440
    chore(deps): bump github.com/pkg/sftp from 1.13.9 to 1.13.10 #7390 dependabot[bot] 2025-10-27 15:53:01 +0000
  • 4290e76e0d
    chore(deps): bump github.com/getsentry/sentry-go from 0.35.3 to 0.36.1 #7389 dependabot[bot] 2025-10-27 15:45:11 +0000
  • 6c8201636c
    chore(deps): bump github.com/prometheus/procfs from 0.17.0 to 0.19.1 dependabot[bot] 2025-10-27 15:30:34 +0000
  • 44b0007889
    chore(deps): bump actions/upload-artifact from 4 to 5 #7387 dependabot[bot] 2025-10-27 15:25:56 +0000
  • df59f81392
    chore(deps): bump golang.org/x/net from 0.45.0 to 0.46.0 dependabot[bot] 2025-10-27 15:22:05 +0000
  • a33087092a Publish seaweedfs-4.0.399.tgz chrislusf 2025-10-27 06:45:23 +0000
  • 4b76b2ad3c fix lint chrislu 2025-10-26 23:20:20 -0700
  • 838e3104c4 3.99 chrislu 2025-10-26 22:51:45 -0700
  • 2ad2ffcdff fix comment chrislu 2025-10-26 22:44:10 -0700
  • 0813138d57
    Volume Server: handle incomplete ec encoding (#7384) Chris Lu 2025-10-26 22:48:58 -0700
  • 15fcc03b04 fix comment enhance-erasure-coding chrislu 2025-10-26 22:44:10 -0700
  • 502c183763 adjust to warning #7384 chrislu 2025-10-26 21:18:55 -0700
  • a348381a51 refactor chrislu 2025-10-26 21:14:10 -0700
  • 859a30bbd8 refactor chrislu 2025-10-26 21:09:03 -0700
  • f20d7c3bd5 fmt chrislu 2025-10-26 20:29:13 -0700
  • 40f82aa806 Avoid misclassifying local EC as distributed when .dat stat errors occur; also standardize unload-before-remove. chrislu 2025-10-26 20:28:47 -0700
  • b5a6fa0cdf minor chrislu 2025-10-26 20:26:58 -0700
  • d07b24e42c Eliminated Redundant Parsing in checkOrphanedShards chrislu 2025-10-26 20:18:08 -0700
  • f85dd4df39 address comments chrislu 2025-10-26 19:56:34 -0700
  • e1b448100e The check for orphaned shards should be performed for the previous volume before resetting sameVolumeShards for the new volume. chrislu 2025-10-26 19:51:04 -0700
  • ab5f91ea3b handle exceptions in tests; use constants chrislu 2025-10-26 19:41:43 -0700
  • 4605a30446 unexpected error chrislu 2025-10-26 19:21:39 -0700
  • c6968ffd96 grouping logic should be updated to use both collection and volumeId to ensure correctness chrislu 2025-10-26 19:21:27 -0700
  • 2bcf65741f 10GB sparse files can be slow or fail on non-sparse FS. Use 10MB to hit SmallBlockSize math (1MB shards) deterministically. chrislu 2025-10-26 19:13:33 -0700
  • 46ce3b9831 fix shard directory chrislu 2025-10-26 13:58:38 -0700
  • fbb459ca4c minor chrislu 2025-10-26 13:57:56 -0700
  • 6fff6269c8 refactoring chrislu 2025-10-26 13:53:10 -0700
  • 7b6f364e7f calculate expected shard size chrislu 2025-10-26 13:48:11 -0700
  • 96caa76101 validate shard size chrislu 2025-10-26 13:32:03 -0700
  • ed3788eb80 check ec shard sizes chrislu 2025-10-26 11:53:18 -0700
  • e3d0f9e4ce Added Shard Size Validation chrislu 2025-10-26 11:46:22 -0700
  • d2822ae7e6 refactor chrislu 2025-10-26 10:45:49 -0700
  • 6f3cb7bebe Update disk_location_ec.go chrislu 2025-10-26 09:57:05 -0700
  • 3843a75ac6 in memory cleanup chrislu 2025-10-26 09:44:43 -0700
  • 1a124d1fd8 address comments chrislu 2025-10-26 09:42:40 -0700
  • 31f905ce2a Update disk_location_ec.go chrislu 2025-10-26 01:32:50 -0700
  • 51edda3356 simplify, and better logs chrislu 2025-10-26 01:28:18 -0700
  • 6f7ceb63eb unit tests chrislu 2025-10-26 01:25:48 -0700
  • 829dc8e092 handle incomplete ec encoding chrislu 2025-10-26 01:21:45 -0700
  • b73b14d87a add a todo #7383 add-admin-and-worker-to-helm-charts chrislu 2025-10-25 21:02:07 -0700
  • bcdbc461b3 address comments chrislu 2025-10-25 20:47:17 -0700
  • e4076dad9a add probe for workers chrislu 2025-10-25 20:46:00 -0700
  • cee8969bd1 supports Kubernetes versions from v1.14 to v1.30+, ensuring broad compatibility chrislu 2025-10-25 20:39:23 -0700
  • 6050e0c3aa address comments chrislu 2025-10-25 20:30:25 -0700
  • a450055fed address comments chrislu 2025-10-25 20:15:07 -0700
  • c5264bf933
    Update k8s/charts/seaweedfs/templates/admin/admin-ingress.yaml Chris Lu 2025-10-25 20:12:50 -0700