chrislu
b1de205d6c
refactor: update ec_encoder.go to use ECContext
- Add WriteEcFilesWithContext() and RebuildEcFilesWithContext() functions
- Keep old functions for backward compatibility (call new versions)
- Update all internal functions to accept ECContext parameter
- Use ctx.DataShards, ctx.ParityShards, ctx.TotalShards consistently
- Use ctx.CreateEncoder() instead of hardcoded reedsolomon.New()
- Use ctx.ToExt() for shard file extensions
- No behavior change, still uses default 10+4 configuration
1 month ago
Chris Lu
9d013ea9b8
Admin UI: include ec shard sizes into volume server info ( #7071 )
* show ec shards on dashboard, show max in its own column
* master collect shard size info
* master send shard size via VolumeList
* change to more efficient shard sizes slice
* include ec shard sizes into volume server info
* Eliminated Redundant gRPC Calls
* much more efficient
* Efficient Counting: bits.OnesCount32() uses CPU-optimized instructions to count set bits in O(1)
* avoid extra volume list call
* simplify
* preserve existing shard sizes
* avoid hard coded value
* Update weed/storage/erasure_coding/ec_volume_info.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update weed/admin/dash/volume_management.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update ec_volume_info.go
* address comments
* avoid duplicated functions
* Update weed/admin/dash/volume_management.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
* simplify
* refactoring
* fix compilation
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
4 months ago
Chris Lu
69553e5ba6
convert error fromating to %w everywhere ( #6995 )
5 months ago
chrislu
e5adc3872a
ensure deleted entries are deleted
fix https://github.com/seaweedfs/seaweedfs/issues/6936
5 months ago
Lars Lehtonen
a879e1bbb5
weed/storage/erasure_coding: remove unused err from encodeDatFile() signature
2 years ago
Nikita Mochalov
e6a49dc533
Fix resource leaks ( #4737 )
* Fix division by zero
* Fix file handle leak
* Fix file handle leak
* Fix file handle leak
* Fix goroutine leak
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
guol-fnst
ac694f0c8f
rename parameter and reuse functions
rename milestone to watermark
3 years ago
justin
d51a724101
fix: encode small chunk return error maybe have some bug.
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
5 years ago
Chris Lu
9fd7cdadf1
fix
6 years ago
Chris Lu
3b638d3994
add more ec encoding logging
6 years ago
Chris Lu
0871d2cff0
volume: fix memory leak during compaction
fix https://github.com/chrislusf/seaweedfs/issues/1222
6 years ago
Chris Lu
8d94564f41
refactor
6 years ago
Chris Lu
c1288e9eb4
volume: sdx generation uses memdb instead of compactMap
fix https://github.com/chrislusf/seaweedfs/issues/1194
6 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
6 years ago
Chris Lu
58f88e530c
volume: use sorted index map for readonly volumes
6 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
6 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
6 years ago
Chris Lu
856da7aae2
ec volume support deletes
7 years ago
Chris Lu
11cffb3168
fix ec.rebuild bugs
7 years ago
Chris Lu
7e80b2b882
fix multiple bugs
7 years ago
Chris Lu
f0e6574d5e
allocate ec shards to volume servers
7 years ago
Chris Lu
228850d588
shard id starts from zero
7 years ago
Chris Lu
17ac1290c0
volume: load ec shards during heartbeats to master
7 years ago
Chris Lu
fbbc74abb4
adds VolumeEcGenerateSlices, VolumeEcCopy
7 years ago
Chris Lu
7c2c60c376
add locating data inside the ec files
7 years ago
Chris Lu
87f63b9c08
generate ec01~ec14, generate ecx file with sorted needle values
7 years ago
Chris Lu
8156958ee9
move function to make travis happy
7 years ago
Chris Lu
0a36f628c6
testing RS coding
7 years ago