coffeecloudgit
c531e2eb0e
Update disk_location_ec.go ( #6359 )
Add lock for l.ecVolumes
7 days ago
coffeecloudgit
7eb8257126
Update store.go ( #6358 )
Add lock for location.ecVolumes And single delete
7 days ago
Lisandro Pin
9b48ce0613
Parallelize EC shards balancing within racks ( #6354 )
Parallelize EC shards balancing within racks.
7 days ago
Lisandro Pin
926cfea3dc
Parallelize EC shards balancing across racks. ( #6352 )
1 week ago
Lisandro Pin
b81def5e5c
Parallelize EC balancing for racks. ( #6351 )
1 week ago
zouyixiong
d6f3e1970d
fix: filer may crash by bucketLastActiveTsNs concurrency access. ( #6350 )
1 week ago
Konstantin Lebedev
0a4b1909a2
[shell] only apply the balancing for writable volumes ( #6346 )
1 week ago
zouyixiong
9987a65e8a
fix: record and delete bucket metrics after inactive ( #6349 )
1 week ago
Lisandro Pin
b0210df081
Begin implementing EC balancing parallelization support. ( #6342 )
* Begin implementing EC balancing parallelization support.
Impacts both `ec.encode` and `ec.balance`,
* Nit: improve type naming.
* Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof.
* Nit: unify naming for `ecBalancer` wait group methods with the rest of the module.
* Fix concurrency bug.
* Fix whitespace after Gitlab automerge.
* Delete stray TODO.
1 week ago
Lisandro Pin
23ffbb083c
Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID argument is provided. ( #6347 )
Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID is provided.
1 week ago
Lisandro Pin
6320036c56
Delete legacy balancing code for `ec.encode`. ( #6344 )
1 week ago
Konstantin Lebedev
700b95304b
[shell] volume.list show only writable volumes ( #6338 )
* show only writable volumes
* fix import
2 weeks ago
Konstantin Lebedev
c37281735e
volume.list avoid output empty data center and rack and disk info ( #6341 )
2 weeks ago
Lisandro Pin
8c82c037b9
Unify the re-balancing logic for `ec.encode` with `ec.balance`. ( #6339 )
Among others, this enables recent changes related to topology aware
re-balancing at EC encoding time.
2 weeks ago
Konstantin Lebedev
ff1392f7f4
[shell] use constant for hdd of type ( #6337 )
use constant for hdd of type
2 weeks ago
Lisandro Pin
522a25790a
Remove average constraints when selecting nodes/racks to balance EC shards into. ( #6325 )
2 weeks ago
vadimartynov
914ff0e718
Replaced https.client.enabled with false in scaffold/security ( #6320 )
2 weeks ago
chrislu
f3dde99796
adjust error message
2 weeks ago
Lisandro Pin
34cdbdd279
Share common parameters for EC re-balancing functions under a single struct. ( #6319 )
TODO cleanup for https://github.com/seaweedfs/seaweedfs/discussions/6179 .
2 weeks ago
Lisandro Pin
edef485333
Account for replication placement settings when balancing EC shards within the same rack. ( #6317 )
* Account for replication placement settings when balancing EC shards within racks.
* Update help contents for `ec.balance`.
* Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`.
3 weeks ago
Lisandro Pin
351efa134d
Account for replication placement settings when balancing EC shards across racks. ( #6316 )
3 weeks ago
Konstantin Lebedev
b65eb2ec45
[security] reload whiteList on http seerver ( #6302 )
* reload whiteList
* white_list add to scaffold
3 weeks ago
Lisandro Pin
b2ba7d7408
Resolve replica placement for EC volumes from master server defaults. ( #6303 )
3 weeks ago
Lisandro Pin
9a741a61b1
Display details upon failures to re-balance EC shards racks. ( #6299 )
3 weeks ago
Lisandro Pin
559a1fd0f4
Improve EC shards rebalancing logic across nodes ( #6297 )
* Improve EC shards rebalancing logic across nodes.
- Favor target nodes with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target nodes are available.
- Add logic to account for replication settings when selecting target nodes (currently disabled).
* Fix minor test typo.
* Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`.
4 weeks ago
steve.wei
88fa64a01a
change comment for expect header ( #6289 )
* remove case of expect
* Set the default value of the Expect header for compatibility.
4 weeks ago
Konstantin Lebedev
e2e97db917
[master] avoid timeout when assigning for main request with filter by DC or rack ( #6291 )
* avoid timeout when assigning for main request with filter by DC or rack
https://github.com/seaweedfs/seaweedfs/issues/6290
* use constant NoWritableVolumes
4 weeks ago
Konstantin Lebedev
fec88e64eb
[master] update LastLeaderChangeTime for hashicorp raft ( #6292 )
4 weeks ago
Trim21
d43fa07f06
use readable bytes size string in shell output ( #6288 )
4 weeks ago
Konstantin Lebedev
8836fa19b6
use ShouldGrowVolumesByDcAndRack ( #6280 )
4 weeks ago
Konstantin Lebedev
167b50be88
fix missing register master metric MasterPickForWriteErrorCounter ( #6277 )
4 weeks ago
Trim21
fd6c787c02
fix EcVolumes sorting in volume UI ( #6275 )
* Update store_ec.go
* fix: EcVolume sorting not work
* use stdlib
* revert
4 weeks ago
chrislu
ccf1795e6f
wait a bit before getting the next volume id if the leader is recently elected
4 weeks ago
chrislu
04081128a9
use math rand v2
1 month ago
chrislu
54204bc89b
format error
1 month ago
Lisandro Pin
ca499de1cb
Improve EC shards rebalancing logic across racks ( #6270 )
Improve EC shards rebalancing logic across racks.
- Favor target shards with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target shards are available.
- Add logic to account for replication settings when selecting target shards (currently disabled).
1 month ago
Numblgw
e56327e3b0
ExclusiveLocker only create one renew goroutine ( #6269 )
Co-authored-by: liguowei <liguowei@xinye.com>
1 month ago
Numblgw
aebf3952b7
filer sync: source path and exclude path support dir suffix ( #6268 )
filer sync: source path and exclude paht support dir suffix
Co-authored-by: liguowei <liguowei@xinye.com>
1 month ago
Konstantin Lebedev
7fa4e5c2a1
[master] Revert back automatic volume grow in case of compensate for crowded volumes ( #6267 )
brought back the Automatic Volume Grow to compensate for crowded volumes
1 month ago
Konstantin Lebedev
a143c888e5
[shell] don't require lock when there are no changes for volume.fix.replication ( #6266 )
* don't require lock when there are no changes
* revert takeAction
1 month ago
Konstantin Lebedev
a49d9e020c
[master] avoid crowded more writable for auto grow ( #6214 )
avoid crowded more writable
https://github.com/seaweedfs/seaweedfs/issues/6121
1 month ago
chrislu
75f5afa571
fix compilation
1 month ago
chrislu
1c143cfcea
display actual offset value
1 month ago
chrislu
c9f3448692
ReadAt may return io.EOF t end of file
related to https://github.com/seaweedfs/seaweedfs/issues/6219
1 month ago
chrislu
be09d08eb6
adjust error message
1 month ago
chrislu
6b2612690b
consistent error message if auth is not setup
fix https://github.com/seaweedfs/seaweedfs/issues/6262
1 month ago
Konstantin Lebedev
254ed8897e
[shell] add noLock param for volume.move ( #6261 )
1 month ago
chrislu
96f1a2e01a
adjust error message
1 month ago
chrislu
e28f55eb08
typo
1 month ago
chrislu
98f03862aa
rename
1 month ago