Konstantin Lebedev
ff1392f7f4
[shell] use constant for hdd of type ( #6337 )
use constant for hdd of type
10 months ago
Lisandro Pin
522a25790a
Remove average constraints when selecting nodes/racks to balance EC shards into. ( #6325 )
10 months ago
vadimartynov
914ff0e718
Replaced https.client.enabled with false in scaffold/security ( #6320 )
10 months ago
chrislu
f3dde99796
adjust error message
10 months ago
Lisandro Pin
34cdbdd279
Share common parameters for EC re-balancing functions under a single struct. ( #6319 )
TODO cleanup for https://github.com/seaweedfs/seaweedfs/discussions/6179 .
10 months ago
Lisandro Pin
edef485333
Account for replication placement settings when balancing EC shards within the same rack. ( #6317 )
* Account for replication placement settings when balancing EC shards within racks.
* Update help contents for `ec.balance`.
* Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`.
10 months ago
Lisandro Pin
351efa134d
Account for replication placement settings when balancing EC shards across racks. ( #6316 )
10 months ago
Konstantin Lebedev
b65eb2ec45
[security] reload whiteList on http seerver ( #6302 )
* reload whiteList
* white_list add to scaffold
10 months ago
Lisandro Pin
b2ba7d7408
Resolve replica placement for EC volumes from master server defaults. ( #6303 )
10 months ago
Lisandro Pin
9a741a61b1
Display details upon failures to re-balance EC shards racks. ( #6299 )
10 months ago
Lisandro Pin
559a1fd0f4
Improve EC shards rebalancing logic across nodes ( #6297 )
* Improve EC shards rebalancing logic across nodes.
- Favor target nodes with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target nodes are available.
- Add logic to account for replication settings when selecting target nodes (currently disabled).
* Fix minor test typo.
* Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`.
10 months ago
steve.wei
88fa64a01a
change comment for expect header ( #6289 )
* remove case of expect
* Set the default value of the Expect header for compatibility.
10 months ago
Konstantin Lebedev
e2e97db917
[master] avoid timeout when assigning for main request with filter by DC or rack ( #6291 )
* avoid timeout when assigning for main request with filter by DC or rack
https://github.com/seaweedfs/seaweedfs/issues/6290
* use constant NoWritableVolumes
10 months ago
Konstantin Lebedev
fec88e64eb
[master] update LastLeaderChangeTime for hashicorp raft ( #6292 )
10 months ago
Trim21
d43fa07f06
use readable bytes size string in shell output ( #6288 )
10 months ago
Konstantin Lebedev
8836fa19b6
use ShouldGrowVolumesByDcAndRack ( #6280 )
10 months ago
Konstantin Lebedev
167b50be88
fix missing register master metric MasterPickForWriteErrorCounter ( #6277 )
10 months ago
Trim21
fd6c787c02
fix EcVolumes sorting in volume UI ( #6275 )
* Update store_ec.go
* fix: EcVolume sorting not work
* use stdlib
* revert
11 months ago
chrislu
ccf1795e6f
wait a bit before getting the next volume id if the leader is recently elected
11 months ago
chrislu
04081128a9
use math rand v2
11 months ago
chrislu
54204bc89b
format error
11 months ago
Lisandro Pin
ca499de1cb
Improve EC shards rebalancing logic across racks ( #6270 )
Improve EC shards rebalancing logic across racks.
- Favor target shards with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target shards are available.
- Add logic to account for replication settings when selecting target shards (currently disabled).
11 months ago
Numblgw
e56327e3b0
ExclusiveLocker only create one renew goroutine ( #6269 )
Co-authored-by: liguowei <liguowei@xinye.com>
11 months ago
Numblgw
aebf3952b7
filer sync: source path and exclude path support dir suffix ( #6268 )
filer sync: source path and exclude paht support dir suffix
Co-authored-by: liguowei <liguowei@xinye.com>
11 months ago
Konstantin Lebedev
7fa4e5c2a1
[master] Revert back automatic volume grow in case of compensate for crowded volumes ( #6267 )
brought back the Automatic Volume Grow to compensate for crowded volumes
11 months ago
Konstantin Lebedev
a143c888e5
[shell] don't require lock when there are no changes for volume.fix.replication ( #6266 )
* don't require lock when there are no changes
* revert takeAction
11 months ago
Konstantin Lebedev
a49d9e020c
[master] avoid crowded more writable for auto grow ( #6214 )
avoid crowded more writable
https://github.com/seaweedfs/seaweedfs/issues/6121
11 months ago
chrislu
75f5afa571
fix compilation
11 months ago
chrislu
1c143cfcea
display actual offset value
11 months ago
chrislu
c9f3448692
ReadAt may return io.EOF t end of file
related to https://github.com/seaweedfs/seaweedfs/issues/6219
11 months ago
chrislu
be09d08eb6
adjust error message
11 months ago
chrislu
6b2612690b
consistent error message if auth is not setup
fix https://github.com/seaweedfs/seaweedfs/issues/6262
11 months ago
Konstantin Lebedev
254ed8897e
[shell] add noLock param for volume.move ( #6261 )
11 months ago
chrislu
96f1a2e01a
adjust error message
11 months ago
chrislu
e28f55eb08
typo
11 months ago
chrislu
98f03862aa
rename
11 months ago
chrislu
07cf8cf22d
minor
11 months ago
Lisandro Pin
0d5393641e
Unify usage of shell.EcNode.dc as DataCenterId. ( #6258 )
11 months ago
chrislu
bc7650bd61
adds more info on skipped volumes
11 months ago
Lisandro Pin
f2db746690
Introduce logic to resolve volume replica placement within EC rebalancing. ( #6254 )
* Rename `command_ec_encode_test.go` to `command_ec_common_test.go`.
All tests defined in this file are now for `command_ec_common.go`.
* Minor code cleanups.
- Fix broken `ec.balance` test.
- Rework integer ceiling division to not use floats, which can introduce precision errors.
* Introduce logic to resolve volume replica placement within EC rebalancing.
This will be used to make rebalancing logic topology-aware.
* Give shell.EcNode.dc a dedicated DataCenterId type.
11 months ago
chrislu
7b3c0e937f
3.80
11 months ago
zemul
6d3e38f439
Adjust threshold config ( #6246 )
* fix:mount deadlock
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
11 months ago
Kevin Bulteel
4a0dc883cf
Fix/parse upload filename ( #6241 )
* fix: parse filename in PUT + refactor
* fix: master iu public url with http
* fix: better parsing and handle disposition header
* fix: take mime type from file extension if not set
11 months ago
Max Denushev
a5fe6e21bc
feat(filer.backup): add ignore errors option ( #6235 )
* feat(filer.backup): add ignore errors option
* feat(filer.backup): fix 404 error wrap
* feat(filer.backup): fix wrapping function
* feat(filer.backup): fix wrapping errors in genProcessFunction
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
---------
Co-authored-by: Max Denushev <denushev@tochka.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
11 months ago
Eugeniy E. Mikhailov
3003c9e17e
added backward compatible CRC check and extra explanatory comments ( #6233 )
11 months ago
Chris Lu
72b14a451e
delete aborted ec shards from both source and target servers ( #6221 )
fix https://github.com/seaweedfs/seaweedfs/issues/6205#issuecomment-2465004586
11 months ago
chrislu
113c9ce6a8
remove the direct_io flag, as it is not well-supported on macOS
11 months ago
chrislu
88a1eee31c
adjust logs
11 months ago
chrislu
62c4980754
add debug info
11 months ago
Konstantin Lebedev
9a5d3e7b31
[shell] add admin noLock for balance ( #6209 )
add admin noLock for balance
11 months ago