Commit Graph

  • c531e2eb0e
    Update disk_location_ec.go (#6359) coffeecloudgit 2024-12-16 14:05:47 +0800
  • 7eb8257126
    Update store.go (#6358) coffeecloudgit 2024-12-16 14:05:22 +0800
  • ce7db9f7eb
    Update disk_location_ec.go #6359 coffeecloudgit 2024-12-16 11:49:53 +0800
  • 65ded174e9
    Update store.go #6358 coffeecloudgit 2024-12-16 11:48:07 +0800
  • 47a2008209
    Update store.go #6357 coffeecloudgit 2024-12-16 10:10:04 +0800
  • 9b48ce0613
    Parallelize EC shards balancing within racks (#6354) Lisandro Pin 2024-12-15 22:36:23 +0100
  • 4c65c578db Parallelize EC shards balancing within racks. #6354 Lisandro Pin 2024-12-13 16:52:54 +0100
  • 926cfea3dc
    Parallelize EC shards balancing across racks. (#6352) Lisandro Pin 2024-12-13 15:05:32 +0100
  • d97ffc3bfb Parallelize EC shards balancing across racks. #6352 Lisandro Pin 2024-12-13 14:38:49 +0100
  • b81def5e5c
    Parallelize EC balancing for racks. (#6351) Lisandro Pin 2024-12-13 14:33:53 +0100
  • d6f3e1970d
    fix: filer may crash by bucketLastActiveTsNs concurrency access. (#6350) zouyixiong 2024-12-13 21:30:21 +0800
  • c25ed98665 Fix EC concurrency bug introduced by 1f736ce9. #6351 Lisandro Pin 2024-12-13 12:21:11 +0100
  • f33f53c100 Parallelize EC balancing for racks. Lisandro Pin 2024-12-13 12:02:51 +0100
  • 1f736ce9c1 Collect, and return, all errors on concurrent tasks for `shell.EcBalance()`. Lisandro Pin 2024-12-13 10:54:52 +0100
  • 0f3a1e7333
    Merge branch 'seaweedfs:master' into master #6350 zouyixiong 2024-12-13 17:31:22 +0800
  • d452a7ef2e fix: make bucketLastActiveTsNs concurrency write save by sync.Mutex XYZ 2024-12-13 17:16:34 +0800
  • 0a4b1909a2
    [shell] only apply the balancing for writable volumes (#6346) Konstantin Lebedev 2024-12-13 11:10:00 +0200
  • e0c588aaa4 fix test balance #6346 Konstantin Lebedev 2024-12-13 10:49:39 +0200
  • 9987a65e8a
    fix: record and delete bucket metrics after inactive (#6349) zouyixiong 2024-12-13 12:34:02 +0800
  • bd4b405d8f feat: use nao ts #6349 XYZ 2024-12-13 12:22:02 +0800
  • c33cd90d2b fix: record and delete bucket metrics after inactive XYZ 2024-12-13 11:13:32 +0800
  • b0210df081
    Begin implementing EC balancing parallelization support. (#6342) Lisandro Pin 2024-12-12 18:14:44 +0100
  • 651650a1be Delete stray TODO. #6342 Lisandro Pin 2024-12-12 18:13:30 +0100
  • 676fddbeb7 Fix whitespace after Gitlab automerge. Lisandro Pin 2024-12-12 18:07:38 +0100
  • e92568f393
    Merge branch 'master' into ec_topology/rebalance Lisandro Pin 2024-12-12 17:48:42 +0100
  • 23ffbb083c
    Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID argument is provided. (#6347) Lisandro Pin 2024-12-12 17:41:33 +0100
  • 2c9c145aa3 Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID is provided. #6347 Lisandro Pin 2024-12-12 17:05:27 +0100
  • 6320036c56
    Delete legacy balancing code for `ec.encode`. (#6344) Lisandro Pin 2024-12-12 16:42:03 +0100
  • ab1ab16ed9 only apply the balancing for writable volumes Konstantin Lebedev 2024-12-12 17:29:25 +0200
  • 797376ed47 Fix concurrency bug. Lisandro Pin 2024-12-12 15:29:57 +0100
  • 4913b0a2c0 Nit: unify naming for `ecBalancer` wait group methods with the rest of the module. Lisandro Pin 2024-12-12 15:28:43 +0100
  • f9b8bb998a Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof. Lisandro Pin 2024-12-12 12:51:08 +0100
  • a7f53b8105 Delete legacy balancing code for `ec.encode`. #6344 Lisandro Pin 2024-12-12 11:53:52 +0100
  • 6e4a217019 Nit: improve type naming. Lisandro Pin 2024-12-11 19:49:07 +0100
  • d1aa6774d9 Begin implementing EC balancing parallelization support. Lisandro Pin 2024-12-11 19:42:32 +0100
  • 700b95304b
    [shell] volume.list show only writable volumes (#6338) Konstantin Lebedev 2024-12-11 19:06:15 +0200
  • c37281735e
    volume.list avoid output empty data center and rack and disk info (#6341) Konstantin Lebedev 2024-12-11 19:03:16 +0200
  • 966076f4d4 volume.list avoid output empty data center and rack and disk info #6341 Konstantin Lebedev 2024-12-11 16:55:15 +0200
  • 7a90f0e6e1 fix import #6338 Konstantin Lebedev 2024-12-11 15:03:04 +0200
  • 860ae02ef8 show only writable volumes Konstantin Lebedev 2024-12-11 15:02:11 +0200
  • 8c82c037b9
    Unify the re-balancing logic for `ec.encode` with `ec.balance`. (#6339) Lisandro Pin 2024-12-10 22:30:13 +0100
  • c73ac9b78c Unify the re-balancing logic for `ec.encode` with `ec.balance`. #6339 Lisandro Pin 2024-12-10 18:48:35 +0100
  • ff1392f7f4
    [shell] use constant for hdd of type (#6337) Konstantin Lebedev 2024-12-10 18:43:59 +0200
  • ada941a88b use constant for hdd of type #6337 Konstantin Lebedev 2024-12-10 17:05:37 +0200
  • 4f6c989309
    chore(deps): bump golang.org/x/net from 0.31.0 to 0.32.0 (#6330) dependabot[bot] 2024-12-09 09:59:05 -0800
  • a36da40272
    chore(deps): bump golang.org/x/net from 0.31.0 to 0.32.0 #6330 dependabot[bot] 2024-12-09 17:07:15 +0000
  • af4c51aee6
    chore(deps): bump cloud.google.com/go/pubsub from 1.45.1 to 1.45.3 (#6328) dependabot[bot] 2024-12-09 09:04:45 -0800
  • a1efaa742a
    chore(deps): bump cloud.google.com/go/pubsub from 1.45.1 to 1.45.3 #6328 dependabot[bot] 2024-12-09 16:47:08 +0000
  • 3cd2f06279
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.69.0 to 1.71.0 (#6329) dependabot[bot] 2024-12-09 08:46:16 -0800
  • e438fdc16c
    chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.7.1 to 2.7.2 (#6331) dependabot[bot] 2024-12-09 08:46:00 -0800
  • 3680bbac56
    chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 (#6332) dependabot[bot] 2024-12-09 08:45:26 -0800
  • 67461ccd27
    chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 (#6333) dependabot[bot] 2024-12-09 08:45:13 -0800
  • f0b2070d9b
    chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 #6333 dependabot[bot] 2024-12-09 16:08:40 +0000
  • bfe673d71d
    chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 #6332 dependabot[bot] 2024-12-09 15:18:24 +0000
  • 63eebd9a46
    chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.7.1 to 2.7.2 #6331 dependabot[bot] 2024-12-09 15:18:21 +0000
  • adb96ca25d
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 #6329 dependabot[bot] 2024-12-09 15:18:10 +0000
  • 522a25790a
    Remove average constraints when selecting nodes/racks to balance EC shards into. (#6325) Lisandro Pin 2024-12-06 18:00:06 +0100
  • 25c643da68 Remove average constraints when selecting nodes/racks to balance EC shards into. #6325 Lisandro Pin 2024-12-06 16:15:07 +0100
  • 914ff0e718
    Replaced https.client.enabled with false in scaffold/security (#6320) vadimartynov 2024-12-05 21:39:28 +0300
  • dc3af02104 Updated the https.client.enabled option by default in scaffold/security #6320 vadimartynov 2024-12-05 21:08:35 +0300
  • f3dde99796 adjust error message chrislu 2024-12-05 09:33:49 -0800
  • 34cdbdd279
    Share common parameters for EC re-balancing functions under a single struct. (#6319) Lisandro Pin 2024-12-05 18:00:46 +0100
  • 8df1a02770 Share common parameters for EC re-balancing functions under a single struct. #6319 Lisandro Pin 2024-12-05 16:24:10 +0100
  • edef485333
    Account for replication placement settings when balancing EC shards within the same rack. (#6317) Lisandro Pin 2024-12-04 19:47:51 +0100
  • 81096effff Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`. #6317 Lisandro Pin 2024-12-04 18:42:16 +0100
  • f56d597728 Update help contents for `ec.balance`. Lisandro Pin 2024-12-04 18:25:43 +0100
  • 1afcf20765 Account for replication placement settings when balancing EC shards within racks. Lisandro Pin 2024-12-04 18:22:09 +0100
  • 351efa134d
    Account for replication placement settings when balancing EC shards across racks. (#6316) Lisandro Pin 2024-12-04 18:00:55 +0100
  • 9381b9dc3e Fix typo in 85362cb5. #6316 Lisandro Pin 2024-12-04 13:56:36 +0100
  • 85362cb5eb Update help contents for `ec.balance`. Lisandro Pin 2024-12-04 13:55:25 +0100
  • c86c3da053 Account for replication placement settings when balancing EC shards across racks. Lisandro Pin 2024-12-04 13:51:00 +0100
  • b65eb2ec45
    [security] reload whiteList on http seerver (#6302) Konstantin Lebedev 2024-12-02 23:38:10 +0500
  • b2ba7d7408
    Resolve replica placement for EC volumes from master server defaults. (#6303) Lisandro Pin 2024-12-02 17:44:07 +0100
  • ef6142f632 Add small TODO regarding help description for the re-balancing algorithm. #6303 Lisandro Pin 2024-12-02 13:30:41 +0100
  • c6991ab35c Rework 29a83aa9 so we only read master replica placement settings if none is specified via the command line. Lisandro Pin 2024-12-02 02:11:06 +0100
  • 11201ac95f adding agent chrislu 2024-12-01 14:24:41 -0800
  • 2a47790773 fix RemoteVids append #6304 Bruce Zou 2024-12-01 09:33:30 +0800
  • 39e020f801 Don't phone masters for default replication settings unless we really need to. Lisandro Pin 2024-11-29 16:40:08 +0100
  • 5fab5e1aff add remote location info for vol urls Bruce Zou 2024-11-29 22:40:39 +0800
  • 29a83aa9d2 Resolve replica placement for EC volumes from master server defaults. Lisandro Pin 2024-11-29 15:20:48 +0100
  • 7de0d8f442 white_list add to scaffold #6302 Konstantin Lebedev 2024-11-29 17:09:15 +0500
  • 3014c93aa1 reload whiteList Konstantin Lebedev 2024-11-29 16:09:31 +0500
  • 9a741a61b1
    Display details upon failures to re-balance EC shards racks. (#6299) Lisandro Pin 2024-11-28 17:42:41 +0100
  • a7ad72b0b7 Display details upon failures to rebalance EC shards racks. #6299 Lisandro Pin 2024-11-28 15:09:12 +0100
  • 559a1fd0f4
    Improve EC shards rebalancing logic across nodes (#6297) Lisandro Pin 2024-11-27 20:51:57 +0100
  • 8e9f0b91a6 Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`. #6297 Lisandro Pin 2024-11-27 19:46:16 +0100
  • 360f7bc4fb Fix minor test typo. Lisandro Pin 2024-11-27 16:54:24 +0100
  • fe3f4aec22 Improve EC shards rebalancing logic across nodes. Lisandro Pin 2024-11-27 16:32:45 +0100
  • 88fa64a01a
    change comment for expect header (#6289) steve.wei 2024-11-27 00:35:41 +0800
  • e2e97db917
    [master] avoid timeout when assigning for main request with filter by DC or rack (#6291) Konstantin Lebedev 2024-11-26 21:33:31 +0500
  • 6a0cdb51cd use constant NoWritableVolumes #6291 Konstantin Lebedev 2024-11-26 21:12:34 +0500
  • fec88e64eb
    [master] update LastLeaderChangeTime for hashicorp raft (#6292) Konstantin Lebedev 2024-11-26 21:02:45 +0500
  • 74408405be update LastLeaderChangeTime for hashicorp raft #6292 Konstantin Lebedev 2024-11-26 16:49:20 +0500
  • 0e30065d94 avoid timeout when assigning for main request with filter by DC or rack Konstantin Lebedev 2024-11-26 16:34:02 +0500
  • 5ebec9b417 Set the default value of the Expect header for compatibility. #6289 steve.wei 2024-11-26 19:24:24 +0800
  • 2769d28fe0 remove case of expect steve.wei 2024-11-26 16:00:57 +0800
  • d43fa07f06
    use readable bytes size string in shell output (#6288) Trim21 2024-11-26 09:25:17 +0800
  • e652e15966
    use readable bytes size string #6288 Trim21 2024-11-26 08:55:15 +0800
  • f965af51b7
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.3 to 1.69.0 (#6287) dependabot[bot] 2024-11-25 14:35:21 -0800
  • 62920410af
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 #6287 dependabot[bot] 2024-11-25 22:29:10 +0000