Commit Graph

  • 9c90396620
    Merge 1485330547 into 3729e9ba25 #7116 Chris Lu 2025-08-13 00:55:37 +0330
  • 056a9ae258
    Merge 1cb03cc7d2 into 3729e9ba25 #4898 ChengDaqi2023 2025-08-13 01:20:31 +0800
  • 3729e9ba25
    chore(deps): bump golang.org/x/image from 0.29.0 to 0.30.0 (#7129) master dependabot[bot] 2025-08-12 10:20:23 -0700
  • 890b51eaef
    chore(deps): bump golang.org/x/tools from 0.35.0 to 0.36.0 (#7128) dependabot[bot] 2025-08-12 10:20:09 -0700
  • 1485330547 Update ec_vacuum_task.go #7116 add-ec-vacuum chrislu 2025-08-12 09:50:17 -0700
  • 8213a4a2b6 use the EcVacuumLogic chrislu 2025-08-12 09:48:17 -0700
  • 425a54019b adding EcVacuumLogic chrislu 2025-08-12 09:45:30 -0700
  • 82907ad6ca determineGenerations() Removed chrislu 2025-08-12 09:33:40 -0700
  • 729268d065 detection with generation info chrislu 2025-08-12 09:32:07 -0700
  • 8a5c4a4972 add generation to TaskSource chrislu 2025-08-12 09:14:16 -0700
  • 80bfce59ad Create NOTES.md chrislu 2025-08-12 09:13:57 -0700
  • c6e4d0c549
    Merge aa41ee38c9 into 6bf5a6871c #6860 Jack 2025-08-12 10:25:35 +0100
  • 8ab85fc887
    Merge cb3e0d53bb into 6bf5a6871c #6814 Weihao Jiang 2025-08-12 10:19:35 +0100
  • 35f3da108b distribute index files to all volume servers that will have shards mounted, not just one chrislu 2025-08-12 00:33:49 -0700
  • 6bf5a6871c fix presigned signature chrislu 2025-08-11 23:57:57 -0700
  • c8c758e639 fix hanging task detail page chrislu 2025-08-11 23:55:24 -0700
  • 56db0a081a distribute .ecx files chrislu 2025-08-11 23:47:42 -0700
  • dbcc55af15
    chore(deps): bump golang.org/x/image from 0.29.0 to 0.30.0 #7129 dependabot[bot] 2025-08-12 06:41:12 +0000
  • 0d6ea416a7 fix retry link chrislu 2025-08-11 23:37:17 -0700
  • eda385aaa2
    chore(deps): bump golang.org/x/tools from 0.35.0 to 0.36.0 #7128 dependabot[bot] 2025-08-12 06:37:04 +0000
  • 3864f89f92
    chore(deps): bump golang.org/x/crypto from 0.40.0 to 0.41.0 (#7132) dependabot[bot] 2025-08-11 23:35:09 -0700
  • d1f18f08d3
    chore(deps): bump google.golang.org/protobuf from 1.36.6 to 1.36.7 (#7131) dependabot[bot] 2025-08-11 23:34:58 -0700
  • 4f9f9ec971 fix routing chrislu 2025-08-11 22:36:48 -0700
  • 9da113eb23
    chore(deps): bump golang.org/x/crypto from 0.40.0 to 0.41.0 #7132 dependabot[bot] 2025-08-12 04:57:34 +0000
  • 3bbe4481f2 remove unused code chrislu 2025-08-11 21:54:21 -0700
  • cac6a51cbf implement todos chrislu 2025-08-11 21:48:45 -0700
  • 7780a7d652 ec vacuum workflow is correct now chrislu 2025-08-11 21:41:18 -0700
  • 83b6a94bfe change to correct ec vacuum workflow chrislu 2025-08-11 21:14:36 -0700
  • 0f1c734626 fix mounting ec volumes chrislu 2025-08-11 20:34:02 -0700
  • 5ffff3e5d0
    chore(deps): bump google.golang.org/protobuf from 1.36.6 to 1.36.7 #7131 dependabot[bot] 2025-08-12 03:10:40 +0000
  • 2a61cda2cd adding retry button chrislu 2025-08-11 18:28:02 -0700
  • 5c93557314 detect shard sources chrislu 2025-08-11 17:36:27 -0700
  • 7cf5ddf8ac more self contained tasks chrislu 2025-08-11 17:16:16 -0700
  • 7622d14580 remove unused config chrislu 2025-08-11 17:08:48 -0700
  • bddb2cd5cc keep only ec config chrislu 2025-08-11 17:02:15 -0700
  • 96a2749355 adding EcVacuumTaskConfig chrislu 2025-08-11 16:59:55 -0700
  • f9e7ca4308 Merge branch 'master' into add-ec-vacuum chrislu 2025-08-11 16:45:45 -0700
  • 7889e78f4d use one http client chrislu 2025-08-11 16:44:51 -0700
  • af3300e063
    filer: server side copying (#7121) Chris Lu 2025-08-11 16:40:46 -0700
  • e9049c128e address comments #7121 chrislu 2025-08-11 16:30:47 -0700
  • 7bd4d3dfef address comments chrislu 2025-08-11 16:25:38 -0700
  • 6abb1531a5 there could be large chunks chrislu 2025-08-11 16:08:18 -0700
  • 406328c824 errgroup chrislu 2025-08-11 16:06:44 -0700
  • a962c41ce0 address comments chrislu 2025-08-11 15:53:24 -0700
  • 495fa079a1 handle manifest chunks chrislu 2025-08-11 15:43:16 -0700
  • a4d97056df copying chunks in parallel chrislu 2025-08-11 15:37:05 -0700
  • 05b9440036 address comments chrislu 2025-08-11 15:32:18 -0700
  • 5355bab55e deep copy remote entry chrislu 2025-08-11 15:25:50 -0700
  • 7e86045e22
    chore(deps): bump golang.org/x/net from 0.42.0 to 0.43.0 (#7126) dependabot[bot] 2025-08-11 15:21:46 -0700
  • d5edc72e4b address comments chrislu 2025-08-11 15:17:04 -0700
  • 5f6cb6d19f
    chore(deps): bump golang.org/x/net from 0.42.0 to 0.43.0 #7126 dependabot[bot] 2025-08-11 22:08:00 +0000
  • 529c68a798
    chore(deps): bump google.golang.org/api from 0.244.0 to 0.246.0 (#7127) dependabot[bot] 2025-08-11 15:06:25 -0700
  • e3b15073a0
    chore(deps): bump actions/checkout from 4 to 5 (#7125) dependabot[bot] 2025-08-11 15:06:14 -0700
  • 5f62b11889
    chore(deps): bump golang.org/x/sys from 0.34.0 to 0.35.0 (#7124) dependabot[bot] 2025-08-11 15:06:01 -0700
  • 524c1916b6
    chore(deps): bump github.com/redis/go-redis/v9 from 9.11.0 to 9.12.0 (#7123) dependabot[bot] 2025-08-11 15:05:53 -0700
  • 412fd6ee86
    chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.113.4 to 3.113.5 (#7122) dependabot[bot] 2025-08-11 15:05:44 -0700
  • b731384d9d check for the key's existence in the map first before accessing its members chrislu 2025-08-11 14:50:33 -0700
  • 739a738baf
    chore(deps): bump google.golang.org/api from 0.244.0 to 0.246.0 #7127 dependabot[bot] 2025-08-11 21:42:55 +0000
  • 495e5e5154
    chore(deps): bump actions/checkout from 4 to 5 #7125 dependabot[bot] 2025-08-11 21:27:58 +0000
  • da091c61d5
    chore(deps): bump golang.org/x/sys from 0.34.0 to 0.35.0 #7124 dependabot[bot] 2025-08-11 20:30:40 +0000
  • d28231548d
    chore(deps): bump github.com/redis/go-redis/v9 from 9.11.0 to 9.12.0 #7123 dependabot[bot] 2025-08-11 20:10:43 +0000
  • aea37246d5
    chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 #7122 dependabot[bot] 2025-08-11 19:58:36 +0000
  • 85fd6361fc destination is directory chrislu 2025-08-11 12:51:24 -0700
  • 65643242b7 address hardlink, checking existing directory chrislu 2025-08-11 12:37:36 -0700
  • 01873f0e63 remove unused functions, reuse http clients chrislu 2025-08-11 12:29:06 -0700
  • 2ab23ccf47 address comments chrislu 2025-08-11 12:17:52 -0700
  • 9e6258a464 copy chrislu 2025-08-11 12:05:46 -0700
  • 605b3333c1
    fix sftp start with filer (#7120) Chris Lu 2025-08-11 10:56:40 -0700
  • b3271f151c add bindIp #7120 chrislu 2025-08-11 10:44:36 -0700
  • b32a041591 fix sftp start with filer chrislu 2025-08-11 10:37:59 -0700
  • 9265e81fe9
    S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118) Chris Lu 2025-08-11 10:31:01 -0700
  • 46c76e86f3 address comments #7118 chrislu 2025-08-11 09:47:43 -0700
  • c9c0b218e9 Update chunked_reader_v4.go chrislu 2025-08-11 09:26:34 -0700
  • 7f1454ed07 This handles the case where we have unsigned streaming (no cred) but chunks contain signatures chrislu 2025-08-11 09:24:53 -0700
  • c1a6f475da
    Merge d96b8b96e6 into a265a07922 #7095 Konstantin Lebedev 2025-08-11 16:51:05 +0300
  • a265a07922 fix ttl objects chrislu 2025-08-11 02:20:02 -0700
  • f03f4383af fix missing grpc dial option chrislu 2025-08-11 02:19:22 -0700
  • c57ccd554a worker_pb.TaskParams_VacuumParams chrislu 2025-08-11 02:11:39 -0700
  • 9df006b49d fix min volume age chrislu 2025-08-11 01:54:10 -0700
  • 424bb7fe11 showing criteria chrislu 2025-08-11 01:34:33 -0700
  • 97d58e77c6 getting ec volume deletions chrislu 2025-08-11 01:03:21 -0700
  • 553a229fd3 reduce lock scope chrislu 2025-08-11 00:21:04 -0700
  • 57d025910d cancel context chrislu 2025-08-11 00:20:52 -0700
  • 213dd9b470 testing chrislu 2025-08-11 00:20:37 -0700
  • a31fc1ac01 Bypass compaction revision check to handle volumes compacted after task creation chrislu 2025-08-10 20:39:48 -0700
  • 91d641e685 avoid dead lock chrislu 2025-08-10 20:23:18 -0700
  • 740983d69e Delete ec_test_files.json chrislu 2025-08-10 20:15:36 -0700
  • 0e649f710a collect deletion for ec shards chrislu 2025-08-10 20:08:45 -0700
  • 772ee0f967 address comments chrislu 2025-08-10 19:58:52 -0700
  • 0c6980182c ec shards with generation chrislu 2025-08-10 19:40:35 -0700
  • 47ea1ac228 unmount chrislu 2025-08-10 19:39:24 -0700
  • 6446893e3c metrics chrislu 2025-08-10 19:39:11 -0700
  • 06c012ea60 Update maintenance_scanner.go chrislu 2025-08-10 19:37:54 -0700
  • 5a6954be1b sort chrislu 2025-08-10 18:42:27 -0700
  • 0f1ca16457 more accurate estimation chrislu 2025-08-10 18:42:22 -0700
  • 72f0a47563 CRITICAL: Check ALL task states for volume conflicts chrislu 2025-08-10 18:04:31 -0700
  • 751cfac7d7 Implement volume-aware task conflict checking chrislu 2025-08-10 18:02:42 -0700
  • 5c1e6e904d CRITICAL: Restore task conflict definitions to prevent data integrity issues chrislu 2025-08-10 17:56:13 -0700
  • 04e3a68b61 Replace deprecated ioutil with os package functions chrislu 2025-08-10 17:53:48 -0700
  • c220ad1e69 Replace bubble sort with idiomatic sort.Slice in EC shard management chrislu 2025-08-10 17:52:30 -0700