Commit Graph

  • 70a4289466 add github action #7520 chrislu 2025-11-20 23:12:27 -0800
  • 9d58e2da04 address comments chrislu 2025-11-20 23:11:41 -0800
  • cf8c6463be fix eachEntryFunc Roman Tamarov 2025-11-21 10:06:50 +0300
  • 64dd9fc68c test read write by s3fs and PyArrow native file system for s3 chrislu 2025-11-20 22:44:44 -0800
  • a46be6e1a9 fix foundationdb test s Roman Tamarov 2025-11-21 09:40:03 +0300
  • 7c82e1a3d1 Update s3api_bucket_handlers.go #7519 chrislu 2025-11-20 22:27:46 -0800
  • ebaeaa6892 Update s3api_bucket_handlers.go chrislu 2025-11-20 22:19:12 -0800
  • f6f88d0bb8
    Merge branch 'master' into add_error_list_each_entry_func tam-i13 2025-11-21 09:14:02 +0300
  • 5890109812 Update s3api_bucket_handlers.go chrislu 2025-11-20 22:08:48 -0800
  • 7f814f8772 fix security vulnerability chrislu 2025-11-20 22:00:55 -0800
  • ec69e25d7b fix comparing chrislu 2025-11-20 21:56:42 -0800
  • fec3088fb1 refactor to test chrislu 2025-11-20 21:37:36 -0800
  • b72df84361 fallback to request header if iam is not enabled chrislu 2025-11-20 21:15:31 -0800
  • 611a2db4e3 set identity id chrislu 2025-11-20 21:11:38 -0800
  • 2a5e5049c7 no-owner buckets chrislu 2025-11-20 21:11:25 -0800
  • 53dfc43d2b add unit tests chrislu 2025-11-20 21:07:31 -0800
  • c81ff673a1 simplify chrislu 2025-11-20 21:04:43 -0800
  • b02f865183 list owned buckets chrislu 2025-11-20 20:59:17 -0800
  • c1b8d4bf0d
    S3: adds FilerClient to use cached volume id (#7518) Chris Lu 2025-11-20 20:50:26 -0800
  • c4f4d38f90 data racing in test #7518 chrislu 2025-11-20 19:50:44 -0800
  • 5875acf7d9 improve: call IAM server Shutdown() for best-effort cleanup chrislu 2025-11-20 19:42:55 -0800
  • c384f43c65
    Update weed/wdclient/masterclient.go Chris Lu 2025-11-20 19:42:10 -0800
  • 8eb1c733d0 improve: add data center preference and URL shuffling for consistent performance chrislu 2025-11-20 18:59:00 -0800
  • 7f19067b7d Can't use defer directly in loop chrislu 2025-11-20 18:28:21 -0800
  • bd8259c2a1 fix: use defer cancel() with anonymous function for proper context cleanup chrislu 2025-11-20 18:27:34 -0800
  • db87abd496 fix: rename vicCacheLock to vidCacheLock for consistency chrislu 2025-11-20 17:55:51 -0800
  • 85cbe7f7b2 refactor: make retry and timeout parameters configurable chrislu 2025-11-20 17:53:44 -0800
  • 0d3947afab retry parameters chrislu 2025-11-20 17:53:38 -0800
  • ba2dcfc26c refactor: make circuit breaker parameters configurable in FilerClient chrislu 2025-11-20 17:51:03 -0800
  • 5df2e9a691 fmt chrislu 2025-11-20 17:41:21 -0800
  • e5073e75bc refactor: address code review feedback on comments and style chrislu 2025-11-20 17:31:38 -0800
  • e8fc6606dc purge chrislu 2025-11-20 17:29:27 -0800
  • 890e5c8bd8 fix: add timeout to master volume lookup to prevent indefinite blocking chrislu 2025-11-20 17:28:03 -0800
  • 5426dc4027 fix: use client ID instead of timeout for gRPC signature parameter chrislu 2025-11-20 17:26:38 -0800
  • f665a63c42 refactor: remove unnecessary KeepMasterClientConnected wrapper in filer chrislu 2025-11-20 17:04:55 -0800
  • f75a90d88d fix: goroutine and connection leak in IAM server shutdown chrislu 2025-11-20 16:47:02 -0800
  • 7b264afdb4 fix: always reset vidMap cache on master reconnection chrislu 2025-11-20 16:45:23 -0800
  • f0c27ffbb2 fix: create fresh timeout context for each filer retry attempt chrislu 2025-11-20 16:37:08 -0800
  • 19962b8c56 fix: data race on filerHealth.lastFailureTime in circuit breaker chrislu 2025-11-20 16:35:35 -0800
  • b0058af417 fix: IAM server must start KeepConnectedToMaster for masterClient usage chrislu 2025-11-20 16:34:06 -0800
  • 8ef04a4a84 improve: clarify Aborted error handling in volume lookups chrislu 2025-11-20 16:30:30 -0800
  • 99ae38339d fix: OnPeerUpdate should only process updates for matching FilerGroup chrislu 2025-11-20 16:21:50 -0800
  • 3a5b5ea02c improve: add circuit breaker to skip known-unhealthy filers chrislu 2025-11-20 16:20:06 -0800
  • 9d31b5d21d fmt chrislu 2025-11-20 16:16:16 -0800
  • 85ad2e9a13 improve: implement gRPC-aware retry for FilerClient volume lookups chrislu 2025-11-20 16:15:06 -0800
  • 3e6ec1e727 fix: restore observability instrumentation in MasterClient chrislu 2025-11-20 13:54:02 -0800
  • 1601a4133a improve: address remaining code review findings chrislu 2025-11-20 13:52:07 -0800
  • 71f8a6e189 fix: handle partial results correctly in LookupVolumeIdsWithFallback callers chrislu 2025-11-20 13:21:05 -0800
  • f799596419 improve: address code review findings on error handling and documentation chrislu 2025-11-20 13:18:37 -0800
  • 8b8fa8d260 fix: restore leader change detection in KeepConnected stream loop chrislu 2025-11-20 13:16:15 -0800
  • 01b9b68ac5 fix: FilerClient supports multiple filer addresses for high availability chrislu 2025-11-20 13:14:50 -0800
  • c81bb716b5 fix: prevent vidMap swap race condition in LookupFileIdWithFallback chrislu 2025-11-20 12:46:37 -0800
  • 5a1eed0835 refactor: mount uses FilerClient for efficient volume location caching chrislu 2025-11-20 12:30:22 -0800
  • bcabd1e5a6 refactor: MasterClient embeds vidMapClient to eliminate ~150 lines of duplication chrislu 2025-11-20 12:27:36 -0800
  • c0342f23b7 adds FilerClient to use cached volume id chrislu 2025-11-20 12:20:10 -0800
  • 5f77f87335
    S3: S3 Object Retention API to include XML namespace support (#7517) Chris Lu 2025-11-20 11:42:22 -0800
  • 20199490d6 Added XMLNS field setting in both places #7517 chrislu 2025-11-20 10:48:07 -0800
  • e67909cb48 Refactor S3 Object Retention API to include XML namespace support and improve compatibility with Veeam. Updated XML tags to remove hardcoded namespaces and added test cases for retention and legal hold configurations without namespaces. chrislu 2025-11-20 10:32:54 -0800
  • 37cb44df9b
    Merge branch 'master' into add_error_list_each_entry_func tam-i13 2025-11-20 14:01:38 +0300
  • 6281e62d7f
    S3: JWT generation for volume server authentication (#7514) Chris Lu 2025-11-20 00:07:00 -0800
  • 5f286e58aa Update s3api_object_handlers.go #7514 chrislu 2025-11-19 23:39:16 -0800
  • 311b722774 Refactor JWT generation for volume server authentication to use centralized function from filer package, improving code clarity and reducing redundancy. chrislu 2025-11-19 23:27:30 -0800
  • 987513f93d
    Merge branch 'master' into add_error_list_each_entry_func tam-i13 2025-11-20 09:01:19 +0300
  • c14e513964
    chore(deps): bump org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0 in /other/java/hdfs3 (#7512) dependabot[bot] 2025-11-19 21:22:18 -0800
  • c239150b53 fix buffer #7512 chrislu 2025-11-19 21:08:01 -0800
  • 7dce429e61
    chore(deps): bump golang.org/x/crypto from 0.43.0 to 0.45.0 (#7511) dependabot[bot] 2025-11-19 21:01:12 -0800
  • 42b4909da2 fix chrislu 2025-11-19 21:00:24 -0800
  • d9be928558 add java integration tests chrislu 2025-11-19 20:56:34 -0800
  • e764db8925 Update dependency-reduced-pom.xml chrislu 2025-11-19 20:43:41 -0800
  • 315f361198 add java client unit tests chrislu 2025-11-19 20:43:22 -0800
  • e8c67acb95 go mod tidy #7511 chrislu 2025-11-19 20:36:28 -0800
  • 4c07635a85
    chore(deps): bump org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0 in /other/java/hdfs-over-ftp (#7513) dependabot[bot] 2025-11-19 20:35:35 -0800
  • d8cac1a6cc
    Account Info (#7507) Leonardo Lara 2025-11-20 01:34:38 -0300
  • 034fef9a41 Update command_s3_configure.go #7507 chrislu 2025-11-19 20:28:33 -0800
  • 7a604b2d37 address comments chrislu 2025-11-19 20:11:27 -0800
  • a354e1a724
    chore(deps): bump org.apache.hadoop:hadoop-common #7513 dependabot[bot] 2025-11-20 04:09:10 +0000
  • 63219df418
    chore(deps): bump org.apache.hadoop:hadoop-common in /other/java/hdfs3 dependabot[bot] 2025-11-20 04:08:49 +0000
  • d2daea1552
    chore(deps): bump golang.org/x/crypto from 0.43.0 to 0.45.0 in /test/kafka/kafka-client-loadtest (#7510) dependabot[bot] 2025-11-19 20:08:27 -0800
  • c6b6ea40e6
    filer store: add foundationdb (#7178) Chris Lu 2025-11-19 20:06:57 -0800
  • 079f536204
    chore(deps): bump golang.org/x/crypto from 0.43.0 to 0.45.0 dependabot[bot] 2025-11-20 02:59:37 +0000
  • 930b736d9d
    chore(deps): bump golang.org/x/crypto #7510 dependabot[bot] 2025-11-20 02:45:32 +0000
  • f93b1f47b3 nil compare #7178 chrislu 2025-11-19 14:25:12 -0800
  • bdef2850c5 Install FoundationDB client libraries chrislu 2025-11-19 14:18:00 -0800
  • 282cb139e8 add go test chrislu 2025-11-19 14:15:46 -0800
  • 8232a4cea0 fixes chrislu 2025-11-19 14:13:00 -0800
  • 976a6eb3d5 empty vs no data chrislu 2025-11-19 13:54:23 -0800
  • 1502686166 fix build chrislu 2025-11-19 13:52:24 -0800
  • 8be9e258fc
    S3: Add tests for PyArrow with native S3 filesystem (#7508) Chris Lu 2025-11-19 13:49:22 -0800
  • 08ae6e8ca4 address comments chrislu 2025-11-19 13:48:39 -0800
  • 8d54fded4b separate transaction chrislu 2025-11-19 13:48:11 -0800
  • 6954d133b5 Update test_pyarrow_native_s3.py #7508 chrislu 2025-11-19 13:32:09 -0800
  • 1c650c6466 refactoring chrislu 2025-11-19 13:24:11 -0800
  • 00422b40a9 clean up chrislu 2025-11-19 13:20:45 -0800
  • 0d4019a3d4 Update test_pyarrow_native_s3.py chrislu 2025-11-19 13:16:13 -0800
  • 69568302b8 ENABLE_SSE_S3 chrislu 2025-11-19 12:59:28 -0800
  • 02eacddc15 minor chrislu 2025-11-19 12:58:02 -0800
  • aeba6513ad update chrislu 2025-11-19 12:56:48 -0800
  • 0e45e5bb10 add sse-s3 tests chrislu 2025-11-19 12:48:09 -0800
  • 08ed4af4ec PyArrow native S3 filesystem chrislu 2025-11-19 12:28:21 -0800
  • dee2317cba address comments chrislu 2025-11-19 12:08:08 -0800