Commit Graph

  • 9f2b695238 copy for non versioned files chrislu 2025-11-25 12:14:02 -0800
  • b78b521a8a fix copying for paused versioning buckets chrislu 2025-11-25 12:02:18 -0800
  • 3f1a34d8d7 doc chrislu 2025-11-25 11:59:36 -0800
  • f6a604c538
    S3: Fix encrypted file copy with multiple chunks (#7530) (#7546) Chris Lu 2025-11-25 09:56:20 -0800
  • 3a3e6c1fc7 Address PR review feedback: simplify tests and improve clarity #7546 Chris Lu 2025-11-25 09:35:18 -0800
  • a24c31de06
    S3: Add `Vary` header for non-wildcard AllowOrigin (#7547) 粒粒橙 2025-11-25 22:19:34 +0800
  • f9c5b9824d S3: Fix encrypted file copy with multiple chunks (#7530) Chris Lu 2025-11-25 01:06:05 -0800
  • 16cb0f981a
    Add `Vary` header for non-wildcard AllowOrigin #7547 粒粒橙 2025-11-25 16:28:15 +0800
  • 935c641f25
    chore(deps): bump actions/setup-go from 5 to 6 (#7542) dependabot[bot] 2025-11-25 00:41:45 -0800
  • fb01269ded
    chore(deps): bump actions/checkout from 4 to 6 (#7543) dependabot[bot] 2025-11-25 00:41:33 -0800
  • 2712a0daeb
    chore(deps): bump github.com/linkedin/goavro/v2 from 2.14.0 to 2.14.1 (#7537) dependabot[bot] 2025-11-25 00:40:49 -0800
  • a4c5e85a1f go mod tidy #7537 chrislu 2025-11-25 00:13:57 -0800
  • a23a5349e8
    chore(deps): bump actions/checkout from 4 to 6 #7543 dependabot[bot] 2025-11-25 08:10:08 +0000
  • 564b72f376
    chore(deps): bump actions/setup-go from 5 to 6 #7542 dependabot[bot] 2025-11-25 08:09:42 +0000
  • 80cb4ca1a8
    Merge fcec9b4abe into 9f413de6a9 #6065 dependabot[bot] 2025-11-25 08:04:01 +0000
  • 37e9225606
    Merge 9d06589d20 into 9f413de6a9 #6045 dependabot[bot] 2025-11-25 08:04:00 +0000
  • 9f413de6a9
    HDFS: Java client replication configuration (#7526) Chris Lu 2025-11-25 00:03:54 -0800
  • 274750fb82 remove try catch #7526 chrislu 2025-11-24 23:52:31 -0800
  • d4bd0f8518 clean up chrislu 2025-11-24 23:39:45 -0800
  • 0da72322d1 clean up chrislu 2025-11-24 23:30:00 -0800
  • fd1d48a989 treat as root chrislu 2025-11-24 23:00:21 -0800
  • 30dee336a3 Update spark-integration-tests.yml chrislu 2025-11-24 22:37:47 -0800
  • 3d00bc6145 Update spark-integration-tests.yml chrislu 2025-11-24 22:27:13 -0800
  • b0a19a00c2 Update SeaweedHadoopInputStream.java chrislu 2025-11-24 22:22:55 -0800
  • 773e0ff237 Update pom.xml chrislu 2025-11-24 22:22:49 -0800
  • e76753b1f1 purge chrislu 2025-11-24 22:20:40 -0800
  • 046bba92af Update pom.xml chrislu 2025-11-24 22:17:24 -0800
  • b94e78578a Update pom.xml chrislu 2025-11-24 22:15:52 -0800
  • 4b066e1e5a security fix chrislu 2025-11-24 22:13:20 -0800
  • 474a63e425 disable chrislu 2025-11-24 22:04:12 -0800
  • 82266d8271 less logs chrislu 2025-11-24 22:04:00 -0800
  • 5e1065f3fd
    Merge branch 'master' into add_error_list_each_entry_func #7485 tam-i13 2025-11-25 09:03:54 +0300
  • 8af6692ace less logs chrislu 2025-11-24 21:51:57 -0800
  • 972c2b12c8 remove hdfs2 chrislu 2025-11-24 21:48:59 -0800
  • cbbb1e52ac clean chrislu 2025-11-24 21:42:15 -0800
  • 785dbc6077 clean up tests chrislu 2025-11-24 21:29:49 -0800
  • 32118a82bc tests not needed now chrislu 2025-11-24 21:24:57 -0800
  • 0fdf5f1a12 fixing hdfs3 chrislu 2025-11-24 20:38:04 -0800
  • 73a22e1875
    Merge 1cb03cc7d2 into e5d12d926b #4898 ChengDaqi2023 2025-11-25 04:40:21 +0800
  • e5d12d926b
    Add explicit IP and binding parameters in Docker Compose (#7533) Gophlet 2025-11-25 04:36:48 +0800
  • ed6add9046
    chore(deps): bump actions/upload-artifact from 4 to 5 (#7541) dependabot[bot] 2025-11-24 11:48:26 -0800
  • 0559e13f44
    chore(deps): bump actions/setup-java from 4 to 5 (#7540) dependabot[bot] 2025-11-24 11:48:19 -0800
  • 0e6bee6c5b
    chore(deps): bump actions/setup-python from 5 to 6 (#7539) dependabot[bot] 2025-11-24 11:48:11 -0800
  • 2dfa824cef
    chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.39.5 to 1.40.0 (#7538) dependabot[bot] 2025-11-24 11:48:05 -0800
  • c4cf5553fa
    chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.113.5 to 3.118.2 (#7536) dependabot[bot] 2025-11-24 11:47:53 -0800
  • a3a19ac172
    chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azidentity from 1.13.0 to 1.13.1 (#7534) dependabot[bot] 2025-11-24 11:47:43 -0800
  • 9b94f970c7 fix: implement flush-on-getPos() - still fails with 78-byte error chrislu 2025-11-24 11:23:52 -0800
  • 580a6c1e00 debug: add rename logging - proves metadata IS preserved correctly chrislu 2025-11-24 11:18:38 -0800
  • e878431dea docs: final investigation summary - issue is in rename operation chrislu 2025-11-24 11:14:16 -0800
  • b44e51fae6 WIP: implement metadata visibility check in close() chrislu 2025-11-24 10:56:28 -0800
  • 75f4195f25 docs: comprehensive analysis of I/O comparison findings chrislu 2025-11-24 10:31:36 -0800
  • d045624994 test: comprehensive I/O comparison reveals timing/metadata issue chrislu 2025-11-24 10:30:46 -0800
  • 6ae8b12917 test: prove I/O operations identical between local and SeaweedFS chrislu 2025-11-24 10:23:30 -0800
  • d4d6836139 test: prove Spark CAN read Parquet files (both direct and Spark-written) chrislu 2025-11-24 10:15:00 -0800
  • 1d78409440 test: prove Parquet works perfectly when written directly (not via Spark) chrislu 2025-11-24 10:11:55 -0800
  • fba35124af experiment: prove chunk count irrelevant to 78-byte EOF error chrislu 2025-11-24 10:08:11 -0800
  • f6b0c1e216 docs: comprehensive recommendation for Parquet EOF fix chrislu 2025-11-24 09:56:04 -0800
  • 1cdb2fcf07 fix: implement flush-before-getPos() for Parquet compatibility chrislu 2025-11-24 09:54:41 -0800
  • b019ec8f08 feat: comprehensive Parquet EOF debugging with multiple fix attempts chrislu 2025-11-24 09:39:56 -0800
  • 4641d31f48
    chore(deps): bump actions/upload-artifact from 4 to 5 #7541 dependabot[bot] 2025-11-24 15:32:38 +0000
  • 376316db2c
    chore(deps): bump actions/setup-java from 4 to 5 #7540 dependabot[bot] 2025-11-24 15:32:28 +0000
  • bc934f6962
    chore(deps): bump actions/setup-python from 5 to 6 #7539 dependabot[bot] 2025-11-24 15:32:23 +0000
  • 6311d8ed6e
    chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.39.5 to 1.40.0 #7538 dependabot[bot] 2025-11-24 15:21:04 +0000
  • d49c444345
    chore(deps): bump github.com/linkedin/goavro/v2 from 2.14.0 to 2.14.1 dependabot[bot] 2025-11-24 15:19:53 +0000
  • 9a0f7e4c93
    chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 #7536 dependabot[bot] 2025-11-24 15:19:46 +0000
  • 17bdaa6809
    chore(deps): bump google.golang.org/protobuf from 1.36.9 to 1.36.10 #7535 dependabot[bot] 2025-11-24 15:19:39 +0000
  • f8934592cc
    chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azidentity #7534 dependabot[bot] 2025-11-24 15:19:35 +0000
  • e8223e97f8
    fix(compose): correct command args to ensure proper IP binding #7533 Gophlet 2025-11-24 22:00:58 +0800
  • 58f5b6b99b
    Bootstrap logic to fix read-only volumes with `volume.check.disk`. Lisandro Pin 2025-11-24 14:08:29 +0100
  • 3f242dcf73
    Bootstrap logic to fix read-only volumes with `volume.check.disk`. #7601 Lisandro Pin 2025-11-24 13:47:16 +0100
  • 2bf6e814f0 docs: complete debug session summary and findings chrislu 2025-11-24 01:30:09 -0800
  • 9eb71466d8 feat: implement flush-on-getPos() to ensure accurate offsets chrislu 2025-11-24 01:29:23 -0800
  • c1b0aa6611 feat: implement virtual position tracking in SeaweedOutputStream chrislu 2025-11-24 01:03:27 -0800
  • 2d6b571120 docs: comprehensive analysis of Parquet EOF root cause and fix strategies chrislu 2025-11-24 00:56:00 -0800
  • 3e754792a5 feat: add comprehensive debug logging to track Parquet write sequence chrislu 2025-11-24 00:55:21 -0800
  • 7d601191a5 docs: complete local reproduction analysis with detailed findings chrislu 2025-11-24 00:43:05 -0800
  • 852ca41928 docs: BREAKTHROUGH - found the bug in Spark local reproduction! chrislu 2025-11-24 00:42:10 -0800
  • 50a8a3eb11 docs: comprehensive test results showing unit tests PASS but Spark fails chrislu 2025-11-24 00:35:11 -0800
  • 80b463b7e4 test: add GetPosBufferTest to reproduce Parquet issue - ALL TESTS PASS! chrislu 2025-11-24 00:33:40 -0800
  • 4faa6d55f6 docs: comprehensive issue summary - getPos() buffer flush timing issue chrislu 2025-11-24 00:28:53 -0800
  • 8f33f5240d debug: confirmed root cause - Parquet tries to read 78 bytes past EOF chrislu 2025-11-24 00:28:07 -0800
  • 16b8cf3e52 debug: add logging to EOF return path - FOUND ROOT CAUSE! chrislu 2025-11-24 00:19:25 -0800
  • 216ae856ca docs: add comprehensive debugging analysis for EOF exception fix chrislu 2025-11-23 23:54:18 -0800
  • 5c30bc8e7b debug: add detailed getPos() tracking with caller stack trace chrislu 2025-11-23 23:53:33 -0800
  • e95f7061a4 fix: SeaweedInputStream returning 0 bytes for inline content reads chrislu 2025-11-23 23:35:39 -0800
  • c10ae054b6 debug: add logging to SeaweedInputStream constructor to track contentLength chrislu 2025-11-23 23:11:40 -0800
  • 9bb000e150 Update SeaweedOutputStream.java chrislu 2025-11-23 23:01:13 -0800
  • d7d4d97098 debug: verify JARs contain latest code before running tests chrislu 2025-11-23 23:00:55 -0800
  • 4936f733d1 debug: add WARN logging to SeaweedOutputStream base constructor chrislu 2025-11-23 22:54:21 -0800
  • c834e30a72 debug: add logging to SeaweedFileSystemStore.createFile() chrislu 2025-11-23 22:35:18 -0800
  • aed16ca9d7 fix: enable DEBUG logging for seaweed.hdfs package chrislu 2025-11-23 22:28:15 -0800
  • 6fe5c372ee debug: change logs to WARN level to ensure visibility chrislu 2025-11-23 22:27:29 -0800
  • c91175cb97 fix: make path variable final for anonymous inner class chrislu 2025-11-23 22:15:12 -0800
  • d6f9234cea debug: add aggressive logging to FSDataOutputStream getPos() override chrislu 2025-11-23 22:12:35 -0800
  • 9f4f324305
    Merge branch 'master' into add_error_list_each_entry_func tam-i13 2025-11-24 09:06:00 +0300
  • 58d4d61f89 docs: push instructions for Parquet EOF fix chrislu 2025-11-23 22:02:43 -0800
  • 90aa83dbe4 docs: add detailed analysis of Parquet EOF fix chrislu 2025-11-23 22:02:16 -0800
  • 9e7ed48688 fix: Override FSDataOutputStream.getPos() to use SeaweedOutputStream position chrislu 2025-11-23 22:01:29 -0800
  • a8491ecd3f Update SeaweedOutputStream.java chrislu 2025-11-23 21:42:54 -0800
  • 16bd118125 fix: don't split chunk ID on comma - comma is PART of the ID! chrislu 2025-11-23 21:42:26 -0800