chrislu
fe93b4f981
testing upload
2 weeks ago
chrislu
6b2851e4b9
clean up if fails
2 weeks ago
chrislu
2731db20bb
different IV for each chunk in SSE-S3 and SSE-KMS
2 weeks ago
chrislu
20bd7e9851
stop volume server in 1 second
2 weeks ago
chrislu
fd247817cf
stop volume server faster
2 weeks ago
chrislu
cbf4816f76
Update README.md
2 weeks ago
chrislu
30c82fe1c7
Handle ivSkip for non-block-aligned offsets
2 weeks ago
chrislu
7d5d6222ed
Update Makefile
2 weeks ago
chrislu
9b1fe3a001
Update s3_parquet_test.py
2 weeks ago
chrislu
29601543ff
Update Makefile
2 weeks ago
chrislu
d9cbc07b2a
clean up
2 weeks ago
chrislu
628b68e26c
Update s3_parquet_test.py
2 weeks ago
chrislu
f996d014a8
clean up if metadata operation failed
2 weeks ago
chrislu
46bb2cdec1
docs: Add placeholder documentation files for Parquet test suite
Added three missing documentation files referenced in test/s3/parquet/README.md:
1. TEST_COVERAGE.md - Documents 43 total test cases (17 Go unit tests,
6 Python integration tests, 20 Python end-to-end tests)
2. FINAL_ROOT_CAUSE_ANALYSIS.md - Explains the s3fs compatibility issue
with PyArrow, the implicit directory problem, and how the fix works
3. MINIO_DIRECTORY_HANDLING.md - Compares MinIO's directory handling
approach with SeaweedFS's implementation
Each file contains:
- Title and overview
- Key technical details relevant to the topic
- TODO sections for future expansion
These placeholder files resolve the broken README links and provide
structure for future detailed documentation.
2 weeks ago
chrislu
5de58dca20
address comments
2 weeks ago
chrislu
1b97c56738
add import
2 weeks ago
chrislu
adf5576646
fix: Clean up gRPC ports between tests to prevent port conflicts
The second test (test-implicit-dir-with-server) was failing because the
volume server's gRPC port (18080 = VOLUME_PORT + 10000) was still in use
from the first test. The cleanup code only killed HTTP port processes,
not gRPC port processes.
Added cleanup for gRPC ports in all stop targets:
- Master gRPC: MASTER_PORT + 10000 (19333)
- Volume gRPC: VOLUME_PORT + 10000 (18080)
- Filer gRPC: FILER_PORT + 10000 (18888)
This ensures clean state between test runs in CI.
2 weeks ago
chrislu
45d3331d06
store derived IV
2 weeks ago
chrislu
e4a882cc93
sse tests
2 weeks ago
chrislu
c4365d102a
fix: Wait for volume assignment readiness before running Parquet tests
The test-implicit-dir-with-server test was failing with an Internal Error
because volume assignment was not ready when tests started. This fix adds
a check that attempts a volume assignment and waits for it to succeed
before proceeding with tests.
This ensures that:
1. Volume servers are registered with the master
2. Volume growth is triggered if needed
3. The system can successfully assign volumes for writes
Fixes the timeout issue where boto3 would retry 4 times and fail with
'We encountered an internal error, please try again.'
2 weeks ago
chrislu
fcc74d18a2
https
2 weeks ago
chrislu
c85407d537
errors after writing header
2 weeks ago
chrislu
990778613b
handle errors
2 weeks ago
chrislu
410d578e19
According to S3 specifications, when both partNumber and Range are present, the Range should apply within the selected part's boundaries, not to the full object.
2 weeks ago
chrislu
9be15e83f7
Update requirements.txt
2 weeks ago
chrislu
d594869882
Update s3_parquet_test.py
2 weeks ago
chrislu
def705fd51
purge unused code
2 weeks ago
chrislu
513208c046
handle empty directory in S3, added PyArrow tests
2 weeks ago
chrislu
21e6b7c281
Fixed SSE-KMS Multipart ChunkReader HTTP Body Leak
2 weeks ago
chrislu
7a0d413a8d
Fixed SSERangeReader Infinite Loop Vulnerability
2 weeks ago
chrislu
0e94b4d36c
ErrNoEncryptionConfig
2 weeks ago
chrislu
2f6abd3814
large files
Reverted the plain-object range test
2 weeks ago
Chris Lu
d8222fa923
Merge branch 'master' into directly-read-write-volume-servers
2 weeks ago
chrislu
aef5121c36
faster master startup
2 weeks ago
chrislu
290b7a7898
large files
2 weeks ago
chrislu
fb09fafc36
SSE type
2 weeks ago
chrislu
74dec79a41
adjust logs
2 weeks ago
chrislu
f1fde6e1a8
Consolidate redundant nil entry checks in HeadObjectHandler
2 weeks ago
chrislu
18ffff8170
add range tests
2 weeks ago
chrislu
920678afb5
Consolidate nil entry checks in GetObjectHandler
2 weeks ago
chrislu
32450f8b90
constant
2 weeks ago
chrislu
abfb67ac74
Revert "handling directory"
This reverts commit 3a335f0ac3 .
2 weeks ago
chrislu
75bf7460c9
Optimized rejectDirectoryObjectWithoutSlash() to avoid unnecessary lookups
2 weeks ago
chrislu
298b36f5fd
handling directory
2 weeks ago
Feng Shao
0299e78de7
de/compress the fs meta file if filename ends with gz/gzip ( #7500 )
* de/compress the fs meta file if filename ends with gz/gzip
* gemini code review
* update help msg
2 weeks ago
Dima Tisnek
156ce42f26
chore: fix the diagram in RDMA sidecar readme ( #7503 )
3 weeks ago
dependabot[bot]
cae62db31b
chore(deps): bump golang.org/x/image from 0.32.0 to 0.33.0 ( #7497 )
* chore(deps): bump golang.org/x/image from 0.32.0 to 0.33.0
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.32.0 to 0.33.0.
- [Commits](https://github.com/golang/image/compare/v0.32.0...v0.33.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-version: 0.33.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
3 weeks ago
dependabot[bot]
93dd5d49c4
chore(deps): bump actions/dependency-review-action from 4.8.1 to 4.8.2 ( #7493 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.8.1 to 4.8.2.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](40c09b7dc9 ...3c4e3dcb1aa7874d2c16be7d79418e9b7efd6261)
---
updated-dependencies:
- dependency-name: actions/dependency-review-action
dependency-version: 4.8.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
dependabot[bot]
e9353d58a2
chore(deps): bump github.com/linxGnu/grocksdb from 1.10.2 to 1.10.3 ( #7494 )
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.10.2 to 1.10.3.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.10.2...v1.10.3 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-version: 1.10.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
dependabot[bot]
71970418b0
chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.8.0 to 2.9.0 ( #7495 )
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse ) from 2.8.0 to 2.9.0.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.8.0...v2.9.0 )
---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
dependency-version: 2.9.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago