1549ee2e15
implement PubObjectRetention and WORM ( #6969 )
* implement PubObjectRetention and WORM
* Update s3_worm_integration_test.go
* avoid previous buckets
* Update s3-versioning-tests.yml
* address comments
* address comments
* rename to ExtObjectLockModeKey
* only checkObjectLockPermissions if versioningEnabled
* address comments
* comments
* Revert "comments"
This reverts commit 6736434176
2 weeks ago
d892538d32
More efficient copy object ( #6665 )
* it compiles
* refactored
* reduce to 4 concurrent chunk upload
* CopyObjectPartHandler
* copy a range of the chunk data, fix offset size in copied chunks
* Update s3api_object_handlers_copy.go
What the PR Accomplishes:
CopyObjectHandler - Now copies entire objects by copying chunks individually instead of downloading/uploading the entire file
CopyObjectPartHandler - Handles copying parts of objects for multipart uploads by copying only the relevant chunk portions
Efficient Chunk Copying - Uses direct chunk-to-chunk copying with proper volume assignment and concurrent processing (limited to 4 concurrent operations)
Range Support - Properly handles range-based copying for partial object copies
* fix compilation
* fix part destination
* handling small objects
* use mkFile
* copy to existing file or part
* add testing tools
* adjust tests
* fix chunk lookup
* refactoring
* fix TestObjectCopyRetainingMetadata
* ensure bucket name not conflicting
* fix conditional copying tests
* remove debug messages
* add custom s3 copy tests
2 weeks ago
a9e1f00673
Fix drift for security config ( #6967 )
2 weeks ago
cf5a24983a
S3: add object versioning ( #6945 )
* add object versioning
* add missing file
* Update weed/s3api/s3api_object_versioning.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update weed/s3api/s3api_object_versioning.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update weed/s3api/s3api_object_versioning.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* ListObjectVersionsResult is better to show multiple version entries
* fix test
* Update weed/s3api/s3api_object_handlers_put.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update weed/s3api/s3api_object_versioning.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* multiple improvements
* move PutBucketVersioningHandler into weed/s3api/s3api_bucket_handlers.go file
* duplicated code for reading bucket config, versioningEnabled, etc. try to use functions
* opportunity to cache bucket config
* error handling if bucket is not found
* in case bucket is not found
* fix build
* add object versioning tests
* remove non-existent tests
* add tests
* add versioning tests
* skip a new test
* ensure .versions directory exists before saving info into it
* fix creating version entry
* logging on creating version directory
* Update s3api_object_versioning_test.go
* retry and wait for directory creation
* revert add more logging
* Update s3api_object_versioning.go
* more debug messages
* clean up logs, and touch directory correctly
* log the .versions creation and then parent directory listing
* use mkFile instead of touch
touch is for update
* clean up data
* add versioning test in go
* change location
* if modified, latest version is moved to .versions directory, and create a new latest version
Core versioning functionality: WORKING
TestVersioningBasicWorkflow - PASS
TestVersioningDeleteMarkers - PASS
TestVersioningMultipleVersionsSameObject - PASS
TestVersioningDeleteAndRecreate - PASS
TestVersioningListWithPagination - PASS
❌ Some advanced features still failing:
ETag calculation issues (using mtime instead of proper MD5)
Specific version retrieval (EOF error)
Version deletion (internal errors)
Concurrent operations (race conditions)
* calculate multi chunk md5
Test Results - All Passing:
✅ TestBucketListReturnDataVersioning - PASS
✅ TestVersioningCreateObjectsInOrder - PASS
✅ TestVersioningBasicWorkflow - PASS
✅ TestVersioningMultipleVersionsSameObject - PASS
✅ TestVersioningDeleteMarkers - PASS
* dedupe
* fix TestVersioningErrorCases
* fix eof error of reading old versions
* get specific version also check current version
* enable integration tests for versioning
* trigger action to work for now
* Fix GitHub Actions S3 versioning tests workflow
- Fix syntax error (incorrect indentation)
- Update directory paths from weed/s3api/versioning_tests/ to test/s3/versioning/
- Add push trigger for add-object-versioning branch to enable CI during development
- Update artifact paths to match correct directory structure
* Improve CI robustness for S3 versioning tests
Makefile improvements:
- Increase server startup timeout from 30s to 90s for CI environments
- Add progressive timeout reporting (logs at 30s, full logs at 90s)
- Better error handling with server logs on failure
- Add server PID tracking for debugging
- Improved test failure reporting
GitHub Actions workflow improvements:
- Increase job timeouts to account for CI environment delays
- Add system information logging (memory, disk space)
- Add detailed failure reporting with server logs
- Add process and network diagnostics on failure
- Better error messaging and log collection
These changes should resolve the 'Server failed to start within 30 seconds' issue
that was causing the CI tests to fail.
* adjust testing volume size
* Update Makefile
* Update Makefile
* Update Makefile
* Update Makefile
* Update s3-versioning-tests.yml
* Update s3api_object_versioning.go
* Update Makefile
* do not clean up
* log received version id
* more logs
* printout response
* print out list version response
* use tmp files when put versioned object
* change to versions folder layout
* Delete weed-test.log
* test with mixed versioned and unversioned objects
* remove versionDirCache
* remove unused functions
* remove unused function
* remove fallback checking
* minor
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2 weeks ago
80697c17ad
chore(deps): bump actions/setup-go from 4.2.1 to 5.5.0 ( #6948 )
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 4.2.1 to 5.5.0.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](https://github.com/actions/setup-go/compare/v4.2.1...v5.5.0 )
---
updated-dependencies:
- dependency-name: actions/setup-go
dependency-version: 5.5.0
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
ec4ef30483
chore(deps): bump actions/setup-go from 4 to 5 ( #6931 )
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 4 to 5.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](https://github.com/actions/setup-go/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: actions/setup-go
dependency-version: '5'
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
adc7807451
update deploying
4 weeks ago
52097a1d9b
fix binary location
4 weeks ago
4cd6c3ec36
copy telemetry server
4 weeks ago
a1aab8a083
add telemetry ( #6926 )
* add telemetry
* fix go mod
* add default telemetry server url
* Update README.md
* replace with broker count instead of s3 count
* Update telemetry.pb.go
* github action to deploy
4 weeks ago
a5bb5e04da
chore(deps): bump docker/setup-buildx-action from 3.11.0 to 3.11.1 ( #6910 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.11.0 to 3.11.1.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](18ce135bb5
1 month ago
13103c32d8
chore(deps): bump docker/setup-buildx-action from 3.10.0 to 3.11.0 ( #6873 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.10.0 to 3.11.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](b5ca514318
1 month ago
bd4891a117
change version directory
2 months ago
aeb3bcdfc1
chore(deps): bump docker/build-push-action from 6.17.0 to 6.18.0 ( #6834 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.17.0 to 6.18.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](1dc7386353
2 months ago
140b7a7402
chore(deps): bump docker/build-push-action from 6.16.0 to 6.17.0 ( #6796 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.16.0 to 6.17.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](14487ce63c
2 months ago
c25e455111
chore(deps): bump actions/dependency-review-action from 4.7.0 to 4.7.1 ( #6797 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.7.0 to 4.7.1.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](38ecb5b593
2 months ago
8da3079d22
chore(deps): bump actions/dependency-review-action from 4.6.0 to 4.7.0 ( #6784 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.6.0 to 4.7.0.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](ce3cf9537a
2 months ago
5aff086aa4
chore(deps): bump actions/dependency-review-action from 4.3.2 to 4.6.0 ( #6759 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.3.2 to 4.6.0.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](0c155c5e85
3 months ago
f14de131b3
chore(deps): bump docker/build-push-action from 6.15.0 to 6.16.0 ( #6743 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.15.0 to 6.16.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](471d1dc4e0
3 months ago
71382d3279
bump depdency-review-action 4.3.0 -> 4.3.2 ( #6732 )
3 months ago
affacb1b67
[s3] add tests for s3 over https using aws-cli ( #6731 )
* [s3] add tests for s3 over https using aws-cli
* fix typo
3 months ago
ba3afd1803
Tarantool filer store ( #6669 )
Co-authored-by: Marat Karimov <m.karimov@digitalms.ru>
4 months ago
5ab04e1baf
chore(deps): bump docker/login-action from 3.3.0 to 3.4.0 ( #6643 )
Bumps [docker/login-action](https://github.com/docker/login-action ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/docker/login-action/releases )
- [Commits](9780b0c442
4 months ago
d3221099bf
chore(deps): bump docker/setup-buildx-action from 3.9.0 to 3.10.0 ( #6587 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.9.0 to 3.10.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](f7ce87c1d6
5 months ago
0e79bbaf36
chore(deps): bump docker/build-push-action from 6.14.0 to 6.15.0 ( #6588 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.14.0 to 6.15.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](0adf995921
5 months ago
fb41d03a11
chore(deps): bump docker/metadata-action from 5.6.1 to 5.7.0 ( #6589 )
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 5.6.1 to 5.7.0.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](369eb591f4
5 months ago
2adafe366d
chore(deps): bump docker/setup-qemu-action from 3.4.0 to 3.6.0 ( #6590 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.4.0 to 3.6.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](4574d27a47
5 months ago
e4c946229a
chore(deps): bump docker/build-push-action from 6.13.0 to 6.14.0 ( #6575 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.13.0 to 6.14.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](ca877d9245
5 months ago
b4fd5f71c0
chore(deps): bump docker/setup-buildx-action from 3.8.0 to 3.9.0 ( #6533 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.8.0 to 3.9.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](6524bf65af
5 months ago
e369fe5c72
chore(deps): bump docker/setup-qemu-action from 3.3.0 to 3.4.0 ( #6532 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](53851d1459
5 months ago
5058879eff
chore(deps): bump docker/build-push-action from 6.12.0 to 6.13.0 ( #6481 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.12.0 to 6.13.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](67a2d409c0
6 months ago
8a78c4efa3
chore(deps): bump helm/kind-action from 1.11.0 to 1.12.0 ( #6460 )
Bumps [helm/kind-action](https://github.com/helm/kind-action ) from 1.11.0 to 1.12.0.
- [Release notes](https://github.com/helm/kind-action/releases )
- [Commits](https://github.com/helm/kind-action/compare/v1.11.0...v1.12.0 )
---
updated-dependencies:
- dependency-name: helm/kind-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
6 months ago
8a922eb518
chore(deps): bump docker/setup-qemu-action from 3.2.0 to 3.3.0 ( #6459 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](49b3bc8e6b
6 months ago
56876ac654
chore(deps): bump docker/build-push-action from 6.10.0 to 6.12.0 ( #6458 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.10.0 to 6.12.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](48aba3b46d
6 months ago
f7950a9baa
chore(deps): bump helm/chart-testing-action from 2.6.1 to 2.7.0 ( #6457 )
Bumps [helm/chart-testing-action](https://github.com/helm/chart-testing-action ) from 2.6.1 to 2.7.0.
- [Release notes](https://github.com/helm/chart-testing-action/releases )
- [Commits](https://github.com/helm/chart-testing-action/compare/v2.6.1...v2.7.0 )
---
updated-dependencies:
- dependency-name: helm/chart-testing-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
6 months ago
b2f26804a0
chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 ( #6369 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.7.1 to 3.8.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](c47758b77c
7 months ago
93da4fe4d5
chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 ( #6368 )
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action ) from 1.52 to 1.53.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases )
- [Commits](2aa2977ad6
7 months ago
fa2d28c998
chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 ( #6367 )
Bumps [helm/kind-action](https://github.com/helm/kind-action ) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/helm/kind-action/releases )
- [Commits](https://github.com/helm/kind-action/compare/v1.10.0...v1.11.0 )
---
updated-dependencies:
- dependency-name: helm/kind-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
7 months ago
67461ccd27
chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 ( #6333 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.9.0 to 6.10.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](4f58ea7922
8 months ago
11042ddb71
chore(deps): bump docker/metadata-action from 5.5.1 to 5.6.1 ( #6281 )
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 5.5.1 to 5.6.1.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](8e5442c4ef
8 months ago
6c7824c813
consistent sorted tags elastic,gocdk,rclone,sqlite,tikv,ydb
9 months ago
559cfc1fe0
chore(deps): bump docker/setup-buildx-action from 3.6.1 to 3.7.1 ( #6103 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.6.1 to 3.7.1.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](988b5a0280
10 months ago
13501cacd1
chore(deps): bump wangyoucao577/go-release-action from 1.51 to 1.52 ( #6102 )
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action ) from 1.51 to 1.52.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases )
- [Commits](6ac7dba1f9
10 months ago
53ea035aea
chore(deps): bump docker/build-push-action from 6.7.0 to 6.9.0 ( #6079 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.7.0 to 6.9.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](5cd11c3a4c
10 months ago
be338b37b4
Add release for OpenBSD ( #5993 )
11 months ago
7f6b487566
chore(deps): bump docker/build-push-action from 6.6.1 to 6.7.0 ( #5917 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.6.1 to 6.7.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](16ebe778df
11 months ago
2405dadf78
chore(deps): bump docker/build-push-action from 6.5.0 to 6.6.1 ( #5885 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.5.0 to 6.6.1.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](5176d81f87
12 months ago
8a1052cc5e
chore(deps): bump docker/setup-buildx-action from 3.6.0 to 3.6.1 ( #5856 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.6.0 to 3.6.1.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](3d68780484
12 months ago
ddd2ec21d0
chore(deps): bump docker/setup-buildx-action from 3.5.0 to 3.6.0 ( #5825 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.5.0 to 3.6.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](aa33708b10
1 year ago
1c32ac133b
chore(deps): bump docker/setup-buildx-action from 3.4.0 to 3.5.0 ( #5803 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.4.0 to 3.5.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](4fd812986e
1 year ago
Chris Lu
Andrei Kvapil
dependabot[bot]
chrislu
Taehyung Lim
MaratKarimov
mrusme