chrislu
e6de9535cd
adjust log level
3 weeks ago
chrislu
1851f70aef
debug
3 weeks ago
chrislu
c8853b327b
headers
3 weeks ago
chrislu
6d0cc81791
test_multipart_get_part
3 weeks ago
chrislu
5432666863
url encoding
3 weeks ago
chrislu
010b9b502a
profiling
3 weeks ago
chrislu
9a71ffda9d
Missing PartsCount Header
3 weeks ago
chrislu
f2319f1134
debug logs
3 weeks ago
chrislu
b01b7a2aec
fixed the suffix range bug (bytes=-N for "last N bytes")
3 weeks ago
chrislu
a82dc8c844
sse continue
3 weeks ago
chrislu
4b4dc6d10b
implement sse
3 weeks ago
chrislu
615de0dbf2
fmt
3 weeks ago
chrislu
eae129e818
fix sse
3 weeks ago
chrislu
ba6e797dd1
copy object
3 weeks ago
chrislu
a6250d46e7
md5
3 weeks ago
chrislu
ecd30076fc
set header
3 weeks ago
chrislu
9a67f2917c
HTTP Range Request Support
3 weeks ago
chrislu
7ef058d89a
directly read write volume servers
3 weeks ago
chrislu
a2d9a2db84
fmt
3 weeks ago
chrislu
0209f645e6
not used
3 weeks ago
chrislu
8f64c9ccb8
check for the presence of the X-Amz-Server-Side-Encryption header
3 weeks ago
chrislu
684b9d2f60
Removed Premature Mutual Exclusivity Check
3 weeks ago
chrislu
d94ff29be2
refactor
3 weeks ago
chrislu
8425fc0fe7
SSE-C is mutually exclusive with SSE-S3 and SSE-KMS
3 weeks ago
chrislu
2182d2224e
SSE-KMS headers are present, this is not an SSE-C request (mutually exclusive)
3 weeks ago
chrislu
0ab4d7720b
Lazy Entry Fetch for SSE, Skip Conditional Header Check
3 weeks ago
chrislu
ec2986b9ee
revert
Reverted the conditional versioning check to always check versioning status
Reverted the conditional SSE entry fetch to always fetch entry metadata
Reverted the conditional versioning check to always check versioning status
Reverted the conditional SSE entry fetch to always fetch entry metadata
3 weeks ago
chrislu
e2d14befc0
Lazy Versioning Check, Conditional SSE Entry Fetch, HEAD Request Optimization
3 weeks ago
chrislu
e154bfe163
minor
3 weeks ago
Konstantin Lebedev
4477edbcc4
fix: pass proxied query param ( #7477 )
* fix: pass proxied query param
* fix: use math/rand/v2
* Shuffle condition
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
3 weeks ago
Lisandro Pin
0e69f7c916
Split logic for `volume.check.disk` into writable and read-only volume replicas. ( #7476 )
3 weeks ago
Chris Lu
4e73cc778c
S3: add context aware action resolution ( #7479 )
* add context aware action resolution
* isAnonymous
* add s3 action resolver
* refactor
* correct action name
* no need for action copy object
* Simplify by removing the method-action mismatch path
* use PUT instead of DELETE action
* refactor
* constants
* versionId vs versions
* address comments
* comment
* adjust messages
* ResolveS3Action
* address comments
* refactor
* simplify
* more checks
* not needed
* simplify
3 weeks ago
chrislu
5b9a526310
adjust comment
3 weeks ago
Chris Lu
2a9d4d1e23
Refactor data structure ( #7472 )
* refactor to avoids circular dependency
* converts a policy.PolicyDocument to policy_engine.PolicyDocument
* convert numeric types to strings
* Update weed/s3api/policy_conversion.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
* refactoring
* not skipping numeric and boolean values in arrays
* avoid nil
* edge cases
* handling conversion failure
The handling of unsupported types in convertToString could lead to silent policy alterations.
The conversion of map-based principals in convertPrincipal is too generic and could misinterpret policies.
* concise
* fix doc
* adjust warning
* recursion
* return errors
* reject empty principals
* better error message
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
3 weeks ago
Chris Lu
508d06d9a5
S3: Enforce bucket policy ( #7471 )
* evaluate policies during authorization
* cache bucket policy
* refactor
* matching with regex special characters
* Case Sensitivity, pattern cache, Dead Code Removal
* Fixed Typo, Restored []string Case, Added Cache Size Limit
* hook up with policy engine
* remove old implementation
* action mapping
* validate
* if not specified, fall through to IAM checks
* fmt
* Fail-close on policy evaluation errors
* Explicit `Allow` bypasses IAM checks
* fix error message
* arn:seaweed => arn:aws
* remove legacy support
* fix tests
* Clean up bucket policy after this test
* fix for tests
* address comments
* security fixes
* fix tests
* temp comment out
3 weeks ago
Chris Lu
50f067bcfd
backup: handle volume not found when backing up ( #7465 )
* handle volume not found when backing up
* error handling on reading volume ttl and replication
* fix Inconsistent error handling: should continue to next location.
* adjust messages
* close volume
* refactor
* refactor
* proper v.Close()
4 weeks ago
Lisandro Pin
79fa87bad4
Rework parameters passing for functions within `ec.rebuild` ( #7445 )
* Rework parameters passing for functions within `ec.rebuild`
This simplifies the overall codebase and allows to cleanly handle parallelization via waitgroups.
* fix copy source
* add tests
* remove tests not useful
* fmt
* nil check
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
4 weeks ago
Chris Lu
bf8e4f40e6
S3: Perf related ( #7463 )
* reduce checks
* s3 object lookup optimization
* Only check versioning configuration if client requests
* Consolidate SSE Entry Lookups
* optimize
* revert optimization for versioned objects
* Removed: getObjectEntryForSSE() function
* refactor
* Refactoring: Added fetchObjectEntryRequired
* avoid refetching
* return early if not found
* reuse objects from conditional check
* clear cache when creating bucket
4 weeks ago
chrislu
6201cd099e
fix help messages
4 weeks ago
Lisandro Pin
9744382a18
Rework parameters passing for functions within `volume.check.disk`. ( #7448 )
* Rework parameters passing for functions within `volume.check.disk`.
We'll need to rework this logic to account for read-only volumes, and there're already way too many parameters shuffled around.
Grouping these into a single struct simplifies the overall codebase.
* similar fix
* Improved Error Handling in Tests
* propagate the errors
* edge cases
* edge case on modified time
* clean up
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
4 weeks ago
dependabot[bot]
d8dd3e4c53
chore(deps): bump golang.org/x/sys from 0.37.0 to 0.38.0 ( #7459 )
* chore(deps): bump golang.org/x/sys from 0.37.0 to 0.38.0
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.37.0 to 0.38.0.
- [Commits](https://github.com/golang/sys/compare/v0.37.0...v0.38.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-version: 0.38.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
4 weeks ago
dependabot[bot]
735516cf0a
chore(deps): bump github.com/shirou/gopsutil/v4 from 4.25.9 to 4.25.10 ( #7457 )
* chore(deps): bump github.com/shirou/gopsutil/v4 from 4.25.9 to 4.25.10
Bumps [github.com/shirou/gopsutil/v4](https://github.com/shirou/gopsutil ) from 4.25.9 to 4.25.10.
- [Release notes](https://github.com/shirou/gopsutil/releases )
- [Commits](https://github.com/shirou/gopsutil/compare/v4.25.9...v4.25.10 )
---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v4
dependency-version: 4.25.10
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
4 weeks ago
dependabot[bot]
ca8e7739be
chore(deps): bump helm/chart-testing-action from 2.7.0 to 2.8.0 ( #7454 )
Bumps [helm/chart-testing-action](https://github.com/helm/chart-testing-action ) from 2.7.0 to 2.8.0.
- [Release notes](https://github.com/helm/chart-testing-action/releases )
- [Commits](https://github.com/helm/chart-testing-action/compare/v2.7.0...v2.8.0 )
---
updated-dependencies:
- dependency-name: helm/chart-testing-action
dependency-version: 2.8.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
dependabot[bot]
6b82a7cadc
chore(deps): bump docker/metadata-action from 5.8.0 to 5.9.0 ( #7456 )
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 5.8.0 to 5.9.0.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](c1e51972af ...318604b99e75e41977312d83839a89be02ca4893)
---
updated-dependencies:
- dependency-name: docker/metadata-action
dependency-version: 5.9.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
dependabot[bot]
d6a77b639a
chore(deps): bump docker/setup-qemu-action from 3.6.0 to 3.7.0 ( #7455 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.6.0 to 3.7.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](29109295f8 ...c7c53464625b32c7a7e944ae62b3e17d2b600130)
---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
dependency-version: 3.7.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
dependabot[bot]
d37396b420
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azcore from 1.19.1 to 1.20.0 ( #7458 )
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azcore
Bumps [github.com/Azure/azure-sdk-for-go/sdk/azcore](https://github.com/Azure/azure-sdk-for-go ) from 1.19.1 to 1.20.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.19.1...sdk/azcore/v1.20.0 )
---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azcore
dependency-version: 1.20.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
dependabot[bot]
c93bf8b29d
chore(deps): bump github.com/hashicorp/vault/api from 1.20.0 to 1.22.0 ( #7461 )
Bumps [github.com/hashicorp/vault/api](https://github.com/hashicorp/vault ) from 1.20.0 to 1.22.0.
- [Release notes](https://github.com/hashicorp/vault/releases )
- [Changelog](https://github.com/hashicorp/vault/blob/main/CHANGELOG.md )
- [Commits](https://github.com/hashicorp/vault/compare/v1.20.0...api/v1.22.0 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/vault/api
dependency-version: 1.22.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
dependabot[bot]
4a34a2290f
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/storage/azblob from 1.6.2 to 1.6.3 ( #7460 )
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
Bumps [github.com/Azure/azure-sdk-for-go/sdk/storage/azblob](https://github.com/Azure/azure-sdk-for-go ) from 1.6.2 to 1.6.3.
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/storage/azblob/v1.6.2...sdk/storage/azblob/v1.6.3 )
---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
dependency-version: 1.6.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
Lisandro Pin
76e4a51964
Unify the parameter to disable dry-run on weed shell commands to `-apply` (instead of `-force`). ( #7450 )
* Unify the parameter to disable dry-run on weed shell commands to --apply (instead of --force).
* lint
* refactor
* Execution Order Corrected
* handle deprecated force flag
* fix help messages
* Refactoring]: Using flag.FlagSet.Visit()
* consistent with other commands
* Checks for both flags
* fix toml files
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
4 weeks ago
Chris Lu
2a05af2e14
docker: fix /data ownership and permission ( #7451 )
* docker: fix /data ownership and permission
* chown if not owned by seaweed user
* fix github tests
* comments
* fix the unquoted variables in the case pattern matching
* Update docker/entrypoint.sh
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
* Update docker/entrypoint.sh
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
* Update entrypoint.sh
* Update entrypoint.sh
* Update docker/entrypoint.sh
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
4 weeks ago