3e60439d0d
Merge branch 'master' into add_error_list_each_entry_func
2 months ago
e503375bb7
fix return
2 months ago
5895aa3d16
fix log
2 months ago
8455c7ec7b
fix
2 months ago
9ebc27270c
fix return eachEntryFunc
2 months ago
156ce42f26
chore: fix the diagram in RDMA sidecar readme ( #7503 )
2 months ago
cae62db31b
chore(deps): bump golang.org/x/image from 0.32.0 to 0.33.0 ( #7497 )
* chore(deps): bump golang.org/x/image from 0.32.0 to 0.33.0
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.32.0 to 0.33.0.
- [Commits](https://github.com/golang/image/compare/v0.32.0...v0.33.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-version: 0.33.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
2 months ago
46052c61de
add ctx to logs, error handling
2 months ago
19d1371880
more info in error
2 months ago
eae8c0f979
clear err when the scanner stops on io.EOF, so returning err doesn’t surface EOF as a failure.
2 months ago
6f2db5a731
Merge branch 'master' into add_error_list_each_entry_func
2 months ago
93dd5d49c4
chore(deps): bump actions/dependency-review-action from 4.8.1 to 4.8.2 ( #7493 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.8.1 to 4.8.2.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](40c09b7dc9
2 months ago
e9353d58a2
chore(deps): bump github.com/linxGnu/grocksdb from 1.10.2 to 1.10.3 ( #7494 )
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.10.2 to 1.10.3.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.10.2...v1.10.3 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-version: 1.10.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 months ago
71970418b0
chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.8.0 to 2.9.0 ( #7495 )
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse ) from 2.8.0 to 2.9.0.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.8.0...v2.9.0 )
---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
dependency-version: 2.9.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 months ago
2d54322a89
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.6.5 to 3.6.6 ( #7496 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.6.5 to 3.6.6.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.6.5...v3.6.6 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-version: 3.6.6
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 months ago
d280d1b285
chore(deps): bump github.com/getsentry/sentry-go from 0.36.1 to 0.38.0 ( #7498 )
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.36.1 to 0.38.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.36.1...v0.38.0 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-version: 0.38.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 months ago
65f8986fe2
Volume Server: avoid aggressive volume assignment ( #7501 )
* avoid aggressive volume assignment
* also test ec shards
* separate DiskLocation instances for each subtest
* edge cases
* No volumes plus low disk space
* Multiple EC volumes
* simplify
2 months ago
c1053b82df
Merge branch 'master' into add_error_list_each_entry_func
2 months ago
cf0248b918
add log
2 months ago
e044cc2a4f
fix error
2 months ago
4101d34010
add callbackErr in ListDirectoryEntries
2 months ago
01cce31f12
added entry in messege error
2 months ago
6f98a83265
use %w fmt.Errorf
2 months ago
fa8df6e42b
S3: Lazy Versioning Check, Conditional SSE Entry Fetch, HEAD Request Optimization ( #7480 )
* Lazy Versioning Check, Conditional SSE Entry Fetch, HEAD Request Optimization
* revert
Reverted the conditional versioning check to always check versioning status
Reverted the conditional SSE entry fetch to always fetch entry metadata
Reverted the conditional versioning check to always check versioning status
Reverted the conditional SSE entry fetch to always fetch entry metadata
* Lazy Entry Fetch for SSE, Skip Conditional Header Check
* SSE-KMS headers are present, this is not an SSE-C request (mutually exclusive)
* SSE-C is mutually exclusive with SSE-S3 and SSE-KMS
* refactor
* Removed Premature Mutual Exclusivity Check
* check for the presence of the X-Amz-Server-Side-Encryption header
* not used
* fmt
2 months ago
52f7d29742
Merge branch 'master' into add_error_list_each_entry_func
2 months ago
73aa7fd88a
fix return errClose
2 months ago
932ad2af3c
fix fmt.Errorf
2 months ago
e18d5693e5
return error if errClose
2 months ago
f87fc65017
added error return in type ListEachEntryFunc
2 months ago
e154bfe163
minor
2 months ago
4477edbcc4
fix: pass proxied query param ( #7477 )
* fix: pass proxied query param
* fix: use math/rand/v2
* Shuffle condition
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
2 months ago
0e69f7c916
Split logic for `volume.check.disk` into writable and read-only volume replicas. ( #7476 )
2 months ago
4e73cc778c
S3: add context aware action resolution ( #7479 )
* add context aware action resolution
* isAnonymous
* add s3 action resolver
* refactor
* correct action name
* no need for action copy object
* Simplify by removing the method-action mismatch path
* use PUT instead of DELETE action
* refactor
* constants
* versionId vs versions
* address comments
* comment
* adjust messages
* ResolveS3Action
* address comments
* refactor
* simplify
* more checks
* not needed
* simplify
2 months ago
5b9a526310
adjust comment
2 months ago
2a9d4d1e23
Refactor data structure ( #7472 )
* refactor to avoids circular dependency
* converts a policy.PolicyDocument to policy_engine.PolicyDocument
* convert numeric types to strings
* Update weed/s3api/policy_conversion.go
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
* refactoring
* not skipping numeric and boolean values in arrays
* avoid nil
* edge cases
* handling conversion failure
The handling of unsupported types in convertToString could lead to silent policy alterations.
The conversion of map-based principals in convertPrincipal is too generic and could misinterpret policies.
* concise
* fix doc
* adjust warning
* recursion
* return errors
* reject empty principals
* better error message
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2 months ago
508d06d9a5
S3: Enforce bucket policy ( #7471 )
* evaluate policies during authorization
* cache bucket policy
* refactor
* matching with regex special characters
* Case Sensitivity, pattern cache, Dead Code Removal
* Fixed Typo, Restored []string Case, Added Cache Size Limit
* hook up with policy engine
* remove old implementation
* action mapping
* validate
* if not specified, fall through to IAM checks
* fmt
* Fail-close on policy evaluation errors
* Explicit `Allow` bypasses IAM checks
* fix error message
* arn:seaweed => arn:aws
* remove legacy support
* fix tests
* Clean up bucket policy after this test
* fix for tests
* address comments
* security fixes
* fix tests
* temp comment out
2 months ago
50f067bcfd
backup: handle volume not found when backing up ( #7465 )
* handle volume not found when backing up
* error handling on reading volume ttl and replication
* fix Inconsistent error handling: should continue to next location.
* adjust messages
* close volume
* refactor
* refactor
* proper v.Close()
2 months ago
79fa87bad4
Rework parameters passing for functions within `ec.rebuild` ( #7445 )
* Rework parameters passing for functions within `ec.rebuild`
This simplifies the overall codebase and allows to cleanly handle parallelization via waitgroups.
* fix copy source
* add tests
* remove tests not useful
* fmt
* nil check
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
2 months ago
bf8e4f40e6
S3: Perf related ( #7463 )
* reduce checks
* s3 object lookup optimization
* Only check versioning configuration if client requests
* Consolidate SSE Entry Lookups
* optimize
* revert optimization for versioned objects
* Removed: getObjectEntryForSSE() function
* refactor
* Refactoring: Added fetchObjectEntryRequired
* avoid refetching
* return early if not found
* reuse objects from conditional check
* clear cache when creating bucket
2 months ago
6201cd099e
fix help messages
2 months ago
9744382a18
Rework parameters passing for functions within `volume.check.disk`. ( #7448 )
* Rework parameters passing for functions within `volume.check.disk`.
We'll need to rework this logic to account for read-only volumes, and there're already way too many parameters shuffled around.
Grouping these into a single struct simplifies the overall codebase.
* similar fix
* Improved Error Handling in Tests
* propagate the errors
* edge cases
* edge case on modified time
* clean up
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
2 months ago
d8dd3e4c53
chore(deps): bump golang.org/x/sys from 0.37.0 to 0.38.0 ( #7459 )
* chore(deps): bump golang.org/x/sys from 0.37.0 to 0.38.0
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.37.0 to 0.38.0.
- [Commits](https://github.com/golang/sys/compare/v0.37.0...v0.38.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-version: 0.38.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
3 months ago
735516cf0a
chore(deps): bump github.com/shirou/gopsutil/v4 from 4.25.9 to 4.25.10 ( #7457 )
* chore(deps): bump github.com/shirou/gopsutil/v4 from 4.25.9 to 4.25.10
Bumps [github.com/shirou/gopsutil/v4](https://github.com/shirou/gopsutil ) from 4.25.9 to 4.25.10.
- [Release notes](https://github.com/shirou/gopsutil/releases )
- [Commits](https://github.com/shirou/gopsutil/compare/v4.25.9...v4.25.10 )
---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v4
dependency-version: 4.25.10
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* go mod tidy
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
3 months ago
ca8e7739be
chore(deps): bump helm/chart-testing-action from 2.7.0 to 2.8.0 ( #7454 )
Bumps [helm/chart-testing-action](https://github.com/helm/chart-testing-action ) from 2.7.0 to 2.8.0.
- [Release notes](https://github.com/helm/chart-testing-action/releases )
- [Commits](https://github.com/helm/chart-testing-action/compare/v2.7.0...v2.8.0 )
---
updated-dependencies:
- dependency-name: helm/chart-testing-action
dependency-version: 2.8.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
6b82a7cadc
chore(deps): bump docker/metadata-action from 5.8.0 to 5.9.0 ( #7456 )
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 5.8.0 to 5.9.0.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Commits](c1e51972af
3 months ago
d6a77b639a
chore(deps): bump docker/setup-qemu-action from 3.6.0 to 3.7.0 ( #7455 )
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 3.6.0 to 3.7.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](29109295f8
3 months ago
d37396b420
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azcore from 1.19.1 to 1.20.0 ( #7458 )
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/azcore
Bumps [github.com/Azure/azure-sdk-for-go/sdk/azcore](https://github.com/Azure/azure-sdk-for-go ) from 1.19.1 to 1.20.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.19.1...sdk/azcore/v1.20.0 )
---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azcore
dependency-version: 1.20.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
c93bf8b29d
chore(deps): bump github.com/hashicorp/vault/api from 1.20.0 to 1.22.0 ( #7461 )
Bumps [github.com/hashicorp/vault/api](https://github.com/hashicorp/vault ) from 1.20.0 to 1.22.0.
- [Release notes](https://github.com/hashicorp/vault/releases )
- [Changelog](https://github.com/hashicorp/vault/blob/main/CHANGELOG.md )
- [Commits](https://github.com/hashicorp/vault/compare/v1.20.0...api/v1.22.0 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/vault/api
dependency-version: 1.22.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
4a34a2290f
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/storage/azblob from 1.6.2 to 1.6.3 ( #7460 )
chore(deps): bump github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
Bumps [github.com/Azure/azure-sdk-for-go/sdk/storage/azblob](https://github.com/Azure/azure-sdk-for-go ) from 1.6.2 to 1.6.3.
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/storage/azblob/v1.6.2...sdk/storage/azblob/v1.6.3 )
---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
dependency-version: 1.6.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
76e4a51964
Unify the parameter to disable dry-run on weed shell commands to `-apply` (instead of `-force`). ( #7450 )
* Unify the parameter to disable dry-run on weed shell commands to --apply (instead of --force).
* lint
* refactor
* Execution Order Corrected
* handle deprecated force flag
* fix help messages
* Refactoring]: Using flag.FlagSet.Visit()
* consistent with other commands
* Checks for both flags
* fix toml files
---------
Co-authored-by: chrislu <chris.lu@gmail.com>
3 months ago
tam-i13
Roman Tamarov
Dima Tisnek
dependabot[bot]
chrislu
Chris Lu
Konstantin Lebedev
Lisandro Pin