ee0c14673d
Fix TTL Behavior for Directories in Path-Specific Configuration ( #6827 )
1 week ago
9ffc8bcb54
Further improve memory usage of `needle_map.CompactMap()`. ( #6825 )
1 week ago
283d9e0079
Add context with request ( #6824 )
1 week ago
62aaaa18f3
unlimit the list entries in completeMultipartUpload ( #6822 )
1 week ago
2786bea839
Unable to upload empty files to seaweed via. multipart when length is unknown ( #6729 )
1 week ago
6677f1f563
3.88
2 weeks ago
c1c09b60a1
Update README.md
2 weeks ago
aa5b927a18
chore(deps): bump golang.org/x/image from 0.24.0 to 0.27.0 ( #6817 )
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.24.0 to 0.27.0.
- [Commits](https://github.com/golang/image/compare/v0.24.0...v0.27.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-version: 0.27.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
2d77c15569
chore(deps): bump github.com/rclone/rclone from 1.69.1 to 1.69.3 ( #6816 )
2 weeks ago
dd5a24fb89
chore(deps): bump github.com/cognusion/imaging from 1.0.1 to 1.0.2 ( #6818 )
2 weeks ago
a907e71a96
chore(deps): bump google.golang.org/api from 0.232.0 to 0.234.0 ( #6819 )
2 weeks ago
27a392f706
Fix sftp performances and add seaweedfs all-in-one deployment ( #6792 )
* improve perfs & fix rclone & refactoring
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* improve perfs on download + add seaweedfs all-in-one deployment
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* use helper for topologySpreadConstraints and fix create home dir of sftp users
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* fix helm lint
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* add missing ctx param
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
---------
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
2 weeks ago
ea70d17c5f
Make fuse command linux/MacOS only ( #6811 )
2 weeks ago
2e1506c31e
Rewrite `needle_map.CompactMap()` for more efficient memory usage ( #6813 )
2 weeks ago
f1181f1121
Fix mysql tls enable ( #6807 )
2 weeks ago
f3d44b1eb6
Update fuse.go
Changed the signal from SIGUSR1 to SIGTERM. This should fix the compilation error since SIGTERM is available on all Unix-like systems including macOS. The functionality remains similar - it will still allow the master process to wait for a signal before exiting, just using a different signal type.
2 weeks ago
896096c41b
fix compilation on windows
2 weeks ago
25d6310307
fix error format
2 weeks ago
874b4a5535
Ensure `weed fuse` master process exits after mounted ( #6809 )
* Ensure fuse master process wait for mounted
* Validate parent PID input in fuse command
2 weeks ago
165af32d6b
added context to filer_client method calls ( #6808 )
Co-authored-by: akosov <a.kosov@kryptonite.ru>
2 weeks ago
5182d46e22
Added middleware for processing request_id grpc and http requests ( #6805 )
2 weeks ago
140b7a7402
chore(deps): bump docker/build-push-action from 6.16.0 to 6.17.0 ( #6796 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.16.0 to 6.17.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](14487ce63c
3 weeks ago
c25e455111
chore(deps): bump actions/dependency-review-action from 4.7.0 to 4.7.1 ( #6797 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.7.0 to 4.7.1.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](38ecb5b593
3 weeks ago
01306b66ba
chore(deps): bump github.com/tarantool/go-tarantool/v2 from 2.3.0 to 2.3.2 ( #6798 )
chore(deps): bump github.com/tarantool/go-tarantool/v2
Bumps [github.com/tarantool/go-tarantool/v2](https://github.com/tarantool/go-tarantool ) from 2.3.0 to 2.3.2.
- [Release notes](https://github.com/tarantool/go-tarantool/releases )
- [Changelog](https://github.com/tarantool/go-tarantool/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tarantool/go-tarantool/compare/v2.3.0...v2.3.2 )
---
updated-dependencies:
- dependency-name: github.com/tarantool/go-tarantool/v2
dependency-version: 2.3.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
31660aa8e8
chore(deps): bump github.com/aws/aws-sdk-go from 1.55.6 to 1.55.7 ( #6799 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.55.6 to 1.55.7.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG_PENDING.md )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.55.6...v1.55.7 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-version: 1.55.7
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
0cc965737b
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.18 to 3.6.0 ( #6800 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.5.18 to 3.6.0.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.5.18...v3.6.0 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-version: 3.6.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
6fd752445e
chore(deps): bump cloud.google.com/go/storage from 1.51.0 to 1.54.0 ( #6801 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.51.0 to 1.54.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.51.0...spanner/v1.54.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-version: 1.54.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
372547e332
Helm chart - volume statefulset - volumeClaimTemplates - add apiVersion and kind for better compatibility with argocd ( #6793 )
3 weeks ago
ff878a542d
correctly report volume with input/output error to master ( #6790 )
* correctly capture io error and report to master
* code fix
* check io error by error.Is
---------
Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
3 weeks ago
d8c574a5ef
fix fsync logic
3 weeks ago
0be020b0fa
Nit: unify the default `--maxParallelization` value for `weed shell` commands supporting this option ( #6788 )
3 weeks ago
ba1d82db90
Move `shell.ErrorWaitGroup` into a common file, to cleanly reuse across `weed shell` commands. ( #6780 )
Move `shell.ErrorWaitGroup` into a dedicated common file, to cleanly reuse across `weed shell` commands.
4 weeks ago
b0f7c33ce0
chore(deps): bump github.com/redis/go-redis/v9 from 9.7.3 to 9.8.0 ( #6781 )
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis ) from 9.7.3 to 9.8.0.
- [Release notes](https://github.com/redis/go-redis/releases )
- [Changelog](https://github.com/redis/go-redis/blob/master/CHANGELOG.md )
- [Commits](https://github.com/redis/go-redis/compare/v9.7.3...v9.8.0 )
---
updated-dependencies:
- dependency-name: github.com/redis/go-redis/v9
dependency-version: 9.8.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
c993a43a91
chore(deps): bump golang.org/x/tools from 0.31.0 to 0.33.0 ( #6782 )
Bumps [golang.org/x/tools](https://github.com/golang/tools ) from 0.31.0 to 0.33.0.
- [Release notes](https://github.com/golang/tools/releases )
- [Commits](https://github.com/golang/tools/compare/v0.31.0...v0.33.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/tools
dependency-version: 0.33.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
6eaa35040b
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.106.1 to 3.108.3 ( #6783 )
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk ) from 3.106.1 to 3.108.3.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases )
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.106.1...v3.108.3 )
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-version: 3.108.3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 weeks ago
8da3079d22
chore(deps): bump actions/dependency-review-action from 4.6.0 to 4.7.0 ( #6784 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.6.0 to 4.7.0.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](ce3cf9537a
4 weeks ago
45964c2f86
fix: ydb filer bugs ( #6778 )
* fix: ydb filer bugs
* fix(ydb): correct DeleteEntry log argument types
* fix(ydb): bucket creation & deletion logic
4 weeks ago
9c1048bacb
Add prefix listing in mongodb_store.go ( #6777 )
4 weeks ago
dddb0f0ae5
Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards are unmounted ( #6776 )
4 weeks ago
d8cc269294
feature: added ssl support for HCFS ( #6699 ) ( #6775 )
4 weeks ago
848d1f7c34
Improve safety for weed shell's `ec.encode`. ( #6773 )
Improve safety for weed shells `ec.encode`.
The current process for `ec.encode` is:
1. EC shards for a volume are generated and added to a single server
2. The original volume is deleted
3. EC shards get re-balanced across the entire topology
It is then possible to lose data between #2 and #3 , if the underlying volume storage/server/rack/DC
happens to fail, for whatever reason. As a fix, this MR reworks `ec.encode` so:
* Newly created EC shards are spread across all locations for the source volume.
* Source volumes are deleted only after EC shards are converted and balanced.
4 weeks ago
2ae5b480a6
Use the correct constant when computing the offset in SearchNeedleFromSortedIndex ( #6771 )
NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes)
Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
4 weeks ago
97dad06ed8
Improve parallelization for `ec.encode` ( #6769 )
Improve parallelization for `ec.encode`.
Instead of processing one volume at at time, perform all EC conversion
steps (mark readonly -> generate EC shards -> delete volume -> remount) in
parallel for all of them.
This should substantially improve performance when EC encoding
entire collections.
4 weeks ago
582206b7d2
load configuration before get max_file_name_length ( #6766 )
4 weeks ago
7522f11fd7
chore(deps): bump github.com/go-sql-driver/mysql from 1.9.1 to 1.9.2 ( #6720 )
Bumps [github.com/go-sql-driver/mysql](https://github.com/go-sql-driver/mysql ) from 1.9.1 to 1.9.2.
- [Release notes](https://github.com/go-sql-driver/mysql/releases )
- [Changelog](https://github.com/go-sql-driver/mysql/blob/master/CHANGELOG.md )
- [Commits](https://github.com/go-sql-driver/mysql/compare/v1.9.1...v1.9.2 )
---
updated-dependencies:
- dependency-name: github.com/go-sql-driver/mysql
dependency-version: 1.9.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
3c15c8ddad
fix: remove blocking match label ( #6760 )
matchLabels are immutable. Thus, matching against the version, which
changes with every release, blocks Helm upgrades. To resolve this, the
label is removed. See [1] where this was similarly done.
[1] https://github.com/seaweedfs/seaweedfs/pull/6090
1 month ago
93aed187e9
Add SFTP Server Support ( #6753 )
* Add SFTP Server Support
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* fix s3 tests and helm lint
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* increase helm chart version
* adjust version
---------
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 month ago
a2c5510ae1
Addendum to issue #6733 ( #6756 )
add s3.ip.bind command line parameter to filer
1 month ago
a2473af05a
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.29.13 to 1.29.14 ( #6757 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.29.13 to 1.29.14.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.29.13...config/v1.29.14 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-version: 1.29.14
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
51b0f9b7fd
chore(deps): bump github.com/prometheus/procfs from 0.16.0 to 0.16.1 ( #6758 )
Bumps [github.com/prometheus/procfs](https://github.com/prometheus/procfs ) from 0.16.0 to 0.16.1.
- [Release notes](https://github.com/prometheus/procfs/releases )
- [Commits](https://github.com/prometheus/procfs/compare/v0.16.0...v0.16.1 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/procfs
dependency-version: 0.16.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
FQHSLycopene
Lisandro Pin
Aleksey Kosov
Bruce Zou
royatwp
chrislu
Chris Lu
dependabot[bot]
Mohamed Sekour
Weihao Jiang
bwlfhu
Piotr Sawicki
dongxufeng
SmoothDenis
Kuzmin Anton
orthoxerox
Quentin D.
Manuel Leonhardt
ARibster