c4695fc3b3
refactor needle write for different versions
3 days ago
bed0a64693
New `needle_map.CompactMap()` implementation for reduced memory usage ( #6842 )
* Rework `needle_map.CompactMap()` to maximize memory efficiency.
* Use a memory-efficient structure for `CompactMap` needle value entries.
This slightly complicates the code, but makes a **massive** difference
in memory efficiency - preliminary results show a ~30% reduction in
heap usage, with no measurable performance impact otherwise.
* Clean up type for `CompactMap` chunk IDs.
* Add a small comment description for `CompactMap()`.
* Add the old version of `CompactMap()` for comparison purposes.
4 days ago
d8ddc22fc2
update to latest hanwen/go-fuse/v2
https://github.com/seaweedfs/seaweedfs/issues/6645#issuecomment-2933832235
fix https://github.com/seaweedfs/seaweedfs/issues/6645
4 days ago
35f0daa198
the isFsync parameter is essentially IsAsyncWrite and it needs to be turned off if s.isStopping
d8c574a5ef (r159132764)
4 days ago
2f3de5e199
fix build
6 days ago
bd4891a117
change version directory
6 days ago
7039d5003c
gorocksdb 1.10.1 ~ rocksdb 10.2.1
6 days ago
7151a54b28
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
7 days ago
b25561d0d7
3.89
7 days ago
9994617dad
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.78.2 to 1.80.0 ( #6830 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.78.2 to 1.80.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.78.2...service/s3/v1.80.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-version: 1.80.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
7 days ago
7265a9c3b7
chore(deps): bump modernc.org/sqlite from 1.37.0 to 1.37.1 ( #6831 )
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.37.0 to 1.37.1.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.37.0...v1.37.1 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-version: 1.37.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
7 days ago
4217f0dcaf
chore(deps): bump github.com/prometheus/client_golang from 1.21.1 to 1.22.0 ( #6832 )
chore(deps): bump github.com/prometheus/client_golang
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.21.1 to 1.22.0.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.21.1...v1.22.0 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-version: 1.22.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
7 days ago
aeb3bcdfc1
chore(deps): bump docker/build-push-action from 6.17.0 to 6.18.0 ( #6834 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.17.0 to 6.18.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](1dc7386353
7 days ago
2c494751e5
chore(deps): bump github.com/fluent/fluent-logger-golang from 1.9.0 to 1.10.0 ( #6833 )
chore(deps): bump github.com/fluent/fluent-logger-golang
Bumps [github.com/fluent/fluent-logger-golang](https://github.com/fluent/fluent-logger-golang ) from 1.9.0 to 1.10.0.
- [Changelog](https://github.com/fluent/fluent-logger-golang/blob/master/CHANGELOG.md )
- [Commits](https://github.com/fluent/fluent-logger-golang/compare/v1.9.0...v1.10.0 )
---
updated-dependencies:
- dependency-name: github.com/fluent/fluent-logger-golang
dependency-version: 1.10.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
7 days ago
d40746f34e
fix insert beyond look back window ( #6838 )
7 days ago
7204731749
Minor fix for the `CompactMap()` performance test. ( #6836 )
Per-entry memory usage is based on `TotalAllocs`, which is incorrect - that
value is a cummulative of heap usage, which doesn't decrease when objects
are freeed.
`Allocs` is instead an accurate represeentation of actual memory usage
at the time metrics are reported.
7 days ago
5e354a18a3
Update filer upsert sqlstring for postgresql ( #6835 )
1 week ago
90802cb201
revert part of d8c574a5ef ( #6829 )
1 week ago
ee0c14673d
Fix TTL Behavior for Directories in Path-Specific Configuration ( #6827 )
2 weeks ago
9ffc8bcb54
Further improve memory usage of `needle_map.CompactMap()`. ( #6825 )
2 weeks ago
283d9e0079
Add context with request ( #6824 )
2 weeks ago
62aaaa18f3
unlimit the list entries in completeMultipartUpload ( #6822 )
2 weeks ago
2786bea839
Unable to upload empty files to seaweed via. multipart when length is unknown ( #6729 )
2 weeks ago
6677f1f563
3.88
2 weeks ago
c1c09b60a1
Update README.md
2 weeks ago
aa5b927a18
chore(deps): bump golang.org/x/image from 0.24.0 to 0.27.0 ( #6817 )
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.24.0 to 0.27.0.
- [Commits](https://github.com/golang/image/compare/v0.24.0...v0.27.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-version: 0.27.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 weeks ago
2d77c15569
chore(deps): bump github.com/rclone/rclone from 1.69.1 to 1.69.3 ( #6816 )
2 weeks ago
dd5a24fb89
chore(deps): bump github.com/cognusion/imaging from 1.0.1 to 1.0.2 ( #6818 )
2 weeks ago
a907e71a96
chore(deps): bump google.golang.org/api from 0.232.0 to 0.234.0 ( #6819 )
2 weeks ago
27a392f706
Fix sftp performances and add seaweedfs all-in-one deployment ( #6792 )
* improve perfs & fix rclone & refactoring
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* improve perfs on download + add seaweedfs all-in-one deployment
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* use helper for topologySpreadConstraints and fix create home dir of sftp users
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* fix helm lint
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* add missing ctx param
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
---------
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
2 weeks ago
ea70d17c5f
Make fuse command linux/MacOS only ( #6811 )
2 weeks ago
2e1506c31e
Rewrite `needle_map.CompactMap()` for more efficient memory usage ( #6813 )
2 weeks ago
f1181f1121
Fix mysql tls enable ( #6807 )
3 weeks ago
f3d44b1eb6
Update fuse.go
Changed the signal from SIGUSR1 to SIGTERM. This should fix the compilation error since SIGTERM is available on all Unix-like systems including macOS. The functionality remains similar - it will still allow the master process to wait for a signal before exiting, just using a different signal type.
3 weeks ago
896096c41b
fix compilation on windows
3 weeks ago
25d6310307
fix error format
3 weeks ago
874b4a5535
Ensure `weed fuse` master process exits after mounted ( #6809 )
* Ensure fuse master process wait for mounted
* Validate parent PID input in fuse command
3 weeks ago
165af32d6b
added context to filer_client method calls ( #6808 )
Co-authored-by: akosov <a.kosov@kryptonite.ru>
3 weeks ago
5182d46e22
Added middleware for processing request_id grpc and http requests ( #6805 )
3 weeks ago
140b7a7402
chore(deps): bump docker/build-push-action from 6.16.0 to 6.17.0 ( #6796 )
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 6.16.0 to 6.17.0.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](14487ce63c
3 weeks ago
c25e455111
chore(deps): bump actions/dependency-review-action from 4.7.0 to 4.7.1 ( #6797 )
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action ) from 4.7.0 to 4.7.1.
- [Release notes](https://github.com/actions/dependency-review-action/releases )
- [Commits](38ecb5b593
3 weeks ago
01306b66ba
chore(deps): bump github.com/tarantool/go-tarantool/v2 from 2.3.0 to 2.3.2 ( #6798 )
chore(deps): bump github.com/tarantool/go-tarantool/v2
Bumps [github.com/tarantool/go-tarantool/v2](https://github.com/tarantool/go-tarantool ) from 2.3.0 to 2.3.2.
- [Release notes](https://github.com/tarantool/go-tarantool/releases )
- [Changelog](https://github.com/tarantool/go-tarantool/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tarantool/go-tarantool/compare/v2.3.0...v2.3.2 )
---
updated-dependencies:
- dependency-name: github.com/tarantool/go-tarantool/v2
dependency-version: 2.3.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
31660aa8e8
chore(deps): bump github.com/aws/aws-sdk-go from 1.55.6 to 1.55.7 ( #6799 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.55.6 to 1.55.7.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG_PENDING.md )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.55.6...v1.55.7 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-version: 1.55.7
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
0cc965737b
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.18 to 3.6.0 ( #6800 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.5.18 to 3.6.0.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.5.18...v3.6.0 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-version: 3.6.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
6fd752445e
chore(deps): bump cloud.google.com/go/storage from 1.51.0 to 1.54.0 ( #6801 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.51.0 to 1.54.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.51.0...spanner/v1.54.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-version: 1.54.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
372547e332
Helm chart - volume statefulset - volumeClaimTemplates - add apiVersion and kind for better compatibility with argocd ( #6793 )
3 weeks ago
ff878a542d
correctly report volume with input/output error to master ( #6790 )
* correctly capture io error and report to master
* code fix
* check io error by error.Is
---------
Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
4 weeks ago
d8c574a5ef
fix fsync logic
4 weeks ago
0be020b0fa
Nit: unify the default `--maxParallelization` value for `weed shell` commands supporting this option ( #6788 )
4 weeks ago
ba1d82db90
Move `shell.ErrorWaitGroup` into a common file, to cleanly reuse across `weed shell` commands. ( #6780 )
Move `shell.ErrorWaitGroup` into a dedicated common file, to cleanly reuse across `weed shell` commands.
4 weeks ago
chrislu
Lisandro Pin
dependabot[bot]
Chris Lu
Luna Yao
FQHSLycopene
Aleksey Kosov
Bruce Zou
royatwp
Mohamed Sekour
Weihao Jiang
bwlfhu
Piotr Sawicki
dongxufeng