a371ac7337
Merge branch 'master' into feature/suport_dameng_as_filer_store
3 months ago
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com>
3 months ago
f45fec6940
support dameng as filer store
3 months ago
d056c0ddf2
fix(volume): don't persist RO state in specific cases ( #6058 )
* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist
3 months ago
c96b2ce8e5
chore(deps): bump cloud.google.com/go/pubsub from 1.42.0 to 1.43.0 ( #6053 )
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go ) from 1.42.0 to 1.43.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.42.0...pubsub/v1.43.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
028ebb1d0d
Feat:merge small chunk ( #6049 )
* fix:mount deadlock
* feat: merge small chunk
* adjust MergeChunkMinCount
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
3 months ago
4c1e23ad00
chore(deps): bump golang.org/x/tools from 0.24.0 to 0.25.0 ( #6054 )
Bumps [golang.org/x/tools](https://github.com/golang/tools ) from 0.24.0 to 0.25.0.
- [Release notes](https://github.com/golang/tools/releases )
- [Commits](https://github.com/golang/tools/compare/v0.24.0...v0.25.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/tools
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
a3fc985c90
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.30.5 to 1.31.0 ( #6052 )
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2 ) from 1.30.5 to 1.31.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.30.5...v1.31.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
dd40875871
chore(deps): bump google.golang.org/api from 0.195.0 to 0.198.0 ( #6051 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.195.0 to 0.198.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.195.0...v0.198.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
341b5b6edf
chore(deps): bump github.com/klauspost/reedsolomon from 1.12.3 to 1.12.4 ( #6050 )
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon ) from 1.12.3 to 1.12.4.
- [Release notes](https://github.com/klauspost/reedsolomon/releases )
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.12.3...v1.12.4 )
---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
4ec6eab004
fix max volume count auto setting
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
3 months ago
a3572999bb
Vol check disk bug ( #6044 )
* fix volume.check.disk
* ensure multiple replica sync
* add comment
---------
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
3 months ago
6d4f5c94ac
[volume] remove truncate idx file if size not healthy ( #6043 )
3 months ago
50e22864cf
refactor
3 months ago
17b9ce89ee
Bump chart version ( #6033 )
* Update Chart.yaml
* Update k8s/charts/seaweedfs/Chart.yaml
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 months ago
99ae99e3b9
fix nil filer conf
fix https://github.com/seaweedfs/seaweedfs/issues/6034
3 months ago
2b13d2c083
[filer] fix return 204 for DELETE on entry not found ( #6023 )
fix return 204 for DELETE on entry not found
3 months ago
6c986e9d70
improve worm support ( #5983 )
* improve worm support
Signed-off-by: lou <alex1988@outlook.com>
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com>
* remove flag
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* typo
Signed-off-by: lou <alex1988@outlook.com>
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
3 months ago
e73ab5c0c4
chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.15 to 3.5.16 ( #6027 )
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd ) from 3.5.15 to 3.5.16.
- [Release notes](https://github.com/etcd-io/etcd/releases )
- [Commits](https://github.com/etcd-io/etcd/compare/v3.5.15...v3.5.16 )
---
updated-dependencies:
- dependency-name: go.etcd.io/etcd/client/v3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
2606b0a246
chore(deps): bump github.com/linxGnu/grocksdb from 1.9.2 to 1.9.3 ( #6025 )
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb ) from 1.9.2 to 1.9.3.
- [Release notes](https://github.com/linxGnu/grocksdb/releases )
- [Commits](https://github.com/linxGnu/grocksdb/compare/v1.9.2...v1.9.3 )
---
updated-dependencies:
- dependency-name: github.com/linxGnu/grocksdb
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
d10503aa20
chore(deps): bump github.com/getsentry/sentry-go from 0.28.1 to 0.29.0 ( #6026 )
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.28.1 to 0.29.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.28.1...v0.29.0 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
a667da0d1a
chore(deps): bump github.com/rclone/rclone from 1.67.0 to 1.68.0 ( #6028 )
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.67.0 to 1.68.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.67.0...v1.68.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
283e976252
chore(deps): bump google.golang.org/grpc from 1.65.0 to 1.66.2 ( #6029 )
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.65.0 to 1.66.2.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.65.0...v1.66.2 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
367e7638d7
fix invalid file read ( #6024 )
3 months ago
0da9e40abb
Feature: compress before encryption ( #6013 )
3 months ago
5428229347
fix file read crash ( #6021 )
3 months ago
881c9a009e
[master] master missing start LoopPushingMetric routine fixed. ( #6018 )
3 months ago
7340c62c47
changing FindEntry error handling in cassandra store ( #6015 )
3 months ago
4f2bdebe49
helm chart: add s3 and s3-tls ports where missing ( #6016 )
3 months ago
a9c9e1bcb3
refactor
3 months ago
6063a889ed
3.73
3 months ago
dab0bb8097
Feature limit caching to prescribed number of bytes per file ( #6009 )
* feature: we can check if a fileId is already in the cache
We using this to protect cache from adding the same needle to
the cache over and over.
* fuse mount: Do not start dowloader if needle is already in the cache
* added maxFilePartSizeInCache property to ChunkCache
If file very large only first maxFilePartSizeInCache bytes
are going to be put to the cache (subject to the needle size
constrains).
* feature: for large files put in cache no more than prescribed number of bytes
Before this patch only the first needle of a large file was intended for
caching. This patch uses maximum prescribed amount of bytes to be put in
cache. This allows to bypass default 2MB maximum for a file part stored
in the cache.
* added dummy mock methods to satisfy interfaces of ChunkCache
3 months ago
151f2ff7a9
prevent dead loop for followers of master node ( #6007 )
* prevent dead loop for followers of master node
* fix comments
---------
Co-authored-by: levi <344887649@foxmail.com>
3 months ago
3b840c20e3
change math/rand => math/rand/v2 in volume_layout.go where is a perfo… ( #6006 )
3 months ago
c04edeed68
bug fix in the data received from cache processing ( #6002 )
The patch addresses #3745 .
The cache should return the exact amount of data requested by the buffer.
By construction of the cache it is always all requested data range
or we have error happening.
The old use of minsize miscalculate the requested data size,
if non zero offset is requested.
3 months ago
d660d5c7d4
increasing default cache size
3 months ago
f23015ac5b
weed mount caching
3 months ago
93decd1114
remove unused
3 months ago
69fcdd0840
adjust logging
3 months ago
34bbaa2cdd
[master] process grow request with must grow ( #5999 )
process grow request with must grow
3 months ago
15965f7c54
[shell] fix volume grow in shell ( #5992 )
* fix volume grow in shell
* revert add Async
* check available volume space
* create a VolumeGrowRequest and remove unnecessary fields
3 months ago
4af21b0dfc
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.27.30 to 1.27.33 ( #5996 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.27.30 to 1.27.33.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.27.30...config/v1.27.33 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
0c0666055b
[Helm chart] use `/healthz` as default route in readiness/liveness ( #5990 )
feat: #1627 use `/healthz` as default route in readinessProbe/livenessProbe of volume server
4 months ago
92b87cbfb6
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.58.3 to 1.61.2 ( #5994 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.58.3 to 1.61.2.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.58.3...service/s3/v1.61.2 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
5f22cba8f1
chore(deps): bump modernc.org/sqlite from 1.32.0 to 1.33.0 ( #5998 )
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.32.0 to 1.33.0.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.32.0...v1.33.0 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
5769f5ba79
chore(deps): bump github.com/prometheus/client_golang from 1.20.2 to 1.20.3 ( #5997 )
chore(deps): bump github.com/prometheus/client_golang
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.20.2 to 1.20.3.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/v1.20.3/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.20.2...v1.20.3 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
c0a078a5ac
chore(deps): bump golang.org/x/net from 0.28.0 to 0.29.0 ( #5995 )
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.28.0 to 0.29.0.
- [Commits](https://github.com/golang/net/compare/v0.28.0...v0.29.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
be338b37b4
Add release for OpenBSD ( #5993 )
4 months ago
43d9f68219
more consistent server header for s3 apis
4 months ago
d8e18a8eb7
bug fixed to filer store elastic deleteEntry ( #5988 )
4 months ago
Vegetable540
LHHDZ
Max Denushev
dependabot[bot]
zemul
chrislu
dsd
Konstantin Lebedev
Federico A. Corazza
Guang Jiong Lou
Eugeniy E. Mikhailov
Bruce
zouyixiong
Aleksey Kosov
Erwan de Lépinau
wangtao
mrusme