6063a889ed
3.73
3 months ago
dab0bb8097
Feature limit caching to prescribed number of bytes per file ( #6009 )
* feature: we can check if a fileId is already in the cache
We using this to protect cache from adding the same needle to
the cache over and over.
* fuse mount: Do not start dowloader if needle is already in the cache
* added maxFilePartSizeInCache property to ChunkCache
If file very large only first maxFilePartSizeInCache bytes
are going to be put to the cache (subject to the needle size
constrains).
* feature: for large files put in cache no more than prescribed number of bytes
Before this patch only the first needle of a large file was intended for
caching. This patch uses maximum prescribed amount of bytes to be put in
cache. This allows to bypass default 2MB maximum for a file part stored
in the cache.
* added dummy mock methods to satisfy interfaces of ChunkCache
3 months ago
151f2ff7a9
prevent dead loop for followers of master node ( #6007 )
* prevent dead loop for followers of master node
* fix comments
---------
Co-authored-by: levi <344887649@foxmail.com>
3 months ago
3b840c20e3
change math/rand => math/rand/v2 in volume_layout.go where is a perfo… ( #6006 )
3 months ago
c04edeed68
bug fix in the data received from cache processing ( #6002 )
The patch addresses #3745 .
The cache should return the exact amount of data requested by the buffer.
By construction of the cache it is always all requested data range
or we have error happening.
The old use of minsize miscalculate the requested data size,
if non zero offset is requested.
3 months ago
d660d5c7d4
increasing default cache size
3 months ago
f23015ac5b
weed mount caching
3 months ago
93decd1114
remove unused
3 months ago
69fcdd0840
adjust logging
3 months ago
34bbaa2cdd
[master] process grow request with must grow ( #5999 )
process grow request with must grow
3 months ago
15965f7c54
[shell] fix volume grow in shell ( #5992 )
* fix volume grow in shell
* revert add Async
* check available volume space
* create a VolumeGrowRequest and remove unnecessary fields
3 months ago
4af21b0dfc
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.27.30 to 1.27.33 ( #5996 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.27.30 to 1.27.33.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.27.30...config/v1.27.33 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
0c0666055b
[Helm chart] use `/healthz` as default route in readiness/liveness ( #5990 )
feat: #1627 use `/healthz` as default route in readinessProbe/livenessProbe of volume server
3 months ago
92b87cbfb6
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.58.3 to 1.61.2 ( #5994 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.58.3 to 1.61.2.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.58.3...service/s3/v1.61.2 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
5f22cba8f1
chore(deps): bump modernc.org/sqlite from 1.32.0 to 1.33.0 ( #5998 )
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite ) from 1.32.0 to 1.33.0.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.32.0...v1.33.0 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
5769f5ba79
chore(deps): bump github.com/prometheus/client_golang from 1.20.2 to 1.20.3 ( #5997 )
chore(deps): bump github.com/prometheus/client_golang
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) from 1.20.2 to 1.20.3.
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/v1.20.3/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.20.2...v1.20.3 )
---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
c0a078a5ac
chore(deps): bump golang.org/x/net from 0.28.0 to 0.29.0 ( #5995 )
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.28.0 to 0.29.0.
- [Commits](https://github.com/golang/net/compare/v0.28.0...v0.29.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 months ago
be338b37b4
Add release for OpenBSD ( #5993 )
3 months ago
43d9f68219
more consistent server header for s3 apis
3 months ago
d8e18a8eb7
bug fixed to filer store elastic deleteEntry ( #5988 )
3 months ago
ff3d46637d
better logging for volume growth
4 months ago
accba3070a
refactor
4 months ago
d6b0e0ff1c
Remove "Content-Length" header if http.Error is issued ( #5981 )
4 months ago
bc01f09e37
Do CRC check if the buffer contains the full needle data before it is sent ( #5980 )
4 months ago
f9e141a412
persist readonly state to volume info ( #5977 )
4 months ago
310d41998d
Skip volume data integrity check for volume which has remote file ( #5976 )
4 months ago
16984ef07a
[s3] reducing the number of metrics for 403 ( #5961 )
reducing the number of metrics
4 months ago
67a252ee8a
[master] refactor func ShouldGrowVolumes ( #5884 )
4 months ago
eb02946c97
support write once read many
fix https://github.com/seaweedfs/seaweedfs/issues/5954
4 months ago
18afdb15b6
Revert "weed mount, weed dav add option to force cache"
This reverts commit 7367b976b0
4 months ago
7367b976b0
weed mount, weed dav add option to force cache
4 months ago
66ac82bb8f
default cacheDirWrite to cacheDir
4 months ago
8d5a6d7e74
fix for spreading ec shards
4 months ago
8e4bffc66b
copy ec shards to disks already having ec volumes
fix https://github.com/seaweedfs/seaweedfs/issues/5615
4 months ago
3ca4069d86
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.76.6 to 3.77.1 ( #5963 )
4 months ago
0b333d41bc
chore(deps): bump github.com/hashicorp/raft from 1.7.0 to 1.7.1 ( #5964 )
4 months ago
3db8d3f649
chore(deps): bump google.golang.org/api from 0.194.0 to 0.195.0 ( #5965 )
4 months ago
aed2b1a505
chore(deps): bump cloud.google.com/go/pubsub from 1.41.0 to 1.42.0 ( #5966 )
4 months ago
946f04885c
chore(deps): bump gocloud.dev/pubsub/rabbitpubsub from 0.38.0 to 0.39.0 ( #5967 )
4 months ago
361e7ebc74
fix volume.move io.EOF ( #5960 )
4 months ago
282867a71e
Show volume server which failed to verify a chunk ( #5958 )
4 months ago
220061573d
update metric for ErrorCRC if it happens during volume readNeedleDataInto ( #5957 )
4 months ago
3c0854e986
unnecessary skipping
4 months ago
654b8210f7
parameter name
4 months ago
8679870008
fix typo
4 months ago
22d5d2ea96
adjust warning log
4 months ago
a4b25a642d
math/rand => math/rand/v2
4 months ago
ded5e084ea
ensure none zero lastGrowCount
4 months ago
0cf2c15828
rename
4 months ago
bebc385607
randomly pick one replica to write
4 months ago
chrislu
Eugeniy E. Mikhailov
dsd
Konstantin Lebedev
dependabot[bot]
wangtao
mrusme
zouyixiong
Bruce
wyang