4c85da7844
Include meta in ReadAllNeedles ( #3991 )
This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice.
2 years ago
70a4c98b00
refactor filer_pb.Entry and filer.Entry to use GetChunks()
for later locking on reading chunks
2 years ago
371972a1c2
build(deps): bump golang.org/x/tools from 0.2.0 to 0.3.0 ( #3981 )
2 years ago
6464d9e920
build(deps): bump github.com/aws/aws-sdk-go from 1.44.126 to 1.44.136 ( #3982 )
2 years ago
024f63f669
build(deps): bump google.golang.org/api from 0.102.0 to 0.103.0 ( #3980 )
2 years ago
99e325b994
build(deps): bump cloud.google.com/go/storage from 1.27.0 to 1.28.0 ( #3979 )
2 years ago
8ff29ab30d
build(deps): bump golang.org/x/net from 0.1.0 to 0.2.0 ( #3978 )
2 years ago
957f15238c
build(deps): bump actions/dependency-review-action from 2.5.1 to 3.0.0 ( #3977 )
2 years ago
b1d7963e57
3.35
2 years ago
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
d90aa31d5f
filer store: skip disabled location specific filer store initialization
fix https://github.com/seaweedfs/seaweedfs/issues/3971
2 years ago
7ac40ae3d4
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2 years ago
aae82dca6f
file name escape uri
fix https://github.com/seaweedfs/seaweedfs/issues/3969
2 years ago
39f0246deb
fix 'NoSuchUpload' when upload part ( #3968 )
2 years ago
df0662038c
feat:add a uuid after uploadid ( #3963 )
2 years ago
180853a2c9
Replace dashes with underscores in x-amz-meta headers ( #3965 )
2 years ago
2009719b89
build(deps): bump cloud.google.com/go/pubsub from 1.25.1 to 1.26.0 ( #3956 )
2 years ago
ccb3bef1c2
build(deps): bump github.com/tikv/client-go/v2 from 2.0.1 to 2.0.2 ( #3955 )
2 years ago
9c61545338
build(deps): bump modernc.org/sqlite from 1.19.3 to 1.19.4 ( #3957 )
2 years ago
513a120e02
build(deps): bump go.mongodb.org/mongo-driver from 1.10.3 to 1.11.0 ( #3954 )
2 years ago
ac43c2d4ac
build(deps): bump github.com/spf13/viper from 1.13.0 to 1.14.0 ( #3953 )
2 years ago
47db75a695
3.34
2 years ago
5431c445cd
fix filer.remote.sync to azure with ContentType ( #3949 )
* fix filer.remote.sync to azure with ContentType
* fix pass X-Amz-Meta to X-Ms-Meta
2 years ago
167077fae0
fix(sec): upgrade io.springfox:springfox-swagger-ui to 2.10.0 ( #3947 )
2 years ago
cec55feeb0
[filer.backup] add retention_duration ( #3941 )
2 years ago
4193dafce1
azure metadata: skip metadata prefixed with "X-"
fix https://github.com/seaweedfs/seaweedfs/issues/3875
2 years ago
abe4a61659
Bug fix: empty key in DeleteMultipleObjects request caused bucket delete ( #3939 )
2 years ago
54d815fa04
build(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.38.5 to 3.39.0 ( #3929 )
build(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk ) from 3.38.5 to 3.39.0.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases )
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.38.5...v3.39.0 )
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
0999f9b7ff
[volume.fsck] collect ids without cut off time for finding missing data from volumes ( #3934 )
collect all file ids from the file without cut off time for finding missing data from volumes
2 years ago
a322ba042e
[volume.fsck] param volumeId is comma separated the volume id ( #3933 )
volume.fsck param volumeId is comma separated the volume id
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
4a48332248
refactor error contains already deleted ( #3932 )
2 years ago
975be5ea6f
build(deps): bump modernc.org/sqlite from 1.19.2 to 1.19.3 ( #3931 )
---
updated-dependencies:
- dependency-name: modernc.org/sqlite
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
f26de64901
build(deps): bump github.com/google/flatbuffers from 22.9.29+incompatible to 22.10.26+incompatible ( #3930 )
build(deps): bump github.com/google/flatbuffers
Bumps [github.com/google/flatbuffers](https://github.com/google/flatbuffers ) from 22.9.29+incompatible to 22.10.26+incompatible.
- [Release notes](https://github.com/google/flatbuffers/releases )
- [Changelog](https://github.com/google/flatbuffers/blob/master/CHANGELOG.md )
- [Commits](https://github.com/google/flatbuffers/compare/v22.9.29...v22.10.26 )
---
updated-dependencies:
- dependency-name: github.com/google/flatbuffers
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
e26925cb41
build(deps): bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.126 ( #3928 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.44.121 to 1.44.126.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.121...v1.44.126 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
bd2810dcee
build(deps): bump google.golang.org/api from 0.100.0 to 0.101.0 ( #3927 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.100.0 to 0.101.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.100.0...v0.101.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
c0deaa4948
[volume.fsck] check needles status from volume server ( #3926 )
check needles status from volume server
2 years ago
bd459db5fb
Revert "put v in front of appVersion that is used as image tag ( #3925 )"
This reverts commit ee7bf69c03
2 years ago
ee7bf69c03
put v in front of appVersion that is used as image tag ( #3925 )
2 years ago
0f360862bf
3.33
2 years ago
409c9328de
[master] avoid vacuum if not enough replica copies ( #3924 )
avoid vacuum if not enough replica copies
2 years ago
bf8a9d2db1
[volume.chek.disk] sync of deletions the fix ( #3923 )
* sync of deletions the fix
* avoid return if only partiallyDeletedNeedles
* refactor sync deletions
2 years ago
8b9957d461
add back "/" prefix if it is missing in object
fix https://github.com/seaweedfs/seaweedfs/issues/3737
2 years ago
0d9f2f9e7a
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2 years ago
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
764d9cb105
[voluche.chek.disk] needles older than the cutoff time are not missing yet ( #3922 )
needles older than the cutoff time are not missing yet
https://github.com/seaweedfs/seaweedfs/issues/3919
2 years ago
f9f499b8d5
[fix] add param for ignore error ( #3918 )
2 years ago
1e0d64c048
master: delete partially created replicated volumes during volume growth
fix https://github.com/seaweedfs/seaweedfs/discussions/3792#discussioncomment-3973120
2 years ago
e90ad660ff
fix volume statefulset helm chart's tolerations ( #3911 )
2 years ago
c6f2899375
avoid fix missing of deleted needles ( #3909 )
2 years ago
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
James Hartig
chrislu
dependabot[bot]
Guo Lei
LHHDZ
famosss
aronneagu
Konstantin Lebedev
645775992
zemul
pavelzhurov
Cristian Chiru
Matt Ward
Eric Yang