7836f7574e
[volume.fsck] hotfix apply purging and add option verifyNeedle #3860 ( #3861 )
* fix apply purging and add verifyNeedle
* common readSourceNeedleBlob
* use consts
3 years ago
f476cf3403
fix volume_server.proto conflict ( #3858 )
fix conflict
https://github.com/seaweedfs/seaweedfs/pull/3841
3 years ago
5c2eb602c9
Revert "mount: remove mount directory from generating cache directory id"
This reverts commit 109dc7fdf6
3 years ago
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
3 years ago
f19c9e3d9d
Volume fsck by volume ( #3851 )
* refactor
* refactor args verbose and writer
* refactor readFilerFileIdFile
* fix filter by collectMtime
* skip system log collection
3 years ago
9c8678ded9
ensure monotonic n.AppendAtNs
fix https://github.com/seaweedfs/seaweedfs/issues/3852
3 years ago
e05637c42c
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
3 years ago
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
3 years ago
a5b867af69
don't skip empty value at `AssembleEntryWithAcp` ( #3855 )
* add acl helper functionalities
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* add tests
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* remove 0 when create map
Signed-off-by: changlin.shi <changlin.shi@ly.com>
* delete when empty at `AssembleEntryWithAcp`
`PutBucketAcl/PutObjectAcl` allow request with empty grants, `AssembleEntryWithAcp` shouldn't skip empty value
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
3 years ago
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
3 years ago
f5d4952d73
filer: redis store reduce from 2 redis operations to 1 for updates.
3 years ago
f95c25e113
types packages is imported more than onece ( #3838 )
3 years ago
9a339a9cfb
default hasSlowRead to true
3 years ago
cacc3e883b
volume server:set the default value of "hasSlowRead" to true ( #3710 )
* simplify a bit
* feat: volume: add "readBufSize" option to customize read optimization
* refactor : redbufSIze -> readBufferSize
* simplify a bit
* simplify a bit
* volume server:set the default value of "hasSlowRead" to true
3 years ago
bf5e45b66a
add acl helper functionalities ( #3831 )
3 years ago
401315f337
master fix interruption through ctrl+c ( #3834 )
3 years ago
a05725aea6
filer: get directory metadata ( #3833 )
3 years ago
e55076c46f
cloud tier: add retry when copying data file
fix https://github.com/seaweedfs/seaweedfs/issues/3828
3 years ago
cea73ac008
serialize sqlite operations
fix https://github.com/seaweedfs/seaweedfs/issues/3827
3 years ago
dff85e9c71
fix error handling
3 years ago
8aec786a6d
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
3 years ago
0d817bc347
fix invalid memory address or nil pointer dereference on filer.sync
fix https://github.com/seaweedfs/seaweedfs/issues/3826
3 years ago
84c401e693
Optimiz leveldb metric ( #3830 )
* optimiz updating mapmetric for leveldb
* import loading leveldb
* add comments
3 years ago
d21e2f523d
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unn… ( #3824 )
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unnecessary `json.Unmarshal()` call
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
3 years ago
c34f04b35b
fix bug : read error when position after 2147483647 ( #3829 )
Co-authored-by: huang.lin <hh@chaintool.ai>
3 years ago
f6c8720ded
build(deps): bump google.golang.org/grpc from 1.49.0 to 1.50.0 ( #3819 )
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.49.0 to 1.50.0.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.49.0...v1.50.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
50ed9456ff
build(deps): bump github.com/hashicorp/raft from 1.3.10 to 1.3.11 ( #3821 )
Bumps [github.com/hashicorp/raft](https://github.com/hashicorp/raft ) from 1.3.10 to 1.3.11.
- [Release notes](https://github.com/hashicorp/raft/releases )
- [Changelog](https://github.com/hashicorp/raft/blob/main/CHANGELOG.md )
- [Commits](https://github.com/hashicorp/raft/compare/v1.3.10...v1.3.11 )
---
updated-dependencies:
- dependency-name: github.com/hashicorp/raft
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
0aa947913a
build(deps): bump github.com/arangodb/go-driver from 1.3.3 to 1.4.0 ( #3823 )
Bumps [github.com/arangodb/go-driver](https://github.com/arangodb/go-driver ) from 1.3.3 to 1.4.0.
- [Release notes](https://github.com/arangodb/go-driver/releases )
- [Changelog](https://github.com/arangodb/go-driver/blob/master/CHANGELOG.md )
- [Commits](https://github.com/arangodb/go-driver/compare/v1.3.3...v1.4.0 )
---
updated-dependencies:
- dependency-name: github.com/arangodb/go-driver
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
358d9fb109
build(deps): bump github.com/armon/go-metrics from 0.3.10 to 0.4.1 ( #3822 )
Bumps [github.com/armon/go-metrics](https://github.com/armon/go-metrics ) from 0.3.10 to 0.4.1.
- [Release notes](https://github.com/armon/go-metrics/releases )
- [Commits](https://github.com/armon/go-metrics/compare/v0.3.10...v0.4.1 )
---
updated-dependencies:
- dependency-name: github.com/armon/go-metrics
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
3fbf68de12
build(deps): bump github.com/Shopify/sarama from 1.37.0 to 1.37.2 ( #3818 )
Bumps [github.com/Shopify/sarama](https://github.com/Shopify/sarama ) from 1.37.0 to 1.37.2.
- [Release notes](https://github.com/Shopify/sarama/releases )
- [Changelog](https://github.com/Shopify/sarama/blob/main/CHANGELOG.md )
- [Commits](https://github.com/Shopify/sarama/compare/v1.37.0...v1.37.2 )
---
updated-dependencies:
- dependency-name: github.com/Shopify/sarama
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
c4fa148ee6
build(deps): bump actions/checkout from 3.0.2 to 3.1.0 ( #3815 )
Bumps [actions/checkout](https://github.com/actions/checkout ) from 3.0.2 to 3.1.0.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](2541b1294d
3 years ago
6bbc1d4026
build(deps): bump github.com/klauspost/reedsolomon from 1.11.0 to 1.11.1 ( #3816 )
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon ) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/klauspost/reedsolomon/releases )
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.11.0...v1.11.1 )
---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
43175e7fe8
build(deps): bump go.mongodb.org/mongo-driver from 1.10.2 to 1.10.3 ( #3817 )
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver ) from 1.10.2 to 1.10.3.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases )
- [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.10.2...v1.10.3 )
---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
7617567c02
build(deps): bump github.com/aws/aws-sdk-go from 1.44.110 to 1.44.114 ( #3820 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.44.110 to 1.44.114.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.110...v1.44.114 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 years ago
5b28c3f728
revert disabling FSync for non Mac ( #3814 )
3 years ago
3550692afc
change s3_account.go package to avoid cycle dependency ( #3813 )
3 years ago
0711870f43
3.31
3 years ago
109dc7fdf6
mount: remove mount directory from generating cache directory id
fix https://github.com/seaweedfs/seaweedfs/discussions/3811
3 years ago
fc54afdba9
tests add parsing ec shard info
3 years ago
0623bf582e
include ec shard for capacityByFreeVolumeCount
3 years ago
98dc1e5c15
move volume: find target volume server by exiting/max ratio
3 years ago
049f040c3c
refactor
3 years ago
124b97f6d7
parsing ec volumes
3 years ago
1e27d36576
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
3 years ago
f9383aa726
refactor to change capacity data type
3 years ago
b7de4a967e
fix: compact_map get error mismatching cokie ( #3748 )
* fix: compact_map get error
* fix: CompactSection delete lock and move test to compact_map
Co-authored-by: shibinbin <shibinbin@megvii.com>
3 years ago
b9d8a837af
Fix `mount -t weed` with extra options ( #3807 )
fuse: Ignore "-o" command
3 years ago
5db25a8f2a
metric shows who is currently blocking the cluster or not ( #3799 )
* master_admin_lock Shows whether cluster is locked now or not
https://github.com/seaweedfs/seaweedfs/issues/3452
* fix metric MasterAdminLock
3 years ago
f8d3ff466d
Allow parallel volume loading from different dirs during startup. ( #3802 )
3 years ago
a522507f95
configure raft metrics ( #3798 )
3 years ago
Konstantin Lebedev
chrislu
LHHDZ
Guo Lei
famosss
zemul
Guo Lei
livehl
dependabot[bot]
binbinshi
BakerBunker
Viktor Kuzmin