skycope
0e8a54f6f6
fix write volume over size MaxPossibleVolumeSize ( #5190 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
12 months ago
chrislu
c278bac263
avoid nil needle map
fix https://github.com/seaweedfs/seaweedfs/issues/4640
1 year ago
柏杰
0b0fb9b9e4
avoid data race read volume.IsEmpty ( #4574 )
* avoid data race read volume.IsEmpty
- avoid phantom read isEmpty for onlyEmpty
- use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope
* add Destroy(onlyEmpty: true) test
* add Destroy(onlyEmpty: false) test
* remove unused `IsEmpty()`
* change literal `8` to `SuperBlockSize`
2 years ago
chrislu
d880fc2bb3
fix merge
2 years ago
Konstantin Lebedev
6253058d9d
ensure monotonic n.AppendAtNs in each place ( #3880 )
https://github.com/seaweedfs/seaweedfs/issues/3852
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
chrislu
f2d9049e6a
fix size variable
2 years ago
chrislu
184fbb6c50
volume server: remote tier volumes only soft delete in local index
fix https://github.com/seaweedfs/seaweedfs/issues/3889
2 years ago
chrislu
9c8678ded9
ensure monotonic n.AppendAtNs
fix https://github.com/seaweedfs/seaweedfs/issues/3852
2 years ago
Ryan Russell
277976bd76
refactor(storage): readability improvements ( #3703 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
37ab8909b0
use two flags: v.isCompacting and v.isCommitCompacting
3 years ago
Chris Lu
78e8ddf910
Only when tailing volume, the zero-ed cookie should skip checking.
This only happens when checkCookie == false and fsync == false.
3 years ago
Chris Lu
a8617c1a39
tail volume: fix zero cookie problem from batch deletion
3 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
102a951377
refactor, split into 2 files
4 years ago
Chris Lu
f6e2566ee5
better logs for cookie mismatch
4 years ago
Chris Lu
737bde5ab7
refactoring, remove duplicated code
4 years ago
bingoohuang
ee082ae402
revert comment temporarily
4 years ago
bingoohuang
ee7cdf3668
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
a6d421508a
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
7ffe736d20
renaming to ErrXyz
4 years ago
bingoohuang
7256902fb0
fix typo offset.ToAcutalOffset to offset.ToActualOffset
4 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
4 years ago
Chris Lu
d986c7196d
use append time instead of filer's own modification time
fix https://github.com/chrislusf/seaweedfs/issues/1669
4 years ago
Chris Lu
2c913dde04
volume: detect and drop volumes with disk IO error
from Jethro in slack:
is it possible to make the assign request a bit smarter? Currently I’m in the state that a disk failed but all assign request are being send to this volume. It would be cool if the master sees this and stopped using this volume.
e=HTTP(http://x:8089/913,045a782b63176edf ) not 200 but 500 Internal Server Error
Body={"size":740167,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"ee4381e202212ff3aee647704c036689"}
e=HTTP(http://x:8089/913,045a782c90240077 ) not 200 but 500 Internal Server Error
Body={"size":792779,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"c43463ccc11eb6eb2fc306f407a6a953"}
e=HTTP(http://x:8089/913,045a782e6b7901ea ) not 200 but 500 Internal Server Error
Body={"size":3962392,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"04c91198e9b276c81f11dbf189af5d28"}
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
c0fb4a3766
add comments
4 years ago
Chris Lu
de86945aeb
go fmt
4 years ago
Chris Lu
53c3aad875
volume: add a note file to avoid incomplete volume files
fix https://github.com/chrislusf/seaweedfs/issues/1567
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
e9d40b80b2
less verbose logs
4 years ago
Chris Lu
bd8b9b0c2e
some changes to prepare fix after failed reads
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
f2723c1bc8
do not idx file format
revert c9ab8d05fa
4 years ago
Chris Lu
c9ab8d05fa
fixes for reading deleted fid
4 years ago
Chris Lu
ed4b43b419
adjust logs
4 years ago
Chris Lu
fe01191b5b
support read option readDeleted=true
4 years ago
Chris Lu
6ccd7f0a4d
refactoring
4 years ago
Chris Lu
7e91ae592c
pass in option to read deleted entries
not working yet
4 years ago
Chris Lu
ee11d98650
refactoring
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
bdbe5ddbe9
volume server: add a fix for dead lock
https://github.com/chrislusf/seaweedfs/issues/1353
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
zhangsong
3703c7e176
write request keep compatible with before
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
e4af63a721
volume server: accept fsync=true in write requests
5 years ago
Chris Lu
b6e6ca8595
adjust logs
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
e8b357fd53
rename from .tier to .vif
5 years ago