Chris Lu
d986c7196d
use append time instead of filer's own modification time
fix https://github.com/chrislusf/seaweedfs/issues/1669
4 years ago
Chris Lu
2c913dde04
volume: detect and drop volumes with disk IO error
from Jethro in slack:
is it possible to make the assign request a bit smarter? Currently I’m in the state that a disk failed but all assign request are being send to this volume. It would be cool if the master sees this and stopped using this volume.
e=HTTP(http://x:8089/913,045a782b63176edf ) not 200 but 500 Internal Server Error
Body={"size":740167,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"ee4381e202212ff3aee647704c036689"}
e=HTTP(http://x:8089/913,045a782c90240077 ) not 200 but 500 Internal Server Error
Body={"size":792779,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"c43463ccc11eb6eb2fc306f407a6a953"}
e=HTTP(http://x:8089/913,045a782e6b7901ea ) not 200 but 500 Internal Server Error
Body={"size":3962392,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"04c91198e9b276c81f11dbf189af5d28"}
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
c0fb4a3766
add comments
4 years ago
Chris Lu
de86945aeb
go fmt
4 years ago
Chris Lu
53c3aad875
volume: add a note file to avoid incomplete volume files
fix https://github.com/chrislusf/seaweedfs/issues/1567
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
e9d40b80b2
less verbose logs
4 years ago
Chris Lu
bd8b9b0c2e
some changes to prepare fix after failed reads
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
f2723c1bc8
do not idx file format
revert c9ab8d05fa
4 years ago
Chris Lu
c9ab8d05fa
fixes for reading deleted fid
4 years ago
Chris Lu
ed4b43b419
adjust logs
4 years ago
Chris Lu
fe01191b5b
support read option readDeleted=true
4 years ago
Chris Lu
6ccd7f0a4d
refactoring
4 years ago
Chris Lu
7e91ae592c
pass in option to read deleted entries
not working yet
4 years ago
Chris Lu
ee11d98650
refactoring
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
bdbe5ddbe9
volume server: add a fix for dead lock
https://github.com/chrislusf/seaweedfs/issues/1353
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
zhangsong
3703c7e176
write request keep compatible with before
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
e4af63a721
volume server: accept fsync=true in write requests
5 years ago
Chris Lu
b6e6ca8595
adjust logs
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
e8b357fd53
rename from .tier to .vif
5 years ago
Chris Lu
35393b4a02
cleanly destroy remote files
5 years ago
Chris Lu
f42b5bd0f5
rename .sdb to .sdx
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
deb03ecfa3
remove duplicated checking
already checked in store.go
5 years ago
Chris Lu
ef3ae3cd41
clean up sorted index file
5 years ago
Chris Lu
10bd3c6b4b
refactoring
5 years ago
Chris Lu
f38f90b7ea
cleanly remove .tier volume file
5 years ago
Chris Lu
6827cabfbb
volume: dataFileAccessLock change to RW Lock
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago
chenwanli
295f3beed5
rm ldb and bdb directory
5 years ago
Chris Lu
85f8649320
refactor memory mapped file into backend storage
5 years ago
Chris Lu
19b6a16003
changed from os.file to backend.DataStorageBackend
5 years ago
Chris Lu
46ed2ca902
refactoring
5 years ago
Chris Lu
3c865ee39b
fix missing needle header read
5 years ago
Chris Lu
fc412e428b
refactor ScanVolumeFileFrom()
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
Chris Lu
5e9c65469e
volume: skip readonly checking when Destroy()
fix https://github.com/chrislusf/seaweedfs/issues/1063
5 years ago
j.laycock
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
5 years ago
j.laycock
1e62a2b233
Fix memory not being unmapped
5 years ago
j.laycock
840ccdc35d
Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly
5 years ago
j.laycock
dc50701e7d
Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete
5 years ago
j.laycock
0e5d3b1a70
Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files
5 years ago
Chris Lu
d829df4f59
volume: protect against nil needle map
fix @mastak reported nil problem in https://github.com/chrislusf/seaweedfs/issues/1037
5 years ago