chrislu
70e5a1b632
volume close should wait for committing compaction
3 years ago
chrislu
37ab8909b0
use two flags: v.isCompacting and v.isCommitCompacting
3 years ago
chrislu
94f824e1ce
volume: sync to disk before copying volume files
address https://github.com/chrislusf/seaweedfs/issues/2976
3 years ago
Konstantin Lebedev
7315d1d039
waite volume being closed during compression idx
3 years ago
Konstantin Lebedev
9438738693
avoid invalid memory address or nil pointer dereference
3 years ago
chrislu
a129bda7d9
sync data first before stopping
3 years ago
Konstantin Lebedev
99ef280c7c
avoid data loss after restarting a container with a volum server
4 years ago
Chris Lu
972327f966
prevent nil volume nm
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
4 years ago
Chris Lu
4f31c1bb94
go fmt
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
d156c74ec0
volume server set volume type and heartbeat to the master
4 years ago
Chris Lu
ae655033ac
adjust logging
4 years ago
Chris Lu
2c913dde04
volume: detect and drop volumes with disk IO error
from Jethro in slack:
is it possible to make the assign request a bit smarter? Currently I’m in the state that a disk failed but all assign request are being send to this volume. It would be cool if the master sees this and stopped using this volume.
e=HTTP(http://x:8089/913,045a782b63176edf ) not 200 but 500 Internal Server Error
Body={"size":740167,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"ee4381e202212ff3aee647704c036689"}
e=HTTP(http://x:8089/913,045a782c90240077 ) not 200 but 500 Internal Server Error
Body={"size":792779,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"c43463ccc11eb6eb2fc306f407a6a953"}
e=HTTP(http://x:8089/913,045a782e6b7901ea ) not 200 but 500 Internal Server Error
Body={"size":3962392,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"04c91198e9b276c81f11dbf189af5d28"}
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
9104cfa744
reduce locks
4 years ago
James Hartig
3ccfa4c6ad
Added VolumeMarkWritable and VolumeStatus grpc methods
This is necessary for copy to mark as read-only and then restore the
original state afterwards.
4 years ago
Chris Lu
faa5c2e89a
refactoring
5 years ago
Evgenii Kozlov
0e0db70f55
Set volumes ReadOnly if low free disk space
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
c3cb6fa1d7
volume: compaction can cause readonly volumes
address https://github.com/chrislusf/seaweedfs/issues/1233
5 years ago
Chris Lu
89eb05b50f
filer: support TTL for all filer stores
5 years ago
Chris Lu
151114ff59
volume: fix readonly status reporting
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
f4a74e03d1
refactoring: separating .vif from tier file loading
5 years ago
Chris Lu
2000284435
rename volume tier info to volume info
5 years ago
Chris Lu
35393b4a02
cleanly destroy remote files
5 years ago
stlpmo
f3de4b6c18
remove the redundant type conversion
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
f61de28c69
volume: add deletion capability for previously readonly volumes
5 years ago
Chris Lu
10bd3c6b4b
refactoring
5 years ago
Chris Lu
6827cabfbb
volume: dataFileAccessLock change to RW Lock
5 years ago
Chris Lu
1becbce657
display remote volumes on volume server ui page
5 years ago
Chris Lu
ec8de250e2
tiered storage: can copy to s3, read from s3
master not aware tiered volume yet, file assigning is not working yet
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago
Chris Lu
b7156291a8
adjust variable names
5 years ago
Chris Lu
19b6a16003
changed from os.file to backend.DataStorageBackend
5 years ago
Chris Lu
faec9076a4
adjust parameter names
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
Chris Lu
02710f9624
refactoring: remove unused functions
5 years ago
Chris Lu
0f861d23a2
avoid nil needle map
fix https://github.com/chrislusf/seaweedfs/issues/1061
5 years ago
j.laycock
5885ab67b3
rename volume property MemoryMap to MemoryMapMaxSizeMB
5 years ago
Tom Maxwell
4a878c0006
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
5 years ago
j.laycock
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
5 years ago
Tom Maxwell
d637d86d22
Changes to try and pass the URL parameters through - in memory flag not working still
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago