chrislu
9f8b72a54d
Revert "Merge pull request #3159 from shichanglin5/_duplicateUUID"
This reverts commit 37da689319
, reversing
changes made to 00d53c34c4
.
3 years ago
shichanglin5
f5b0c04b14
perf: Optimized volume handling duplicateUUID logic to avoid quitting when volume is actualy normal
Under normal circumstances, there will be no problems, but when the
master is debugged in the local environment, the volume client cannot
communicate with the master normally, so the sendHeartBeat logic is
restarted, and a new connection is created to report the heartbeat. If
the master has not cleared the uuid of the volume at this time, then The
master will respond to volume duplicateUUIDS, and the volume service
will exit, but in fact the uuid of the volume is not duplicated
3 years ago
chrislu
70e5a1b632
volume close should wait for committing compaction
3 years ago
chrislu
37ab8909b0
use two flags: v.isCompacting and v.isCommitCompacting
3 years ago
chrislu
94f824e1ce
volume: sync to disk before copying volume files
address https://github.com/chrislusf/seaweedfs/issues/2976
3 years ago
Konstantin Lebedev
7315d1d039
waite volume being closed during compression idx
3 years ago
Konstantin Lebedev
9438738693
avoid invalid memory address or nil pointer dereference
3 years ago
chrislu
a129bda7d9
sync data first before stopping
3 years ago
Konstantin Lebedev
99ef280c7c
avoid data loss after restarting a container with a volum server
4 years ago
Chris Lu
972327f966
prevent nil volume nm
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
4 years ago
Chris Lu
4f31c1bb94
go fmt
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
d156c74ec0
volume server set volume type and heartbeat to the master
4 years ago
Chris Lu
ae655033ac
adjust logging
4 years ago
Chris Lu
2c913dde04
volume: detect and drop volumes with disk IO error
from Jethro in slack:
is it possible to make the assign request a bit smarter? Currently I’m in the state that a disk failed but all assign request are being send to this volume. It would be cool if the master sees this and stopped using this volume.
e=HTTP(http://x:8089/913,045a782b63176edf ) not 200 but 500 Internal Server Error
Body={"size":740167,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"ee4381e202212ff3aee647704c036689"}
e=HTTP(http://x:8089/913,045a782c90240077 ) not 200 but 500 Internal Server Error
Body={"size":792779,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"c43463ccc11eb6eb2fc306f407a6a953"}
e=HTTP(http://x:8089/913,045a782e6b7901ea ) not 200 but 500 Internal Server Error
Body={"size":3962392,"error":"failed to write to local disk: write /mnt/v9/913.dat: input/output error","eTag":"04c91198e9b276c81f11dbf189af5d28"}
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
9104cfa744
reduce locks
4 years ago
James Hartig
3ccfa4c6ad
Added VolumeMarkWritable and VolumeStatus grpc methods
This is necessary for copy to mark as read-only and then restore the
original state afterwards.
4 years ago
Chris Lu
faa5c2e89a
refactoring
5 years ago
Evgenii Kozlov
0e0db70f55
Set volumes ReadOnly if low free disk space
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
c3cb6fa1d7
volume: compaction can cause readonly volumes
address https://github.com/chrislusf/seaweedfs/issues/1233
5 years ago
Chris Lu
89eb05b50f
filer: support TTL for all filer stores
5 years ago
Chris Lu
151114ff59
volume: fix readonly status reporting
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
f4a74e03d1
refactoring: separating .vif from tier file loading
5 years ago
Chris Lu
2000284435
rename volume tier info to volume info
5 years ago
Chris Lu
35393b4a02
cleanly destroy remote files
5 years ago
stlpmo
f3de4b6c18
remove the redundant type conversion
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
f61de28c69
volume: add deletion capability for previously readonly volumes
5 years ago
Chris Lu
10bd3c6b4b
refactoring
5 years ago
Chris Lu
6827cabfbb
volume: dataFileAccessLock change to RW Lock
5 years ago
Chris Lu
1becbce657
display remote volumes on volume server ui page
5 years ago
Chris Lu
ec8de250e2
tiered storage: can copy to s3, read from s3
master not aware tiered volume yet, file assigning is not working yet
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago
Chris Lu
b7156291a8
adjust variable names
5 years ago
Chris Lu
19b6a16003
changed from os.file to backend.DataStorageBackend
5 years ago
Chris Lu
faec9076a4
adjust parameter names
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
Chris Lu
02710f9624
refactoring: remove unused functions
5 years ago
Chris Lu
0f861d23a2
avoid nil needle map
fix https://github.com/chrislusf/seaweedfs/issues/1061
5 years ago
j.laycock
5885ab67b3
rename volume property MemoryMap to MemoryMapMaxSizeMB
5 years ago
Tom Maxwell
4a878c0006
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
5 years ago
j.laycock
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
5 years ago