Konstantin Lebedev
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
chrislu
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2 years ago
Ryan Russell
12914af4d8
Character readability ( #3678 )
* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
qzh
74b53729e1
feat(weed.move): add a speed limit parameter of moving files ( #3478 )
* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
Konstantin Lebedev
fc65122766
rename to LoadAvg_1M
2 years ago
Konstantin Lebedev
5209ebbeef
remove percent
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
2f0dda384d
vacuum show LA
2 years ago
chrislu
d12f431d98
collect volume server status
3 years ago
chrislu
b4be56bb3b
add timing info during ping operation
3 years ago
chrislu
800cbc004c
volume server adds ping function
3 years ago
Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Chris Lu
225b019fe0
stream read multiple volumes in a volume server
3 years ago
Chris Lu
c4d7ee6c5c
volume server: read all files in a volume
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
2b1feb732c
remote.cache supports replication
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
713c035a6e
shell: remote.cache remote.uncache
3 years ago
Chris Lu
270770d7d7
refactor
3 years ago
Chris Lu
9df7d16791
read <- remote_storage
3 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
770393a48c
volume: add capability to change disk type when moving a volume
4 years ago
Chris Lu
2e8dba571b
adjust volume server UI
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
5d6753fb98
shell: add volumeServer.leave command
4 years ago
James Hartig
3ccfa4c6ad
Added VolumeMarkWritable and VolumeStatus grpc methods
This is necessary for copy to mark as read-only and then restore the
original state afterwards.
4 years ago
James Hartig
229f11c660
Added VolumeNeedleStatus volume server grpc method
This is needed for the diffing tool to get the cookie for a needle
4 years ago
Chris Lu
ca3516ac6d
adjust protoc
5 years ago
Chris Lu
50a5018b7f
writing meta logs is working
5 years ago
Chris Lu
c3cb6fa1d7
volume: compaction can cause readonly volumes
address https://github.com/chrislusf/seaweedfs/issues/1233
5 years ago
Chris Lu
bbb163c5ad
add for https://github.com/chrislusf/seaweedfs/pull/1207
5 years ago
Chris Lu
f55f49970f
move volume server stats to grpc
5 years ago
Chris Lu
9b6296e77a
volume: add grpc file read operation
This is added more for performance benchmarking.
5 years ago
Chris Lu
40ae533fa3
shell: add volume.configure.replication to change replication for a volume
fix https://github.com/chrislusf/seaweedfs/issues/1192
5 years ago
Chris Lu
37b64a50b4
ec: generate and copy .vif file
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
2000284435
rename volume tier info to volume info
5 years ago
Chris Lu
b3c83f9404
fix spelling
5 years ago
Chris Lu
48d28d3eb2
tier: support remote file attributes and remember the file extension
5 years ago
Chris Lu
d960b3474a
tier storage: support downloading the remote dat files
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
ec8de250e2
tiered storage: can copy to s3, read from s3
master not aware tiered volume yet, file assigning is not working yet
5 years ago
Chris Lu
0da7b894cc
pass backend config from master to volume servers
5 years ago
Chris Lu
0f9ba84274
s3
5 years ago
Chris Lu
faec9076a4
adjust parameter names
5 years ago
Chris Lu
f8d4b7d1c0
support basic json filtering and selection
5 years ago
Chris Lu
cf47f657af
scaffold for volume server query feature
5 years ago