Konstantin Lebedev
2b3e39397e
fix: skipping checking active volumes with the same number of files at the moment ( #4893 )
* fix: skipping checking active volumes with the same number of files at the moment
https://github.com/seaweedfs/seaweedfs/issues/4140
* refactor with comments
https://github.com/seaweedfs/seaweedfs/issues/4140
* add TestShouldSkipVolume
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
1 year ago
Konstantin Lebedev
25535e9c36
Delete volume is empty ( #4561 )
* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
wusong
26f15d0079
Fix no more writable volumes by delay judgment ( #4548 )
* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
chrislu
e1ca6308cb
add chunk etag when downloading from remote storage
fix https://github.com/seaweedfs/seaweedfs/issues/3987
2 years ago
James Hartig
81624de27b
Include name/mime in ReadAllNeedles ( #4005 )
2 years ago
James Hartig
4c85da7844
Include meta in ReadAllNeedles ( #3991 )
This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice.
2 years ago
Eric Yang
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
chrislu
de286fe662
shell: volume.move handles volume moved to cloud tier
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2 years ago
Konstantin Lebedev
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
chrislu
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2 years ago
Ryan Russell
12914af4d8
Character readability ( #3678 )
* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
qzh
74b53729e1
feat(weed.move): add a speed limit parameter of moving files ( #3478 )
* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
Konstantin Lebedev
fc65122766
rename to LoadAvg_1M
2 years ago
Konstantin Lebedev
5209ebbeef
remove percent
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
2f0dda384d
vacuum show LA
2 years ago
chrislu
d12f431d98
collect volume server status
3 years ago
chrislu
b4be56bb3b
add timing info during ping operation
3 years ago
chrislu
800cbc004c
volume server adds ping function
3 years ago
Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Chris Lu
225b019fe0
stream read multiple volumes in a volume server
3 years ago
Chris Lu
c4d7ee6c5c
volume server: read all files in a volume
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
2b1feb732c
remote.cache supports replication
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
713c035a6e
shell: remote.cache remote.uncache
3 years ago
Chris Lu
270770d7d7
refactor
3 years ago
Chris Lu
9df7d16791
read <- remote_storage
3 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
770393a48c
volume: add capability to change disk type when moving a volume
4 years ago
Chris Lu
2e8dba571b
adjust volume server UI
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
5d6753fb98
shell: add volumeServer.leave command
4 years ago
James Hartig
3ccfa4c6ad
Added VolumeMarkWritable and VolumeStatus grpc methods
This is necessary for copy to mark as read-only and then restore the
original state afterwards.
4 years ago
James Hartig
229f11c660
Added VolumeNeedleStatus volume server grpc method
This is needed for the diffing tool to get the cookie for a needle
4 years ago
Chris Lu
ca3516ac6d
adjust protoc
5 years ago
Chris Lu
50a5018b7f
writing meta logs is working
5 years ago
Chris Lu
c3cb6fa1d7
volume: compaction can cause readonly volumes
address https://github.com/chrislusf/seaweedfs/issues/1233
5 years ago
Chris Lu
bbb163c5ad
add for https://github.com/chrislusf/seaweedfs/pull/1207
5 years ago
Chris Lu
f55f49970f
move volume server stats to grpc
5 years ago
Chris Lu
9b6296e77a
volume: add grpc file read operation
This is added more for performance benchmarking.
5 years ago
Chris Lu
40ae533fa3
shell: add volume.configure.replication to change replication for a volume
fix https://github.com/chrislusf/seaweedfs/issues/1192
5 years ago
Chris Lu
37b64a50b4
ec: generate and copy .vif file
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
2000284435
rename volume tier info to volume info
5 years ago
Chris Lu
b3c83f9404
fix spelling
5 years ago
Chris Lu
48d28d3eb2
tier: support remote file attributes and remember the file extension
5 years ago