chrislu
e1ca6308cb
add chunk etag when downloading from remote storage
fix https://github.com/seaweedfs/seaweedfs/issues/3987
2 years ago
James Hartig
81624de27b
Include name/mime in ReadAllNeedles ( #4005 )
2 years ago
James Hartig
4c85da7844
Include meta in ReadAllNeedles ( #3991 )
This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice.
2 years ago
chrislu
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
Eric Yang
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
chrislu
de286fe662
shell: volume.move handles volume moved to cloud tier
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2 years ago
Konstantin Lebedev
f476cf3403
fix volume_server.proto conflict ( #3858 )
fix conflict
https://github.com/seaweedfs/seaweedfs/pull/3841
2 years ago
Konstantin Lebedev
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
chrislu
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2 years ago
chrislu
21c0587900
go fmt
2 years ago
Ryan Russell
12914af4d8
Character readability ( #3678 )
* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
qzh
74b53729e1
feat(weed.move): add a speed limit parameter of moving files ( #3478 )
* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
Konstantin Lebedev
fc65122766
rename to LoadAvg_1M
2 years ago
Konstantin Lebedev
5209ebbeef
remove percent
2 years ago
Konstantin Lebedev
634bc97840
fix conflicts
2 years ago
chrislu
afef014832
scaffold
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
2f0dda384d
vacuum show LA
2 years ago
chrislu
d12f431d98
collect volume server status
3 years ago
chrislu
94635e9b5c
filer: add filer group
3 years ago
Konstantin Lebedev
1e35b4929f
shell vacuum volume by collection and volume id
3 years ago
chrislu
b4be56bb3b
add timing info during ping operation
3 years ago
Konstantin Lebedev
357aa818fe
add raft shell cmds
3 years ago
chrislu
743ad690b6
filer supports grpc ping
3 years ago
chrislu
800cbc004c
volume server adds ping function
3 years ago
chrislu
b70cb3e0b2
upgrade protoc to 3.17.3
$brew install protobuf
$ protoc --version
libprotoc 3.17.3
$ go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.26
$ go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@v1.1
3 years ago
Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Chris Lu
225b019fe0
stream read multiple volumes in a volume server
3 years ago
Chris Lu
c4d7ee6c5c
volume server: read all files in a volume
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
2b1feb732c
remote.cache supports replication
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
713c035a6e
shell: remote.cache remote.uncache
3 years ago
Chris Lu
270770d7d7
refactor
3 years ago
Chris Lu
9df7d16791
read <- remote_storage
3 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
770393a48c
volume: add capability to change disk type when moving a volume
4 years ago
Chris Lu
2e8dba571b
adjust volume server UI
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
2251a8e472
minor
4 years ago
Konstantin Lebedev
1eec5c8d5d
gen pb
4 years ago
Chris Lu
c9202c4b3d
add storage backend to GetMasterConfigurationResponse
4 years ago
Chris Lu
200fe5c83e
go fmt
4 years ago
Chris Lu
5d6753fb98
shell: add volumeServer.leave command
4 years ago
Chris Lu
ca658a97c5
add signatures to messages to avoid double processing
4 years ago
James Hartig
3ccfa4c6ad
Added VolumeMarkWritable and VolumeStatus grpc methods
This is necessary for copy to mark as read-only and then restore the
original state afterwards.
4 years ago
James Hartig
229f11c660
Added VolumeNeedleStatus volume server grpc method
This is needed for the diffing tool to get the cookie for a needle
4 years ago