Konstantin Lebedev
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk ( #5458 )
9 months ago
skycope
316ae45795
can vacuum volume when size mismatch ( #5200 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
11 months ago
skycope
0e8a54f6f6
fix write volume over size MaxPossibleVolumeSize ( #5190 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
12 months ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
12 months ago
zemul
bd6f2716d3
fix_read_tomb_needle_meta ( #4263 )
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2 years ago
Eric Yang
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
Konstantin Lebedev
6253058d9d
ensure monotonic n.AppendAtNs in each place ( #3880 )
https://github.com/seaweedfs/seaweedfs/issues/3852
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
Konstantin Lebedev
452202f35b
ReadNeedleMeta recovery panic occurred ( #3883 )
ReadNeedleMeta panic occurred
https://github.com/seaweedfs/seaweedfs/issues/3882
2 years ago
chrislu
e3ea544d40
skip reading needle if size is invalid
related to https://github.com/seaweedfs/seaweedfs/issues/3882
2 years ago
Ryan Russell
277976bd76
refactor(storage): readability improvements ( #3703 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
2bfc8970d2
refactor: move ReadNeedleDataInto into volume_read.go
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
36d2756978
volume: avoid writing too much data for range requests in large files
related to https://github.com/chrislusf/seaweedfs/issues/3178
3 years ago
chrislu
11f1e7996b
fix test
3 years ago
chrislu
056c480eb0
volume: checksum remove the hashing step in Value()
3 years ago
chrislu
ecef844dfc
stream read large files
3 years ago
chrislu
685643d506
needle read into a writer
3 years ago
chrislu
663bc5dc23
add needle reading in chunks
3 years ago
chrislu
18b29f709c
refactoring, split file
3 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
3 years ago
Konstantin Lebedev
3f4e17aa24
error metrics for filer and store
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
d688e10ed1
do not try to compress if not sure about the file content
3 years ago
Chris Lu
332f5ad3a8
revert temporary changes that disabled compression
fix https://github.com/chrislusf/seaweedfs/issues/2362
3 years ago
Chris Lu
5956a8b05a
adjust comment
3 years ago
Chris Lu
1b942dfa3c
add error message
3 years ago
Konstantin Lebedev
865b06b7fe
The IEEE assembler optimizations has been submitted and will be part of the Go 1.6 standard library.
https://github.com/klauspost/crc32
3 years ago
Chris Lu
9cc84a910f
volume: deletion can skip volume size checking
fix https://github.com/chrislusf/seaweedfs/issues/2225
3 years ago
Chris Lu
b624090398
go fmt
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Chris Lu
8e404a1433
go fmt
4 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
35d939a1d2
go fmt
4 years ago
Chris Lu
38fc200e56
CRCWriter consistent with CRC
4 years ago
Chris Lu
400de380f4
volume server: support tcp direct put/get/delete
4 years ago
Chris Lu
540441fd38
go fmt
4 years ago
Chris Lu
03c643aa6b
fix test
fileSize need to be divided by 8
4 years ago
Chris Lu
1ad3200094
skip seek() when index file writes
4 years ago
bingoohuang
ee7cdf3668
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
7ffe736d20
renaming to ErrXyz
4 years ago
Chris Lu
039ad101b1
manifest file also need to detect compression
fix https://github.com/chrislusf/seaweedfs/issues/1724#issuecomment-753585046
4 years ago
Chris Lu
cc839f935d
better unit detection
4 years ago
Chris Lu
b219ccfe68
Update volume_ttl_test.go
4 years ago
Chris Lu
a83b8e7b01
ttl fix: 3y was converted into 96m
4 years ago
Chris Lu
0da7ecfd29
go fmt
4 years ago
Chris Lu
92f906b6fc
remove zstd
fix https://github.com/chrislusf/seaweedfs/issues/1629
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
dbb10e0f0b
testing with more than 30days
4 years ago