Ryan Russell
277976bd76
refactor(storage): readability improvements ( #3703 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
2bfc8970d2
refactor: move ReadNeedleDataInto into volume_read.go
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
36d2756978
volume: avoid writing too much data for range requests in large files
related to https://github.com/chrislusf/seaweedfs/issues/3178
3 years ago
chrislu
11f1e7996b
fix test
3 years ago
chrislu
056c480eb0
volume: checksum remove the hashing step in Value()
3 years ago
chrislu
ecef844dfc
stream read large files
3 years ago
chrislu
685643d506
needle read into a writer
3 years ago
chrislu
663bc5dc23
add needle reading in chunks
3 years ago
chrislu
18b29f709c
refactoring, split file
3 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
3 years ago
Konstantin Lebedev
3f4e17aa24
error metrics for filer and store
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
d688e10ed1
do not try to compress if not sure about the file content
3 years ago
Chris Lu
332f5ad3a8
revert temporary changes that disabled compression
fix https://github.com/chrislusf/seaweedfs/issues/2362
3 years ago
Chris Lu
5956a8b05a
adjust comment
3 years ago
Chris Lu
1b942dfa3c
add error message
3 years ago
Konstantin Lebedev
865b06b7fe
The IEEE assembler optimizations has been submitted and will be part of the Go 1.6 standard library.
https://github.com/klauspost/crc32
3 years ago
Chris Lu
9cc84a910f
volume: deletion can skip volume size checking
fix https://github.com/chrislusf/seaweedfs/issues/2225
3 years ago
Chris Lu
b624090398
go fmt
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Chris Lu
8e404a1433
go fmt
4 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
35d939a1d2
go fmt
4 years ago
Chris Lu
38fc200e56
CRCWriter consistent with CRC
4 years ago
Chris Lu
400de380f4
volume server: support tcp direct put/get/delete
4 years ago
Chris Lu
540441fd38
go fmt
4 years ago
Chris Lu
03c643aa6b
fix test
fileSize need to be divided by 8
4 years ago
Chris Lu
1ad3200094
skip seek() when index file writes
4 years ago
bingoohuang
ee7cdf3668
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
7ffe736d20
renaming to ErrXyz
4 years ago
Chris Lu
039ad101b1
manifest file also need to detect compression
fix https://github.com/chrislusf/seaweedfs/issues/1724#issuecomment-753585046
4 years ago
Chris Lu
cc839f935d
better unit detection
4 years ago
Chris Lu
b219ccfe68
Update volume_ttl_test.go
4 years ago
Chris Lu
a83b8e7b01
ttl fix: 3y was converted into 96m
4 years ago
Chris Lu
0da7ecfd29
go fmt
4 years ago
Chris Lu
92f906b6fc
remove zstd
fix https://github.com/chrislusf/seaweedfs/issues/1629
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
dbb10e0f0b
testing with more than 30days
4 years ago
Chris Lu
99ecf63276
go fmt
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
ab6e5c0dc4
adjust error message
4 years ago
Chris Lu
20e2ac1add
filer: store md5 metadata for files uploaded by filer
fix https://github.com/chrislusf/seaweedfs/issues/1412
4 years ago
Chris Lu
4ecfa9879d
volume: report Content-MD5 in response header
4 years ago
Chris Lu
cbd80253e3
better needle id format
4 years ago
Chris Lu
f89186a3cf
better logging
4 years ago
Chris Lu
97d97f3528
go code can read and write chunk manifest
4 years ago
李远军
6608cb5f43
Revert "remove fixJpgOrientation"
This reverts commit de5ca9b2
5 years ago