chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
36d2756978
volume: avoid writing too much data for range requests in large files
related to https://github.com/chrislusf/seaweedfs/issues/3178
3 years ago
chrislu
11f1e7996b
fix test
3 years ago
chrislu
056c480eb0
volume: checksum remove the hashing step in Value()
3 years ago
chrislu
ecef844dfc
stream read large files
3 years ago
chrislu
685643d506
needle read into a writer
3 years ago
chrislu
663bc5dc23
add needle reading in chunks
3 years ago
chrislu
18b29f709c
refactoring, split file
3 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
3 years ago
Konstantin Lebedev
3f4e17aa24
error metrics for filer and store
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
d688e10ed1
do not try to compress if not sure about the file content
3 years ago
Chris Lu
332f5ad3a8
revert temporary changes that disabled compression
fix https://github.com/chrislusf/seaweedfs/issues/2362
3 years ago
Chris Lu
5956a8b05a
adjust comment
3 years ago
Chris Lu
1b942dfa3c
add error message
3 years ago
Konstantin Lebedev
865b06b7fe
The IEEE assembler optimizations has been submitted and will be part of the Go 1.6 standard library.
https://github.com/klauspost/crc32
3 years ago
Chris Lu
9cc84a910f
volume: deletion can skip volume size checking
fix https://github.com/chrislusf/seaweedfs/issues/2225
3 years ago
Chris Lu
b624090398
go fmt
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Chris Lu
8e404a1433
go fmt
4 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
35d939a1d2
go fmt
4 years ago
Chris Lu
38fc200e56
CRCWriter consistent with CRC
4 years ago
Chris Lu
400de380f4
volume server: support tcp direct put/get/delete
4 years ago
Chris Lu
540441fd38
go fmt
4 years ago
Chris Lu
03c643aa6b
fix test
fileSize need to be divided by 8
4 years ago
Chris Lu
1ad3200094
skip seek() when index file writes
4 years ago
bingoohuang
ee7cdf3668
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
7ffe736d20
renaming to ErrXyz
4 years ago
Chris Lu
039ad101b1
manifest file also need to detect compression
fix https://github.com/chrislusf/seaweedfs/issues/1724#issuecomment-753585046
4 years ago
Chris Lu
cc839f935d
better unit detection
4 years ago
Chris Lu
b219ccfe68
Update volume_ttl_test.go
4 years ago
Chris Lu
a83b8e7b01
ttl fix: 3y was converted into 96m
4 years ago
Chris Lu
0da7ecfd29
go fmt
4 years ago
Chris Lu
92f906b6fc
remove zstd
fix https://github.com/chrislusf/seaweedfs/issues/1629
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
dbb10e0f0b
testing with more than 30days
4 years ago
Chris Lu
99ecf63276
go fmt
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
ab6e5c0dc4
adjust error message
4 years ago
Chris Lu
20e2ac1add
filer: store md5 metadata for files uploaded by filer
fix https://github.com/chrislusf/seaweedfs/issues/1412
4 years ago
Chris Lu
4ecfa9879d
volume: report Content-MD5 in response header
4 years ago
Chris Lu
cbd80253e3
better needle id format
4 years ago
Chris Lu
f89186a3cf
better logging
4 years ago
Chris Lu
97d97f3528
go code can read and write chunk manifest
4 years ago
李远军
6608cb5f43
Revert "remove fixJpgOrientation"
This reverts commit de5ca9b2
5 years ago
Chris Lu
20d9cfae86
volume: following md5 base64 encoding
fix https://github.com/chrislusf/seaweedfs/issues/1374
5 years ago
Chris Lu
2ff37ccdbd
testing parsing the upload
The mime type is always the value passed in.
Compress or not depends on the content detection, file name extension, and compression ratio.
If the content is already compressed, need to know the content size.
5 years ago
Kimbsen
4eeab2a379
remove unused imports
5 years ago