Chris Lu
039ad101b1
manifest file also need to detect compression
fix https://github.com/chrislusf/seaweedfs/issues/1724#issuecomment-753585046
4 years ago
Chris Lu
cc839f935d
better unit detection
4 years ago
Chris Lu
b219ccfe68
Update volume_ttl_test.go
4 years ago
Chris Lu
a83b8e7b01
ttl fix: 3y was converted into 96m
4 years ago
Chris Lu
0da7ecfd29
go fmt
4 years ago
Chris Lu
92f906b6fc
remove zstd
fix https://github.com/chrislusf/seaweedfs/issues/1629
4 years ago
Chris Lu
06c15ab35c
volume: add special handling for .dat larger than 32GB
4 years ago
Chris Lu
103fafe00b
weed export: print out [start,stop) content range
4 years ago
Chris Lu
dbb10e0f0b
testing with more than 30days
4 years ago
Chris Lu
99ecf63276
go fmt
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
ab6e5c0dc4
adjust error message
4 years ago
Chris Lu
20e2ac1add
filer: store md5 metadata for files uploaded by filer
fix https://github.com/chrislusf/seaweedfs/issues/1412
4 years ago
Chris Lu
4ecfa9879d
volume: report Content-MD5 in response header
4 years ago
Chris Lu
cbd80253e3
better needle id format
4 years ago
Chris Lu
f89186a3cf
better logging
4 years ago
Chris Lu
97d97f3528
go code can read and write chunk manifest
5 years ago
李远军
6608cb5f43
Revert "remove fixJpgOrientation"
This reverts commit de5ca9b2
5 years ago
Chris Lu
20d9cfae86
volume: following md5 base64 encoding
fix https://github.com/chrislusf/seaweedfs/issues/1374
5 years ago
Chris Lu
2ff37ccdbd
testing parsing the upload
The mime type is always the value passed in.
Compress or not depends on the content detection, file name extension, and compression ratio.
If the content is already compressed, need to know the content size.
5 years ago
Kimbsen
4eeab2a379
remove unused imports
5 years ago
Kimbsen
ffddecebef
do md5 validation AFTER decompression
5 years ago
Chris Lu
fe60db404a
prepare for zstd
5 years ago
Kimbsen
6b1e93ba0b
check request header not part header for content-encoding
5 years ago
Kimbsen
38626cb584
don't forget the last few bytes
5 years ago
Kimbsen
8d1f6cd567
added optional md5 verification of uploaded data
5 years ago
Chris Lu
de5ca9b258
remove fixJpgOrientation
5 years ago
Chris Lu
3080c197e3
rename UnCompressData to DecompressData
5 years ago
Chris Lu
e912fd15e3
renaming
5 years ago
Chris Lu
16fe132a20
detect mime type before replicating to other volume servers
5 years ago
Chris Lu
7ccc31853c
hard limit volume file size
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
zhangsong
3703c7e176
write request keep compatible with before
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
22400c6633
consistent gzip logic
local store gzip same as replicated writes
5 years ago
Chris Lu
9b3109a5d8
filer: processing all response headers, no pass through to volume server
* filer calculate MD5 etag
* filer handle response headers, instread of pass it to volume servers
5 years ago
Chris Lu
1ae83c2938
go fmt
5 years ago
Chris Lu
ea1169dc80
filer cipher: single chunk http POST and PUT and read
5 years ago
Chris Lu
7335e62199
volume: PUT also conditionally gzip compress
5 years ago
Chris Lu
943f4986ef
fix possible nil
5 years ago
Chris Lu
9995d3bcb5
remove println
5 years ago
Chris Lu
3eafec4b29
volume: add option to limit file size
5 years ago
Chris Lu
10bd3c6b4b
refactoring
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago
Chris Lu
85f8649320
refactor memory mapped file into backend storage
5 years ago
Chris Lu
4b5ba4927f
adjust NewDiskFile() paramaters
5 years ago
Chris Lu
cd7ce720c7
fix test
5 years ago
Chris Lu
19b6a16003
changed from os.file to backend.DataStorageBackend
5 years ago
Chris Lu
7a51a9a582
refactor: simplifying to ReadAt() and WriteAt()
5 years ago