Chris Lu
2ff37ccdbd
testing parsing the upload
The mime type is always the value passed in.
Compress or not depends on the content detection, file name extension, and compression ratio.
If the content is already compressed, need to know the content size.
5 years ago
Kimbsen
4eeab2a379
remove unused imports
5 years ago
Kimbsen
ffddecebef
do md5 validation AFTER decompression
5 years ago
Chris Lu
fe60db404a
prepare for zstd
5 years ago
Kimbsen
6b1e93ba0b
check request header not part header for content-encoding
5 years ago
Kimbsen
38626cb584
don't forget the last few bytes
5 years ago
Kimbsen
8d1f6cd567
added optional md5 verification of uploaded data
5 years ago
Chris Lu
de5ca9b258
remove fixJpgOrientation
5 years ago
Chris Lu
3080c197e3
rename UnCompressData to DecompressData
5 years ago
Chris Lu
e912fd15e3
renaming
5 years ago
Chris Lu
16fe132a20
detect mime type before replicating to other volume servers
5 years ago
Chris Lu
7ccc31853c
hard limit volume file size
5 years ago
Chris Lu
5568395edd
Revert "Revert "Merge pull request #1299 from song-zhang/master""
This reverts commit afb6a1dbb4
.
5 years ago
zhangsong
3703c7e176
write request keep compatible with before
5 years ago
Chris Lu
afb6a1dbb4
Revert "Merge pull request #1299 from song-zhang/master"
This reverts commit 9016fa19ba
, reversing
changes made to 47234760f4
.
5 years ago
zhangsong
f9e8702bb4
use async write to persistent file to disk - part1
5 years ago
Chris Lu
22400c6633
consistent gzip logic
local store gzip same as replicated writes
5 years ago
Chris Lu
9b3109a5d8
filer: processing all response headers, no pass through to volume server
* filer calculate MD5 etag
* filer handle response headers, instread of pass it to volume servers
5 years ago
Chris Lu
1ae83c2938
go fmt
5 years ago
Chris Lu
ea1169dc80
filer cipher: single chunk http POST and PUT and read
5 years ago
Chris Lu
7335e62199
volume: PUT also conditionally gzip compress
5 years ago
Chris Lu
943f4986ef
fix possible nil
5 years ago
Chris Lu
9995d3bcb5
remove println
5 years ago
Chris Lu
3eafec4b29
volume: add option to limit file size
5 years ago
Chris Lu
10bd3c6b4b
refactoring
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago
Chris Lu
85f8649320
refactor memory mapped file into backend storage
5 years ago
Chris Lu
4b5ba4927f
adjust NewDiskFile() paramaters
5 years ago
Chris Lu
cd7ce720c7
fix test
5 years ago
Chris Lu
19b6a16003
changed from os.file to backend.DataStorageBackend
5 years ago
Chris Lu
7a51a9a582
refactor: simplifying to ReadAt() and WriteAt()
5 years ago
Chris Lu
46ed2ca902
refactoring
5 years ago
Chris Lu
c9a183eb69
refactor memory map related code
5 years ago
Chris Lu
faec9076a4
adjust parameter names
5 years ago
j.laycock
eb27c2b037
Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size.
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
63acc8c972
rename mem_buffer to mBuffer
5 years ago
Tom Maxwell
4a878c0006
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
5 years ago
j.laycock
cc756ddd79
Rename End_of_file variable, implement platform indepenent memory_map.go
5 years ago
j.laycock
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
j.laycock
840ccdc35d
Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly
5 years ago
j.laycock
0e5d3b1a70
Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files
5 years ago
Chris Lu
c2960c7a86
defaulting file ttl to volume ttl
fix https://github.com/chrislusf/seaweedfs/issues/992
6 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
302d9fbc6d
adjust error message for file not found
6 years ago
Chris Lu
4f76342cbc
WIP
no errors, but not returning file content
* the interval needs to use actual file zie
* need to read the actual version instead of the current version
6 years ago
Chris Lu
b4b407e403
add grpc ec shard read
6 years ago
Wine93
32f93fb09e
style: go fmt for all
6 years ago
stlpmo-jn
2200ea9cb9
add function ParseFileIdFromString
6 years ago