Chris Lu
3adc3da291
refactor
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
2acf6be24e
resend the http request if connection is stale
4 years ago
Chris Lu
f62c153274
go fmt
4 years ago
Chris Lu
3be061994f
skip connection reset error
fix https://github.com/chrislusf/seaweedfs/issues/1971
this is because the connections are pooled but the volume server has reset the connection
4 years ago
Chris Lu
1f984d2645
refactor buffer pool
4 years ago
Chris Lu
3b2a9c98ef
fix nil
4 years ago
Chris Lu
df72dc206d
stats collect chunk upload retry count
4 years ago
Chris Lu
44bdfb2d15
filer: avoid encryption and compression at the same time
fix https://github.com/chrislusf/seaweedfs/issues/1828
4 years ago
bingoohuang
eab6e31d34
use backticks instead of double quotes to avoid escaped additionally in regex
4 years ago
Chris Lu
3575d41009
go fmt
4 years ago
Chris Lu
dd9f3a0104
add sleep between upload retries
4 years ago
Chris Lu
487e435679
adjust http max idle connections per host
related to https://github.com/chrislusf/seaweedfs/issues/1802
4 years ago
Chris Lu
a29abd8600
add a {X-,}Idempotency-Key header for http POST
fix https://github.com/chrislusf/seaweedfs/issues/1592
according to https://github.com/golang/go/issues/19943
4 years ago
Chris Lu
8708e7a64d
print out data size
4 years ago
Chris Lu
0ecff9521d
avoid []byte reuse
4 years ago
Chris Lu
031aa70da6
Revert "revert bytebufferpool, seems problematic"
This reverts commit e0fcab47c0
.
4 years ago
Chris Lu
e0fcab47c0
revert bytebufferpool, seems problematic
4 years ago
Chris Lu
c057dd1f64
add back upload retries
4 years ago
Chris Lu
19772d70d7
print for debugging
4 years ago
Chris Lu
ef9c32ea0d
adjust compression threshold
4 years ago
Chris Lu
29c9fa2ef2
byte buffer for uploading
4 years ago
Chris Lu
2579edbc60
fix bug found by tests
4 years ago
Chris Lu
e0c8507d93
memory pool to reduce memory allocation
4 years ago
Chris Lu
c31b254248
mount: shortcut when there is only one chunk
4 years ago
Chris Lu
f64252023e
Revert "a better byte buffer pool"
This reverts commit 59c6422777
.
4 years ago
Chris Lu
59c6422777
a better byte buffer pool
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
50f7e2e89f
add log messages
4 years ago
Chris Lu
5f55a87101
close http response
4 years ago
Chris Lu
0b301b0b47
consume all response body in order to release requests
4 years ago
Chris Lu
003d48da21
adjust logs
4 years ago
Chris Lu
83cad3da79
add retry file upload
4 years ago
Chris Lu
20e2ac1add
filer: store md5 metadata for files uploaded by filer
fix https://github.com/chrislusf/seaweedfs/issues/1412
4 years ago
Chris Lu
bbc8ae110f
report errors
5 years ago
Chris Lu
2ff37ccdbd
testing parsing the upload
The mime type is always the value passed in.
Compress or not depends on the content detection, file name extension, and compression ratio.
If the content is already compressed, need to know the content size.
5 years ago
Chris Lu
fe60db404a
prepare for zstd
5 years ago
Chris Lu
3080c197e3
rename UnCompressData to DecompressData
5 years ago
Chris Lu
97239ce6f1
rename filechunk is_gzipped to is_compressed
5 years ago
Chris Lu
e912fd15e3
renaming
5 years ago
Chris Lu
16fe132a20
detect mime type before replicating to other volume servers
5 years ago
Chris Lu
871efa4fc1
refactoring
some previous chunk etag was using md5, which should be wrong.
5 years ago
Chris Lu
9cacaf5eca
better detect file mime type
5 years ago
Chris Lu
3f1d79512f
only detect when not sure about the types
5 years ago
Chris Lu
d2d1597850
volume: detect gzip effectiveness only when content type is empty
revert part of 2286eda575
5 years ago
Chris Lu
8a73276602
refactor a bit
5 years ago
Chris Lu
eedd33dda3
refactoring
5 years ago
Chris Lu
e1911760a7
refactoring
5 years ago
Chris Lu
2286eda575
sampling whether the data can be gzipped
5 years ago