Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
18c40686d9
s3: multipart upload miss data if file is chunked in 4MB
fix https://github.com/chrislusf/seaweedfs/issues/2195
3 years ago
Chris Lu
da7bd62822
/etc files are stored inside metadata store
4 years ago
Chris Lu
5e6dfbc25f
locks for data racing
4 years ago
Chris Lu
452c6ef183
limits concurrent uploads for one file
4 years ago
Chris Lu
8295e2feb6
skip md5 checking for now because of race condition
4 years ago
Chris Lu
19caeb7b02
fix writing the small file
4 years ago
Chris Lu
bb45dea15a
filer: parallel data upload
4 years ago
Chris Lu
44f1ba6894
refactor
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Chris Lu
c899bdf063
a little optimization
4 years ago
Chris Lu
3eb336e0b0
report error only for the first multipart upload
the glog.Errorf would always print for s3 multipart uploads
4 years ago
Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
0b82edc0d2
filer: avoid stuck uploader
fix https://github.com/chrislusf/seaweedfs/issues/1980
reverting the file upload batch executor
4 years ago
Chris Lu
2327c0756b
fix to avoid loop
4 years ago
Chris Lu
c131764c34
ensure error is sent back in channel
fix https://github.com/chrislusf/seaweedfs/issues/1966
avoid shared readErr variable
4 years ago
Chris Lu
8251d1140e
refactor
4 years ago
Chris Lu
67e019d54b
add missing changes
4 years ago
Chris Lu
7e8edc3c4a
refactoring
4 years ago
Chris Lu
cefe66f159
dedicated upload processor
avoid thundering effect of overloading volume servers
4 years ago
Chris Lu
b5880334fc
refactor
4 years ago