Konstantin Lebedev
f8ef25099c
Removing chunks on failed to write to replicas ( #3591 )
* Removing chunks on failed to write to replicas
https://github.com/seaweedfs/seaweedfs/issues/3578
* put with in the util.Retry
* just purge on any errors
2 years ago
Konstantin Lebedev
90d55cd179
avoid data race read fileChunksSize ( #3570 )
https://github.com/seaweedfs/seaweedfs/issues/3557
2 years ago
Konstantin Lebedev
105702ebe0
avoid data race access to uploadReaderToChunks.uploadErr ( #3550 )
avoid data race access to uploadErr
https://github.com/seaweedfs/seaweedfs/issues/3549
2 years ago
chrislu
3741779144
minor
2 years ago
chrislu
580a7fa685
adjust for data race
fix https://github.com/seaweedfs/seaweedfs/issues/3512
2 years ago
chrislu
fef9c6a520
filer: do not always save files in "/etc" folder to filer store
fix https://github.com/seaweedfs/seaweedfs/issues/3476
2 years ago
chrislu
28b862f45f
use util.Retry to retry
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
Konstantin Lebedev
22181dd018
refactor FilerRequest metrics ( #3402 )
* refactor FilerRequest metrics
* avoid double count proxy
* defer to
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
justin
3551ca2fcf
enhancement: replace sort.Slice with slices.SortFunc to reduce reflection
3 years ago
banjiaojuhao
f28dbbe5c5
[bugfix] filer: 1. Delete uploaded chunks when upload failed. 2. Report error when upload is interrupted by user.
3 years ago
chrislu
bb0b784544
minor
3 years ago
banjiaojuhao
71f3046841
filer: add back isAppend function
3 years ago
banjiaojuhao
6ab09e9071
filer_http: support uploading file with offset
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
18c40686d9
s3: multipart upload miss data if file is chunked in 4MB
fix https://github.com/chrislusf/seaweedfs/issues/2195
3 years ago
Chris Lu
da7bd62822
/etc files are stored inside metadata store
4 years ago
Chris Lu
5e6dfbc25f
locks for data racing
4 years ago
Chris Lu
452c6ef183
limits concurrent uploads for one file
4 years ago
Chris Lu
8295e2feb6
skip md5 checking for now because of race condition
4 years ago
Chris Lu
19caeb7b02
fix writing the small file
4 years ago
Chris Lu
bb45dea15a
filer: parallel data upload
4 years ago
Chris Lu
44f1ba6894
refactor
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Chris Lu
c899bdf063
a little optimization
4 years ago
Chris Lu
3eb336e0b0
report error only for the first multipart upload
the glog.Errorf would always print for s3 multipart uploads
4 years ago
Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
0b82edc0d2
filer: avoid stuck uploader
fix https://github.com/chrislusf/seaweedfs/issues/1980
reverting the file upload batch executor
4 years ago
Chris Lu
2327c0756b
fix to avoid loop
4 years ago
Chris Lu
c131764c34
ensure error is sent back in channel
fix https://github.com/chrislusf/seaweedfs/issues/1966
avoid shared readErr variable
4 years ago
Chris Lu
8251d1140e
refactor
4 years ago
Chris Lu
67e019d54b
add missing changes
4 years ago
Chris Lu
7e8edc3c4a
refactoring
4 years ago
Chris Lu
cefe66f159
dedicated upload processor
avoid thundering effect of overloading volume servers
4 years ago
Chris Lu
b5880334fc
refactor
4 years ago