liubaojiang
25471d579a
add md5 header when UploadData to replication in ReplicatedWrite ( #3881 )
2 years ago
chrislu
4af8c427eb
refactor
2 years ago
chrislu
4a4ef3cc3c
upload_content: upload close response.Body
2 years ago
chrislu
3d8b8ffced
refactor
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
649555b223
adjust log
2 years ago
chrislu
a3553da7f7
add fileId to UploadWithRetry return result
2 years ago
chrislu
d49d0a9fc2
filer.copy: retryable upload
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
Konstantin Lebedev
22181dd018
refactor FilerRequest metrics ( #3402 )
* refactor FilerRequest metrics
* avoid double count proxy
* defer to
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
c2e7d663bc
reduced the timeout for creating a connection from 30 to 10 seconds
3 years ago
banjiaojuhao
fc3b75f2f8
weed/operation/delete_content.go: nil pointer dereference
3 years ago
chrislu
4de060daa6
mount: skip special character in the filenames
fix https://github.com/chrislusf/seaweedfs/issues/2559
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
banjiaojuhao
08336be92e
filer server: allow upload file to specific dataNode
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
e6ef7b2387
return error early
fix https://github.com/chrislusf/seaweedfs/issues/2370
3 years ago
Chris Lu
2789d10342
go fmt
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
0207f5fe9b
replicated remote.cache
3 years ago
Chris Lu
0128239c0f
handle ipv6 addresses
3 years ago
Chris Lu
3adc3da291
refactor
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
e93d4935e3
add other replica locations when assigning volumes
3 years ago
Chris Lu
5a0f92423e
use grpc and jwt
3 years ago
Chris Lu
d1d1fc772c
move some volume lookup operations to grpc
jwt related lookup will come in next commit
3 years ago
Chris Lu
69a6da7969
avoid fail on tail error
3 years ago
Chris Lu
5c14da0f1e
filer.copy: fail early if assign request failed
fix https://github.com/chrislusf/seaweedfs/issues/2216
3 years ago
Chris Lu
4d0cbd2700
skip cookie checking if from grpc api
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
2acf6be24e
resend the http request if connection is stale
4 years ago
qieqieplus
270645f8d7
fix #1996
4 years ago
Chris Lu
f62c153274
go fmt
4 years ago
Chris Lu
3be061994f
skip connection reset error
fix https://github.com/chrislusf/seaweedfs/issues/1971
this is because the connections are pooled but the volume server has reset the connection
4 years ago
Chris Lu
319743d330
go fmt
4 years ago
Chris Lu
7e8edc3c4a
refactoring
4 years ago
Chris Lu
cefe66f159
dedicated upload processor
avoid thundering effect of overloading volume servers
4 years ago
Chris Lu
1f984d2645
refactor buffer pool
4 years ago
Chris Lu
3b2a9c98ef
fix nil
4 years ago
Chris Lu
df72dc206d
stats collect chunk upload retry count
4 years ago
Chris Lu
44bdfb2d15
filer: avoid encryption and compression at the same time
fix https://github.com/chrislusf/seaweedfs/issues/1828
4 years ago
bingoohuang
eab6e31d34
use backticks instead of double quotes to avoid escaped additionally in regex
4 years ago
Chris Lu
3575d41009
go fmt
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
dd9f3a0104
add sleep between upload retries
4 years ago
Chris Lu
487e435679
adjust http max idle connections per host
related to https://github.com/chrislusf/seaweedfs/issues/1802
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
4b5adc60b4
upload result changes to the right output variable
4 years ago