Chris Lu
5a0f92423e
use grpc and jwt
3 years ago
Chris Lu
d1d1fc772c
move some volume lookup operations to grpc
jwt related lookup will come in next commit
3 years ago
Chris Lu
69a6da7969
avoid fail on tail error
3 years ago
Chris Lu
5c14da0f1e
filer.copy: fail early if assign request failed
fix https://github.com/chrislusf/seaweedfs/issues/2216
3 years ago
Chris Lu
4d0cbd2700
skip cookie checking if from grpc api
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
2acf6be24e
resend the http request if connection is stale
4 years ago
qieqieplus
270645f8d7
fix #1996
4 years ago
Chris Lu
f62c153274
go fmt
4 years ago
Chris Lu
3be061994f
skip connection reset error
fix https://github.com/chrislusf/seaweedfs/issues/1971
this is because the connections are pooled but the volume server has reset the connection
4 years ago
Chris Lu
319743d330
go fmt
4 years ago
Chris Lu
7e8edc3c4a
refactoring
4 years ago
Chris Lu
cefe66f159
dedicated upload processor
avoid thundering effect of overloading volume servers
4 years ago
Chris Lu
1f984d2645
refactor buffer pool
4 years ago
Chris Lu
3b2a9c98ef
fix nil
4 years ago
Chris Lu
df72dc206d
stats collect chunk upload retry count
4 years ago
Chris Lu
44bdfb2d15
filer: avoid encryption and compression at the same time
fix https://github.com/chrislusf/seaweedfs/issues/1828
4 years ago
bingoohuang
eab6e31d34
use backticks instead of double quotes to avoid escaped additionally in regex
4 years ago
Chris Lu
3575d41009
go fmt
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
dd9f3a0104
add sleep between upload retries
4 years ago
Chris Lu
487e435679
adjust http max idle connections per host
related to https://github.com/chrislusf/seaweedfs/issues/1802
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
4b5adc60b4
upload result changes to the right output variable
4 years ago
Chris Lu
3433accb1b
weed upload: add TTL
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
0da7ecfd29
go fmt
4 years ago
Chris Lu
92f906b6fc
remove zstd
fix https://github.com/chrislusf/seaweedfs/issues/1629
4 years ago
Chris Lu
dc304342b2
fs.configure: configurable volume growth
4 years ago
Chris Lu
b04375a3d1
use alternative assign request
4 years ago
Chris Lu
0ea5c087ce
go fmt
4 years ago
Chris Lu
95c0de285d
refactoring
4 years ago
Chris Lu
a29abd8600
add a {X-,}Idempotency-Key header for http POST
fix https://github.com/chrislusf/seaweedfs/issues/1592
according to https://github.com/golang/go/issues/19943
4 years ago
Chris Lu
8708e7a64d
print out data size
4 years ago
Chris Lu
0ecff9521d
avoid []byte reuse
4 years ago
Chris Lu
031aa70da6
Revert "revert bytebufferpool, seems problematic"
This reverts commit e0fcab47c0
.
4 years ago
Chris Lu
e0fcab47c0
revert bytebufferpool, seems problematic
4 years ago
Chris Lu
c057dd1f64
add back upload retries
4 years ago
Chris Lu
19772d70d7
print for debugging
4 years ago
Chris Lu
ef9c32ea0d
adjust compression threshold
4 years ago
Chris Lu
29c9fa2ef2
byte buffer for uploading
4 years ago
Chris Lu
2579edbc60
fix bug found by tests
4 years ago
Chris Lu
e0c8507d93
memory pool to reduce memory allocation
4 years ago
Chris Lu
c31b254248
mount: shortcut when there is only one chunk
4 years ago
Chris Lu
f64252023e
Revert "a better byte buffer pool"
This reverts commit 59c6422777
.
4 years ago
Chris Lu
59c6422777
a better byte buffer pool
4 years ago
Chris Lu
35f6518c36
weed upload: usePublicUrl was not being used on big files
fix https://github.com/chrislusf/seaweedfs/issues/1492
4 years ago