Konstantin Lebedev
301b678147
[volume] Add new volumes to HUP(reload) signal ( #3755 )
Add new volumes to HUP(reload) signal
2 years ago
Konstantin Lebedev
7ae51d1ec6
fix set master options for single server ( #3708 )
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
chrislu
10d5b4b32b
volume server: rename readBufferSize to readBufferSizeMB
2 years ago
famosss
d949a238b8
volume: add "readBufSize" option to customize read optimization ( #3702 )
* simplify a bit
* feat: volume: add "readBufSize" option to customize read optimization
* refactor : redbufSIze -> readBufferSize
* simplify a bit
* simplify a bit
2 years ago
chrislu
cf90f76a35
mark "hasSlowRead" as experimental
2 years ago
chrislu
896a85d6e4
volume: add "hasSlowRead" option to customize read optimization
2 years ago
Ryan Russell
f6d391c9da
docs(command): readability fixes ( #3686 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
21c0587900
go fmt
2 years ago
Ryan Russell
8efe1db01a
refactor(various): `Listner` -> `Listener` readability improvements ( #3672 )
* refactor(net_timeout): `listner` -> `listener`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(s3): `s3ApiLocalListner` -> `s3ApiLocalListener`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(filer): `localPublicListner` -> `localPublicListener`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(command): `masterLocalListner` -> `masterLocalListener`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(net_timeout): `ipListner` -> `ipListener`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
19652c1b83
refactor(socket mount): Update socket mount pattern to `/tmp/seaweedf… ( #3662 )
2 years ago
Ryan Russell
b6a1b84a00
docs: `orignial` -> `original` ( #3661 )
2 years ago
LHHDZ
6d2000e8da
fix 'localFilerSocket' nil pointer ( #3654 )
2 years ago
Ryan Russell
2c92a9ff74
refactor: `DefaultConcurrencyLimit` var rename ( #3658 )
2 years ago
Ryan Russell
60fa26ef45
refactor: `concurrentFiles` and `concurrentChunks` var name fix ( #3655 )
2 years ago
chrislu
b834027c5a
refactor
2 years ago
chrislu
2c6b68b40e
simplify a bit
2 years ago
Konstantin Lebedev
b64674018a
[sync] override amz storage class, None to delete ( #3639 )
* override amz storage class, None to delete
https://github.com/seaweedfs/seaweedfs/issues/3636
* use empty string to delete
* without nil check
2 years ago
chrislu
205ecb5d03
skip directories under ".uploads" directory
related to https://github.com/seaweedfs/seaweedfs/issues/3636
skipping all directories under ".uploads" directory.
2 years ago
chrislu
9b084d4c88
purge tcp implementation
2 years ago
Konstantin Lebedev
f4f6855c61
avoid SIGSEGV on localFilerSocket ( #3609 )
https://github.com/seaweedfs/seaweedfs/issues/3607
2 years ago
bernardx
228b133afa
new 'concurrency' parameter for filer.sync ( #3579 )
Co-authored-by: XIAOYQ <xiaoyq@eudic.net>
2 years ago
Konstantin Lebedev
8c3040db81
avoid DATA RACE on S3Options.localFilerSocket ( #3571 )
* avoid DATA RACE on S3Options.localFilerSocket
https://github.com/seaweedfs/seaweedfs/issues/3552
* copy localSocket
2 years ago
chrislu
bcf35876d1
add more logs
2 years ago
chrislu
3d8b8ffced
refactor
2 years ago
Konstantin Lebedev
903a06a160
avoid data race access to startDelay ( #3548 )
2 years ago
chrislu
3f3a1341d8
make CodeQL happy
2 years ago
chrislu
7394f7feee
minor: adjust ordering
2 years ago
chrislu
dbf0de4ce1
minor clean up
2 years ago
Patrick Schmidt
7b424a54dc
Add raft server access mutex to avoid races ( #3503 )
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
7ea2c24c5d
metadata processing use retry instead of retryForEver
2 years ago
chrislu
b4131a3a72
filer.remote.sync: parallelize uploading to remove object storage
2 years ago
chrislu
f6b92b8561
refactor
2 years ago
chrislu
973f6dd162
refactoring
2 years ago
chrislu
6c8822f269
filer.copy: retryable file part upload
2 years ago
chrislu
a3553da7f7
add fileId to UploadWithRetry return result
2 years ago
chrislu
d49d0a9fc2
filer.copy: retryable upload
2 years ago
chrislu
689b4ecdcc
remove unused collection and replication from upload result
2 years ago
chrislu
9f50b310a0
remove unused code
2 years ago
chrislu
2b580a7566
also migrate jsonpb
2 years ago
chrislu
eaeb141b09
move proto package
2 years ago
qzh
7fcfaf7bc9
fix(filer.sync): offset may be set to 0 ( #3451 )
* fix(filer.sync): initializing the offset is related to the path
* fix(filer.sync): the offset maybe to be set to 0.
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
qzh
400f0c3e5d
fix(filer.sync): initializing the offset is related to the path ( #3450 )
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
chrislu
67814a5c79
refactor and fix strings.Split
2 years ago
chrislu
1a4bf0dcb5
filer.sync: parallelize the filer.sync
2 years ago
chrislu
0e9478488d
filer.sync: fix when excluded paths is empty
2 years ago
LHHDZ
84ec68e11a
Add download speed limit support ( #3408 )
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
Patrick Schmidt
1a4a36d510
Add healthy indicator for raft status
2 years ago
chrislu
0423d50106
wip note
2 years ago