bernardx
228b133afa
new 'concurrency' parameter for filer.sync ( #3579 )
Co-authored-by: XIAOYQ <xiaoyq@eudic.net>
2 years ago
qzh
7fcfaf7bc9
fix(filer.sync): offset may be set to 0 ( #3451 )
* fix(filer.sync): initializing the offset is related to the path
* fix(filer.sync): the offset maybe to be set to 0.
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
qzh
400f0c3e5d
fix(filer.sync): initializing the offset is related to the path ( #3450 )
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
chrislu
67814a5c79
refactor and fix strings.Split
2 years ago
chrislu
1a4bf0dcb5
filer.sync: parallelize the filer.sync
2 years ago
chrislu
0e9478488d
filer.sync: fix when excluded paths is empty
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
7e09a548a6
exclude directories to sync on filer
2 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
chrislu
4a65159250
fix reading time
3 years ago
zhihao.qu
4d0d1848c6
fix(filer.sync): modify clientName format : from -> to
3 years ago
zhihao.qu
42d04c581b
feat(filer.sync): add metricsServer in filer.sync.
Metrics include:
(1) the offset of the filer.sync
(2) the last send timestamp of the filer subscription
3 years ago
zhihao.qu
14d82c3dea
feat(filer.sync): add offset to path.
3 years ago
zhihao.qu
cd5cca36a4
feat(filer.sync): add fromTsMs. Extract signature from doSubscribeFilerMetaChanges
3 years ago
creeew
02ae102731
fix filer.sync missing source srv uploaded files to target when target down
3 years ago
chrislu
a2b101a737
subscribe metadata between a range
3 years ago
chrislu
1384529eb7
Fix filer.backup deletes files in backup folder in incremental mode
fix https://github.com/chrislusf/seaweedfs/issues/2919
3 years ago
chrislu
202a29d014
refactoring
3 years ago
chrislu
6a12520a96
fix logging
3 years ago
chrislu
5c87fcc6d2
add client id for all metadata listening clients
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
8e125339d5
line wrap
3 years ago
Chris Lu
68ea99190f
add additionalPathPrefixes
3 years ago
Chris Lu
c5f38c365d
go fmt
3 years ago
Chris Lu
df85f7a1eb
adjust help message
3 years ago
Chris Lu
6b743dbbf9
refactor client subscribe metadata
3 years ago
Chris Lu
3afbf04007
add TLS grpc support for filer meta clients
3 years ago
Chris Lu
c2e0a75c1f
adjust logs
4 years ago
Chris Lu
2d7b4e5bb6
filer.backup: escape colon from path on windows
fix https://github.com/chrislusf/seaweedfs/issues/2084
4 years ago
Chris Lu
e52c94640e
filer.backup: added to replace filer.replicate
4 years ago
Chris Lu
62191b08ea
disk type support custom tags
4 years ago
Chris Lu
0bc3a1f9e8
disk type only supports hdd and ssd, not ready for random tags yet
4 years ago
Chris Lu
ef76365ec2
adjust help message
4 years ago
Chris Lu
d475c89fcc
go fmt
4 years ago
Chris Lu
cc1f3907ff
filer.sync: default filerProxy to true
4 years ago
Chris Lu
80b8692688
filer.sync: replicate outside of either cluster, only need to see filers
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
8baba93fce
rename parameter name to "disk"
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
684a875876
update help message
4 years ago
Chris Lu
446e476a11
go fmt
4 years ago
Chris Lu
7f69acd1f2
sync pprof
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago