Numblgw
aebf3952b7
filer sync: source path and exclude path support dir suffix ( #6268 )
filer sync: source path and exclude paht support dir suffix
Co-authored-by: liguowei <liguowei@xinye.com>
1 month ago
Max Denushev
a5fe6e21bc
feat(filer.backup): add ignore errors option ( #6235 )
* feat(filer.backup): add ignore errors option
* feat(filer.backup): fix 404 error wrap
* feat(filer.backup): fix wrapping function
* feat(filer.backup): fix wrapping errors in genProcessFunction
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
---------
Co-authored-by: Max Denushev <denushev@tochka.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 month ago
chrislu
19d14b4c71
minor
5 months ago
vadimartynov
b796c21fa9
Added loadSecurityConfigOnce ( #5792 )
5 months ago
chrislu
3a82f5ffad
ensure metadata follow a specific folder
fix https://github.com/seaweedfs/seaweedfs/issues/5774
5 months ago
Konstantin Lebedev
d821cb3b18
fix: sync without dir /buckets/some/.uploads/hash_hash ( #5402 )
9 months ago
chrislu
83e4b02517
fix
11 months ago
chrislu
15b66a6633
refactor
11 months ago
XIAOYQ
be166b434f
fix: skip s3 .uploads
11 months ago
Konstantin Lebedev
8d23e36c45
fix: doDeleteFiles deletes files ( #5198 )
12 months ago
Konstantin Lebedev
1169f94310
Fix filer sync set offset ( #5197 )
* fix: compose 2mount with sync
* fix: DATA RACE
https://github.com/seaweedfs/seaweedfs/issues/5194
https://github.com/seaweedfs/seaweedfs/issues/5195
12 months ago
Konstantin Lebedev
b9d32d32e1
chore: filer sync add doDeleteFiles option for create only mode ( #5166 )
12 months ago
Konstantin Lebedev
2b229e98ce
fix: add doDeleteFile option for filer backup
1 year ago
Konstantin Lebedev
3c5295a1a6
filer backup add option for exclude file names that match the regexp to sync on filer
1 year ago
chrislu
5db9fcccd4
refactoring
2 years ago
chrislu
81fdf3651b
grpc connection to filer add sw-client-id header
2 years ago
chrislu
8a40fa8993
more detailed logs
2 years ago
Jiffs Maverick
4b0430e71d
[metrics] Add the ability to control bind ip ( #4012 )
2 years ago
chrislu
21c0587900
go fmt
2 years ago
Ryan Russell
2c92a9ff74
refactor: `DefaultConcurrencyLimit` var rename ( #3658 )
2 years ago
bernardx
228b133afa
new 'concurrency' parameter for filer.sync ( #3579 )
Co-authored-by: XIAOYQ <xiaoyq@eudic.net>
2 years ago
qzh
7fcfaf7bc9
fix(filer.sync): offset may be set to 0 ( #3451 )
* fix(filer.sync): initializing the offset is related to the path
* fix(filer.sync): the offset maybe to be set to 0.
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
qzh
400f0c3e5d
fix(filer.sync): initializing the offset is related to the path ( #3450 )
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
chrislu
67814a5c79
refactor and fix strings.Split
2 years ago
chrislu
1a4bf0dcb5
filer.sync: parallelize the filer.sync
2 years ago
chrislu
0e9478488d
filer.sync: fix when excluded paths is empty
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
7e09a548a6
exclude directories to sync on filer
2 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
chrislu
4a65159250
fix reading time
3 years ago
zhihao.qu
4d0d1848c6
fix(filer.sync): modify clientName format : from -> to
3 years ago
zhihao.qu
42d04c581b
feat(filer.sync): add metricsServer in filer.sync.
Metrics include:
(1) the offset of the filer.sync
(2) the last send timestamp of the filer subscription
3 years ago
zhihao.qu
14d82c3dea
feat(filer.sync): add offset to path.
3 years ago
zhihao.qu
cd5cca36a4
feat(filer.sync): add fromTsMs. Extract signature from doSubscribeFilerMetaChanges
3 years ago
creeew
02ae102731
fix filer.sync missing source srv uploaded files to target when target down
3 years ago
chrislu
a2b101a737
subscribe metadata between a range
3 years ago
chrislu
1384529eb7
Fix filer.backup deletes files in backup folder in incremental mode
fix https://github.com/chrislusf/seaweedfs/issues/2919
3 years ago
chrislu
202a29d014
refactoring
3 years ago
chrislu
6a12520a96
fix logging
3 years ago
chrislu
5c87fcc6d2
add client id for all metadata listening clients
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
8e125339d5
line wrap
3 years ago
Chris Lu
68ea99190f
add additionalPathPrefixes
3 years ago
Chris Lu
c5f38c365d
go fmt
3 years ago
Chris Lu
df85f7a1eb
adjust help message
3 years ago
Chris Lu
6b743dbbf9
refactor client subscribe metadata
3 years ago
Chris Lu
3afbf04007
add TLS grpc support for filer meta clients
3 years ago
Chris Lu
c2e0a75c1f
adjust logs
4 years ago
Chris Lu
2d7b4e5bb6
filer.backup: escape colon from path on windows
fix https://github.com/chrislusf/seaweedfs/issues/2084
4 years ago