chrislu
|
b834027c5a
|
refactor
|
2 years ago |
chrislu
|
2c6b68b40e
|
simplify a bit
|
2 years ago |
Konstantin Lebedev
|
b64674018a
|
[sync] override amz storage class, None to delete (#3639)
* override amz storage class, None to delete
https://github.com/seaweedfs/seaweedfs/issues/3636
* use empty string to delete
* without nil check
|
2 years ago |
chrislu
|
205ecb5d03
|
skip directories under ".uploads" directory
related to https://github.com/seaweedfs/seaweedfs/issues/3636
skipping all directories under ".uploads" directory.
|
2 years ago |
chrislu
|
b4131a3a72
|
filer.remote.sync: parallelize uploading to remove object storage
|
2 years ago |
chrislu
|
eaeb141b09
|
move proto package
|
2 years ago |
chrislu
|
26dbc6c905
|
move to https://github.com/seaweedfs/seaweedfs
|
2 years ago |
chrislu
|
64f3d6fb6e
|
metadata subscription uses client epoch
|
2 years ago |
creeew
|
02ae102731
|
fix filer.sync missing source srv uploaded files to target when target down
|
3 years ago |
chrislu
|
a2b101a737
|
subscribe metadata between a range
|
3 years ago |
chrislu
|
202a29d014
|
refactoring
|
3 years ago |
chrislu
|
5c87fcc6d2
|
add client id for all metadata listening clients
|
3 years ago |
chrislu
|
9f9ef1340c
|
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
|
3 years ago |
Chris Lu
|
ad16221a35
|
adjust error log
|
3 years ago |
Chris Lu
|
cf1586a34d
|
add logs for writing to remote file
|
3 years ago |
Chris Lu
|
6c27845be0
|
add retries when writing to remote s3
fix https://github.com/chrislusf/seaweedfs/issues/2465
|
3 years ago |
Chris Lu
|
63da4bbb54
|
separate filer.remote.gateway command to avoid confusion
|
3 years ago |
Chris Lu
|
e5fc35ed0c
|
change server address from string to a type
|
3 years ago |
Chris Lu
|
98c68d7a79
|
filer.remote.sync fix upload logic
|
3 years ago |
Chris Lu
|
796b2eb929
|
remember sync time
|
3 years ago |
Chris Lu
|
4b28c5f6c3
|
filer.remote.sync: split into buckets mode and single directory mode
|
3 years ago |
Chris Lu
|
03a31587ce
|
go fmt
|
3 years ago |
Chris Lu
|
7f2a8246a9
|
minor
|
3 years ago |
Chris Lu
|
9a73b0e3c9
|
refactor
|
3 years ago |
Chris Lu
|
e281f0fa82
|
refactor
|
3 years ago |
Chris Lu
|
7ce97b59d8
|
go fmt
|
3 years ago |
Chris Lu
|
3bd48c4f29
|
filer.remote.sync: exit when directory is unmounted
this will not propagate the deletions back to the cloud
|
3 years ago |
Chris Lu
|
8e125339d5
|
line wrap
|
3 years ago |
Chris Lu
|
68ea99190f
|
add additionalPathPrefixes
|
3 years ago |
Chris Lu
|
a31f2907f0
|
cloud drive: filer.remote.sync supports remove folder
|
3 years ago |
Chris Lu
|
05d2774117
|
refactoring
|
3 years ago |
Chris Lu
|
a9b41900d8
|
handle cases when mounted directory does not exist
|
3 years ago |
Chris Lu
|
05a648bb96
|
refactor: separating out remote.proto
|
3 years ago |
Chris Lu
|
72eb6d5b9d
|
ensure no writes to remote storage if content is not changed
|
3 years ago |
Chris Lu
|
5a7c40510f
|
format output
|
3 years ago |
Chris Lu
|
5d5a21ba2d
|
adjust log format
|
3 years ago |
Chris Lu
|
c45c12aedc
|
metadata updates
|
3 years ago |
Chris Lu
|
49b5e47bd1
|
retry forever with filer.remote.sync, and some refactoring
|
3 years ago |
Chris Lu
|
c34747c79d
|
rename, fix wrong logic.
|
3 years ago |
Chris Lu
|
713c035a6e
|
shell: remote.cache remote.uncache
|
3 years ago |
Chris Lu
|
c5f38c365d
|
go fmt
|
3 years ago |
Chris Lu
|
df85f7a1eb
|
adjust help message
|
3 years ago |
Chris Lu
|
7412ccdf88
|
write back remote entry to local entry after uploading to remote
|
3 years ago |
Chris Lu
|
dcf614a8c3
|
skip if the remote entry update is because of internal managerial operations
|
3 years ago |
Chris Lu
|
13e45e1605
|
filer.remote.sync can work now
|
3 years ago |