chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
04663c3611
remote.mount: print out metadata sync errors
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
2789d10342
go fmt
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
53b9b521c9
adjust error message
3 years ago
Chris Lu
da49d25950
auto list of storage types
3 years ago
Chris Lu
bbc77f7af4
fix compilation
3 years ago
Chris Lu
0652805236
cloud drive: add createBucket() deleteBucket()
3 years ago
Chris Lu
83cd0fc739
cloud drive: add list buckets
3 years ago
Chris Lu
fbfc90fd1e
adjust formatting remote location
3 years ago
Chris Lu
bca4a9de78
simplify
3 years ago
Chris Lu
958125bd02
conforming to http user agent common practice
3 years ago
Chris Lu
7ce97b59d8
go fmt
3 years ago
Chris Lu
3bd48c4f29
filer.remote.sync: exit when directory is unmounted
this will not propagate the deletions back to the cloud
3 years ago
Chris Lu
3faaa6e360
ensure cached client with updated storage conf
3 years ago
Chris Lu
1dfcdc53b7
cloud drive: add storj, filebase
3 years ago
Chris Lu
701cc133f3
cloud drive: s3 add option for v4 signature
3 years ago
Chris Lu
eacaa44dc2
refactor
3 years ago
Chris Lu
a31f2907f0
cloud drive: filer.remote.sync supports remove folder
3 years ago
Chris Lu
001a472057
cloud mount: remote storage support hdfs
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
c08ac536ed
cloud drive: add support for Wasabi
* disable md5, sha256 checking to avoid reading one chunk twice
* single threaded upload to avoid chunk swapping (to be enhanced later)
3 years ago
Chris Lu
a7a914f120
cloud drive: add support for Baidu BOS
3 years ago
Chris Lu
c6c97bd83d
add default env variables
3 years ago
Chris Lu
a19c728034
cloud drive: add support for Tencent COS
3 years ago
Chris Lu
19a81d25af
cloud drive: add support for Aliyun OSS
3 years ago
Chris Lu
47d775cf68
cloud drive: add support for BackBlaze
3 years ago
Chris Lu
e9ebe24f2e
cloud drive: add support for Azure
3 years ago
Chris Lu
a78d0227cd
adjust package name
3 years ago
Chris Lu
12631a3f5b
cloud drive: gcs simplify a little bit
3 years ago
Chris Lu
00c4e06caa
cloud drive: s3 configurable force path style
3 years ago
Chris Lu
f0cc130849
do not force path style for better compatibility
3 years ago
Chris Lu
2836a58d87
cloud drive: S3 supports storage class
3 years ago
Chris Lu
95e2b83ca5
fix format
3 years ago
Chris Lu
258063de26
cloud drive: add google cloud storage
3 years ago
Chris Lu
5a7c40510f
format output
3 years ago
Chris Lu
c45c12aedc
metadata updates
3 years ago
Chris Lu
507411bdf0
fix https://github.com/chrislusf/seaweedfs/issues/2260
fix https://github.com/chrislusf/seaweedfs/issues/2260
3 years ago
Chris Lu
9462f5129a
shell: add "remote.meta.sync"
3 years ago
Chris Lu
713c035a6e
shell: remote.cache remote.uncache
3 years ago
Chris Lu
c5f38c365d
go fmt
3 years ago
Chris Lu
7412ccdf88
write back remote entry to local entry after uploading to remote
3 years ago
Chris Lu
13e45e1605
filer.remote.sync can work now
3 years ago
Chris Lu
6b743dbbf9
refactor client subscribe metadata
3 years ago
Chris Lu
b9ecf1e3a8
refacotring
3 years ago
Chris Lu
d84c311699
refactoring
3 years ago
Chris Lu
9df7d16791
read <- remote_storage
3 years ago
Chris Lu
899963ac20
remote storage location changed to struct
3 years ago
Chris Lu
c090d6bb25
add ReadRemote(), add read remote setup when filer starts
3 years ago