chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
ce2af0082e
revert
3 years ago
Chris Lu
1c9f3c7ac0
read deleted chunks when replcating data
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
7ce97b59d8
go fmt
3 years ago
Chris Lu
c08ac536ed
cloud drive: add support for Wasabi
* disable md5, sha256 checking to avoid reading one chunk twice
* single threaded upload to avoid chunk swapping (to be enhanced later)
3 years ago
Chris Lu
7c39a18ba5
update azure library
3 years ago
Chris Lu
00c4e06caa
cloud drive: s3 configurable force path style
3 years ago
Chris Lu
f0cc130849
do not force path style for better compatibility
3 years ago
Chris Lu
0db2517994
go fmt
3 years ago
Chris Lu
5a0f92423e
use grpc and jwt
3 years ago
Chris Lu
99b599aa8a
remote.mount
3 years ago
Chris Lu
7359193e97
go fmt
3 years ago
Chris Lu
7ab389e7ec
optimization: improve random range query for large files
3 years ago
Chris Lu
450222dd64
add remote to filer.Entry and filer_pb entry, add RemoteConf
3 years ago
Chris Lu
45bffc92a8
filer.backup: fix cloud sinks when updating entry
4 years ago
Chris Lu
921e0d5008
remove verbose log
4 years ago
Chris Lu
1a70cb9b63
local sink: write and update files
fix issues with https://github.com/chrislusf/seaweedfs/issues/2084
4 years ago
Chris Lu
dce1f02c9e
filer.backup: backup to local directory optionally is incremental
fixed one issue with https://github.com/chrislusf/seaweedfs/issues/2084
4 years ago
Chris Lu
8f8738867f
add retry to assign volume
fix https://github.com/chrislusf/seaweedfs/issues/2056
4 years ago
Chris Lu
4b1ed227d1
revert fasthttp changes
related to https://github.com/chrislusf/seaweedfs/issues/1907
4 years ago
Konstantin Lebedev
7194a5e7bf
avoid http error: superfluous response.WriteHeader
https://github.com/chrislusf/seaweedfs/issues/1838
4 years ago
Chris Lu
540441fd38
go fmt
4 years ago
Chris Lu
c9722dceb2
adjust log level
4 years ago
Chris Lu
f2fcb77808
local file sink: create backup files with permission 0755
4 years ago
Chris Lu
984fdd6192
always use non bucket prefixing url
4 years ago
Chris Lu
9abb041763
filer source: support filerProxy mode
4 years ago
Chris Lu
678c54d705
data sink: add incremental mode
4 years ago
Chris Lu
4ff2c5c4c9
rename file
4 years ago
Chris Lu
7d9dc3c6a2
use fasthttp lib to read
4 years ago
Konstantin Lebedev
94eac4f00e
Do reconnect to RabbitMQ
https://github.com/google/go-cloud/issues/2958
https://github.com/chrislusf/seaweedfs/issues/1773
4 years ago
Chris Lu
a0e84c4fbc
go fmt
4 years ago
Konstantin Lebedev
0cfed8c3cb
restart replication if RabbitMQ connection closed
https://github.com/google/go-cloud/issues/2958
4 years ago
Konstantin Lebedev
2fb4c60540
fix log warn
4 years ago
Konstantin Lebedev
24ec17219b
RabbitMQ delay retry with Dead Letter Exchange
https://github.com/chrislusf/seaweedfs/issues/1773
https://github.com/google/go-cloud/issues/2952
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
9a06c35da4
replicate: incremental sink only contains new and updated files
address da08402ba2
4 years ago
Chris Lu
da08402ba2
replicate: use creation time for local incremental file sink
related to https://github.com/chrislusf/seaweedfs/pull/1762
4 years ago
Konstantin Lebedev
02fdc0a333
rename backup to local_incremental and use mtime
4 years ago
Konstantin Lebedev
6b54ff9912
replication to create time date directory
4 years ago
Konstantin Lebedev
3634811408
replication to todays date directory
4 years ago
Chris Lu
ad2a20c8a5
notification add ack and nack
4 years ago
Konstantin Lebedev
612b7975a1
replication to local disk storage
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
80b8692688
filer.sync: replicate outside of either cluster, only need to see filers
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago