Chris Lu
f2fcb77808
local file sink: create backup files with permission 0755
4 years ago
Chris Lu
984fdd6192
always use non bucket prefixing url
4 years ago
Chris Lu
9abb041763
filer source: support filerProxy mode
4 years ago
Chris Lu
678c54d705
data sink: add incremental mode
4 years ago
Chris Lu
4ff2c5c4c9
rename file
4 years ago
Chris Lu
7d9dc3c6a2
use fasthttp lib to read
4 years ago
Konstantin Lebedev
94eac4f00e
Do reconnect to RabbitMQ
https://github.com/google/go-cloud/issues/2958
https://github.com/chrislusf/seaweedfs/issues/1773
4 years ago
Chris Lu
a0e84c4fbc
go fmt
4 years ago
Konstantin Lebedev
0cfed8c3cb
restart replication if RabbitMQ connection closed
https://github.com/google/go-cloud/issues/2958
4 years ago
Konstantin Lebedev
2fb4c60540
fix log warn
4 years ago
Konstantin Lebedev
24ec17219b
RabbitMQ delay retry with Dead Letter Exchange
https://github.com/chrislusf/seaweedfs/issues/1773
https://github.com/google/go-cloud/issues/2952
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
9a06c35da4
replicate: incremental sink only contains new and updated files
address da08402ba2
4 years ago
Chris Lu
da08402ba2
replicate: use creation time for local incremental file sink
related to https://github.com/chrislusf/seaweedfs/pull/1762
4 years ago
Konstantin Lebedev
02fdc0a333
rename backup to local_incremental and use mtime
4 years ago
Konstantin Lebedev
6b54ff9912
replication to create time date directory
4 years ago
Konstantin Lebedev
3634811408
replication to todays date directory
4 years ago
Chris Lu
ad2a20c8a5
notification add ack and nack
4 years ago
Konstantin Lebedev
612b7975a1
replication to local disk storage
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
80b8692688
filer.sync: replicate outside of either cluster, only need to see filers
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
51eadaf2b6
rename parameter name to "disk"
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
f4abd01adf
filer: cache small file to filer store
4 years ago
Chris Lu
e219c57849
passing full path when assign volume locations
4 years ago
Chris Lu
f375b93aef
renaming
4 years ago
Chris Lu
d75bc62196
to read files that are quickly changing
4 years ago
Chris Lu
3f7d1d1bf1
Only wait on retryable requests
4 years ago
Chris Lu
723ae11db4
refactoring in order to adjust volume server url later
4 years ago
Chris Lu
a8624c2e4f
read from alternative replica
related to https://github.com/chrislusf/seaweedfs/issues/1512
4 years ago
Chris Lu
446e476a11
go fmt
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
4fc0bd1a81
return http response directly
4 years ago
Chris Lu
eb7929a971
rename filer2 to filer
4 years ago
Chris Lu
ca658a97c5
add signatures to messages to avoid double processing
4 years ago
Chris Lu
c27e18aa6a
read possible old deleted chunks
4 years ago
Chris Lu
c647deace1
file size support set file length
use Attr.FileSize and TotalChunkSize to determine file size
4 years ago
Chris Lu
97d97f3528
go code can read and write chunk manifest
4 years ago
Chris Lu
37d5b3ba12
replication: pass isFromOtherCluster also to EventNotification
EventNotification is consistent with message queue and metadata logs.
5 years ago
Chris Lu
31e23e9783
filer: support active<=>active filer replication
5 years ago
Chris Lu
97239ce6f1
rename filechunk is_gzipped to is_compressed
5 years ago
Chris Lu
ed3cf811f5
refactoring
5 years ago
Chris Lu
f282ed444b
refactoring
5 years ago
Chris Lu
4b27afe176
fix sqs message reading
5 years ago
Chris Lu
ec2eb8bc48
add If-None-Match and If-Modified-Since
fix https://github.com/chrislusf/seaweedfs/issues/1269
5 years ago