Damiano Albani
9f55c7c90e
Rclone storage backend ( #4402 )
* Add Rclone storage backend
* Support templating the name of files stored via Rclone
* Enable Rclone accounting
* Remove redundant type conversion
* Provide progress information for Rclone download/upload operations
* Log error when Rclone can't instantiate filesystem
* Remove filename templating functionality for Rclone storage
To (maybe) be later reintroduced as a generic functionality for all
storage backends.
* Remove S3 specific check
* Move Rclone config initialisation to init() method
2 years ago
Konstantin Lebedev
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
828f6e9f4d
volume: auto add missing vif files
fix https://github.com/chrislusf/seaweedfs/issues/1878
4 years ago
Chris Lu
015d16f43f
add vif file versions in case loading superblock fails
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
40ae533fa3
shell: add volume.configure.replication to change replication for a volume
fix https://github.com/chrislusf/seaweedfs/issues/1192
5 years ago
Chris Lu
288baf37fd
saving .vif files correctly
5 years ago
Chris Lu
b6f7033478
go fmt
5 years ago
Chris Lu
9134092a8d
endure creating .vif files
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
f4a74e03d1
refactoring: separating .vif from tier file loading
5 years ago
Chris Lu
2000284435
rename volume tier info to volume info
5 years ago
Chris Lu
e8b357fd53
rename from .tier to .vif
5 years ago
Chris Lu
35393b4a02
cleanly destroy remote files
5 years ago
Chris Lu
f61de28c69
volume: add deletion capability for previously readonly volumes
5 years ago
Chris Lu
ec8de250e2
tiered storage: can copy to s3, read from s3
master not aware tiered volume yet, file assigning is not working yet
5 years ago