Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
a243d7e047
EC: clean up if failed in the middle
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
c57a7839ec
adjust comments
4 years ago
Chris Lu
8438fb0cc3
fix ec shard spreading error
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
c026eb0592
refactoring
4 years ago
Chris Lu
a4dc25cd22
volume: generate ec shard first, before generating the ec index file.
possible fix https://github.com/chrislusf/seaweedfs/issues/1364
the ec index file is used to determine whether the ec files are ready or not
5 years ago
Chris Lu
3b638d3994
add more ec encoding logging
5 years ago
Chris Lu
ae1994cbc1
erasure coding: fix cases where there are no .ecj files
5 years ago
Chris Lu
97ab8a1976
remove ctx if possible
5 years ago
Chris Lu
892e726eb9
avoid reusing context object
fix https://github.com/chrislusf/seaweedfs/issues/1182
5 years ago
Chris Lu
72a64a5cf8
use the same context object in order to retry
5 years ago
Chris Lu
df636e4c14
remove .vif files
5 years ago
Chris Lu
509f314350
keep .vif file for ec to normal volume conversion
5 years ago
Chris Lu
0cc8347a3a
go fmt
5 years ago
Chris Lu
8fbc0a9163
fix edge cases
5 years ago
Chris Lu
37b64a50b4
ec: generate and copy .vif file
5 years ago
Chris Lu
8a2d529759
go fmt
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
58f88e530c
volume: use sorted index map for readonly volumes
5 years ago
Chris Lu
6cc9e0d788
volume: fix ec shard reading
fix https://github.com/chrislusf/seaweedfs/issues/1106
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
4cea8aefd0
add grpc VolumeEcBlobDelete
6 years ago
Chris Lu
856da7aae2
ec volume support deletes
6 years ago
Chris Lu
b05456fe07
able to purge extra ec shard copies
6 years ago
Chris Lu
11cffb3168
fix ec.rebuild bugs
6 years ago
Chris Lu
d85b41b904
fix ec.encode not finding the local ec shards
6 years ago
Chris Lu
7e80b2b882
fix multiple bugs
6 years ago
Chris Lu
133b772fb5
destroy ec volume if it is empty
6 years ago
Chris Lu
ba18314aab
ec shard delete also check ec volumes, in addition to volumes
6 years ago
Chris Lu
3f9ecee40f
working with reading remote intervals
6 years ago
Chris Lu
217cde0a3b
refactoring
6 years ago
Chris Lu
b4b407e403
add grpc ec shard read
6 years ago
Chris Lu
db94a41f9e
mount/unmount ec shards
6 years ago
Chris Lu
41e8ae61f8
generate, balance, delete copied shards, delete old volume
6 years ago
Chris Lu
fbbc74abb4
adds VolumeEcGenerateSlices, VolumeEcCopy
6 years ago