chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
a243d7e047
EC: clean up if failed in the middle
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
c57a7839ec
adjust comments
4 years ago
Chris Lu
8438fb0cc3
fix ec shard spreading error
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
c026eb0592
refactoring
4 years ago
Chris Lu
a4dc25cd22
volume: generate ec shard first, before generating the ec index file.
possible fix https://github.com/chrislusf/seaweedfs/issues/1364
the ec index file is used to determine whether the ec files are ready or not
5 years ago
Chris Lu
3b638d3994
add more ec encoding logging
5 years ago
Chris Lu
ae1994cbc1
erasure coding: fix cases where there are no .ecj files
5 years ago
Chris Lu
97ab8a1976
remove ctx if possible
5 years ago
Chris Lu
892e726eb9
avoid reusing context object
fix https://github.com/chrislusf/seaweedfs/issues/1182
5 years ago
Chris Lu
72a64a5cf8
use the same context object in order to retry
5 years ago
Chris Lu
df636e4c14
remove .vif files
5 years ago
Chris Lu
509f314350
keep .vif file for ec to normal volume conversion
5 years ago
Chris Lu
0cc8347a3a
go fmt
5 years ago
Chris Lu
8fbc0a9163
fix edge cases
5 years ago
Chris Lu
37b64a50b4
ec: generate and copy .vif file
5 years ago
Chris Lu
8a2d529759
go fmt
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
58f88e530c
volume: use sorted index map for readonly volumes
5 years ago
Chris Lu
6cc9e0d788
volume: fix ec shard reading
fix https://github.com/chrislusf/seaweedfs/issues/1106
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
4cea8aefd0
add grpc VolumeEcBlobDelete
6 years ago
Chris Lu
856da7aae2
ec volume support deletes
6 years ago
Chris Lu
b05456fe07
able to purge extra ec shard copies
6 years ago
Chris Lu
11cffb3168
fix ec.rebuild bugs
6 years ago
Chris Lu
d85b41b904
fix ec.encode not finding the local ec shards
6 years ago
Chris Lu
7e80b2b882
fix multiple bugs
6 years ago
Chris Lu
133b772fb5
destroy ec volume if it is empty
6 years ago
Chris Lu
ba18314aab
ec shard delete also check ec volumes, in addition to volumes
6 years ago
Chris Lu
3f9ecee40f
working with reading remote intervals
6 years ago
Chris Lu
217cde0a3b
refactoring
6 years ago
Chris Lu
b4b407e403
add grpc ec shard read
6 years ago
Chris Lu
db94a41f9e
mount/unmount ec shards
6 years ago
Chris Lu
41e8ae61f8
generate, balance, delete copied shards, delete old volume
6 years ago
Chris Lu
fbbc74abb4
adds VolumeEcGenerateSlices, VolumeEcCopy
6 years ago