石昌林
81f7f08708
Determine whether to preallocate according to the master configuration before executing copy volume
3 years ago
chrislu
94f824e1ce
volume: sync to disk before copying volume files
address https://github.com/chrislusf/seaweedfs/issues/2976
3 years ago
chrislu
affe3c2c12
change to util.WriteFile
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
a0ef6e3611
prevent nil response
fix https://github.com/chrislusf/seaweedfs/issues/2452
3 years ago
Chris Lu
0c8dea9de8
go fmt
3 years ago
Chris Lu
5435027ff0
volume copy: stream out copying progress and avoid grpc request timeout
fix https://github.com/chrislusf/seaweedfs/issues/2386
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
7ce97b59d8
go fmt
3 years ago
Chris Lu
d1a4e19a3f
volume: copy file also copies modification time
to ensure ttl can work well
3 years ago
Chris Lu
f4decf02df
volume copying: clean up stale volume data files
fix https://github.com/chrislusf/seaweedfs/issues/2250
3 years ago
Chris Lu
7ca75347ec
minor
4 years ago
Chris Lu
30b30b8fe0
volume.tier.move: passing non-empty disk type
4 years ago
Chris Lu
3fe628f04e
use hdd instead of empty string
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
Chris Lu
770393a48c
volume: add capability to change disk type when moving a volume
4 years ago
Chris Lu
94525aa0fd
allocate volume by disk type
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
de86945aeb
go fmt
4 years ago
Chris Lu
53c3aad875
volume: add a note file to avoid incomplete volume files
fix https://github.com/chrislusf/seaweedfs/issues/1567
4 years ago
Chris Lu
24bf142596
copy large file first
4 years ago
James Hartig
8e54e34576
volume: Don't unmount before deleting volume in copy
If we unmount first and then delete, the delete fails because the volume
was unmounted. Delete ends up doing the same thing as the unmount anyways.
4 years ago
Chris Lu
91b91d6cb7
add error to avoid copying not found volume
fix https://github.com/chrislusf/seaweedfs/issues/1317
5 years ago
Chris Lu
91da7057b1
refactoring
5 years ago
Chris Lu
7bc3c93512
add util.PathJoin
5 years ago
Chris Lu
cea52a4faf
volume copying adds cleaning up on error
fix https://github.com/chrislusf/seaweedfs/issues/1253
5 years ago
Chris Lu
97ab8a1976
remove ctx if possible
5 years ago
Chris Lu
892e726eb9
avoid reusing context object
fix https://github.com/chrislusf/seaweedfs/issues/1182
5 years ago
Chris Lu
72a64a5cf8
use the same context object in order to retry
5 years ago
Chris Lu
4e731f1c8b
volume: copy volumes also include .vif file
5 years ago
Chris Lu
8fbc0a9163
fix edge cases
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
cf47f657af
scaffold for volume server query feature
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
Chris Lu
c74dc2b306
go fmt
6 years ago
Chris Lu
856da7aae2
ec volume support deletes
6 years ago
Chris Lu
ca8a2bb534
go fmt
6 years ago
Chris Lu
d85b41b904
fix ec.encode not finding the local ec shards
6 years ago
Chris Lu
7e80b2b882
fix multiple bugs
6 years ago
Chris Lu
55be09996d
fix volume balance bug
6 years ago
Chris Lu
3f9ecee40f
working with reading remote intervals
6 years ago
Chris Lu
b4b407e403
add grpc ec shard read
6 years ago
Chris Lu
fbbc74abb4
adds VolumeEcGenerateSlices, VolumeEcCopy
6 years ago
Chris Lu
698dea779c
refactoring
6 years ago
Chris Lu
8ffdd5dcdb
writel throttling moving volumes
6 years ago
Chris Lu
6fc1f53018
shell: add command volume.move
6 years ago
Chris Lu
3b3651dea3
volume: atomic copying file, adds version and stopOffset
6 years ago
Chris Lu
ac2727853f
fix needle map entry size
6 years ago