chrislu
21c0587900
go fmt
2 years ago
Ryan Russell
60fa26ef45
refactor: `concurrentFiles` and `concurrentChunks` var name fix ( #3655 )
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
973f6dd162
refactoring
2 years ago
chrislu
6c8822f269
filer.copy: retryable file part upload
2 years ago
chrislu
a3553da7f7
add fileId to UploadWithRetry return result
2 years ago
chrislu
d49d0a9fc2
filer.copy: retryable upload
2 years ago
chrislu
689b4ecdcc
remove unused collection and replication from upload result
2 years ago
chrislu
9f50b310a0
remove unused code
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
4fd5f96598
filer: remove replication, collection, disk_type info from entry metadata
these metadata can change and are not used
3 years ago
chrislu
6994e88192
fix typo
3 years ago
chrislu
b3e526ba95
url should be always using forward slash
3 years ago
Kyle Sanderson
9e012001be
filer.copy: don't crash when volume creation fails
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x1d58247]
goroutine 7482 [running]:
github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks.func1(0x2)
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:488 +0x2a7
created by github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:455 +0x225
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x1d58247]
goroutine 7480 [running]:
github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks.func1(0x0)
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:488 +0x2a7
created by github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:455 +0x225
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
b297849147
typo
3 years ago
Chris Lu
af207bbaf0
retry both assign volume and uploading data
fix https://github.com/chrislusf/seaweedfs/issues/2351
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
0128239c0f
handle ipv6 addresses
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
05fc7db755
filer.copy: large files pack file ids into chunks
3 years ago
Chris Lu
5c14da0f1e
filer.copy: fail early if assign request failed
fix https://github.com/chrislusf/seaweedfs/issues/2216
3 years ago
Chris Lu
4cc2165061
weed -h subcommand list is not sorted, makes discovery difficult
fix https://github.com/chrislusf/seaweedfs/issues/2214
3 years ago
Chris Lu
1e76fc994a
filer.copy: zero fileSize for directories
4 years ago
Chris Lu
b430d1b6ee
filer.copy: "check.size" before copying files
fix https://github.com/chrislusf/seaweedfs/issues/2067
4 years ago
Chris Lu
8f8738867f
add retry to assign volume
fix https://github.com/chrislusf/seaweedfs/issues/2056
4 years ago
Chris Lu
007401f3a0
remove duplicated code
4 years ago
Chris Lu
55a8f57381
go fmt
4 years ago
Chris Lu
cd7bf1a72a
filer.copy copy empty folders
fix https://github.com/chrislusf/seaweedfs/issues/2016
4 years ago
Chris Lu
cc0df36a9e
smaller file chunks are faster
4 years ago
Chris Lu
62191b08ea
disk type support custom tags
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
0bc3a1f9e8
disk type only supports hdd and ssd, not ready for random tags yet
4 years ago
Chris Lu
ef76365ec2
adjust help message
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
3c7f9633eb
show error a little bit more obviously
fix https://github.com/chrislusf/seaweedfs/issues/1678
4 years ago
Chris Lu
8baba93fce
rename parameter name to "disk"
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
745ee8d8f3
avoid unnecessary error message
fix https://github.com/chrislusf/seaweedfs/issues/1611
4 years ago
Chris Lu
de86945aeb
go fmt
4 years ago
Chris Lu
7ecbb4b3c9
clean up
4 years ago
Kenny
9cc6575ab5
Update filer_copy.go
修改 weed filer.copy 上传目录时文件名变子目录的问题
4 years ago
Chris Lu
e219c57849
passing full path when assign volume locations
4 years ago
Chris Lu
f375b93aef
renaming
4 years ago
Chris Lu
63b0fb54f7
minor
4 years ago
Chris Lu
147d4d23b6
filer.copy: automatically use the right bucket
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago