chrislu
4fd5f96598
filer: remove replication, collection, disk_type info from entry metadata
these metadata can change and are not used
3 years ago
chrislu
6994e88192
fix typo
3 years ago
chrislu
b3e526ba95
url should be always using forward slash
3 years ago
Kyle Sanderson
9e012001be
filer.copy: don't crash when volume creation fails
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x1d58247]
goroutine 7482 [running]:
github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks.func1(0x2)
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:488 +0x2a7
created by github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:455 +0x225
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x1d58247]
goroutine 7480 [running]:
github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks.func1(0x0)
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:488 +0x2a7
created by github.com/chrislusf/seaweedfs/weed/command.(*FileCopyWorker).uploadFileInChunks
/go/src/github.com/chrislusf/seaweedfs/weed/command/filer_copy.go:455 +0x225
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
b297849147
typo
3 years ago
Chris Lu
af207bbaf0
retry both assign volume and uploading data
fix https://github.com/chrislusf/seaweedfs/issues/2351
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
0128239c0f
handle ipv6 addresses
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
05fc7db755
filer.copy: large files pack file ids into chunks
3 years ago
Chris Lu
5c14da0f1e
filer.copy: fail early if assign request failed
fix https://github.com/chrislusf/seaweedfs/issues/2216
3 years ago
Chris Lu
4cc2165061
weed -h subcommand list is not sorted, makes discovery difficult
fix https://github.com/chrislusf/seaweedfs/issues/2214
3 years ago
Chris Lu
1e76fc994a
filer.copy: zero fileSize for directories
4 years ago
Chris Lu
b430d1b6ee
filer.copy: "check.size" before copying files
fix https://github.com/chrislusf/seaweedfs/issues/2067
4 years ago
Chris Lu
8f8738867f
add retry to assign volume
fix https://github.com/chrislusf/seaweedfs/issues/2056
4 years ago
Chris Lu
007401f3a0
remove duplicated code
4 years ago
Chris Lu
55a8f57381
go fmt
4 years ago
Chris Lu
cd7bf1a72a
filer.copy copy empty folders
fix https://github.com/chrislusf/seaweedfs/issues/2016
4 years ago
Chris Lu
cc0df36a9e
smaller file chunks are faster
4 years ago
Chris Lu
62191b08ea
disk type support custom tags
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
0bc3a1f9e8
disk type only supports hdd and ssd, not ready for random tags yet
4 years ago
Chris Lu
ef76365ec2
adjust help message
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
3c7f9633eb
show error a little bit more obviously
fix https://github.com/chrislusf/seaweedfs/issues/1678
4 years ago
Chris Lu
8baba93fce
rename parameter name to "disk"
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
745ee8d8f3
avoid unnecessary error message
fix https://github.com/chrislusf/seaweedfs/issues/1611
4 years ago
Chris Lu
de86945aeb
go fmt
4 years ago
Chris Lu
7ecbb4b3c9
clean up
4 years ago
Kenny
9cc6575ab5
Update filer_copy.go
修改 weed filer.copy 上传目录时文件名变子目录的问题
4 years ago
Chris Lu
e219c57849
passing full path when assign volume locations
4 years ago
Chris Lu
f375b93aef
renaming
4 years ago
Chris Lu
63b0fb54f7
minor
4 years ago
Chris Lu
147d4d23b6
filer.copy: automatically use the right bucket
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
39e72fb23c
go fmt
5 years ago
Chris Lu
871efa4fc1
refactoring
some previous chunk etag was using md5, which should be wrong.
5 years ago
wuyuxiang
6850d28d6b
refacotr: move signal handling and pprof to grace package
5 years ago
Chris Lu
57df14f76f
report error if copying failed
5 years ago
Chris Lu
eedd33dda3
refactoring
5 years ago
Chris Lu
d848d08944
use public url also for deletions
5 years ago
Chris Lu
89eb05b50f
filer: support TTL for all filer stores
5 years ago
Chris Lu
2e3f6ad3a9
filer: remember content is gzipped or not
5 years ago
Chris Lu
936e7cdbfb
pass in filer.copy cipher option
5 years ago
Chris Lu
8c3e25b38a
mimee type default "application/octet-stream" to empty string
5 years ago