Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
f0b928ff5e
go fmt
3 years ago
Chris Lu
3afa451cdc
volume: find a non-empty offset when binary searching by timestamp
3 years ago
Chris Lu
b530f12327
volume: find a non-empty offset when binary searching by timestamp
fix https://github.com/chrislusf/seaweedfs/issues/2364
3 years ago
Chris Lu
ce1efeb0eb
adds more error message
3 years ago
Chris Lu
d688e10ed1
do not try to compress if not sure about the file content
3 years ago
Chris Lu
332f5ad3a8
revert temporary changes that disabled compression
fix https://github.com/chrislusf/seaweedfs/issues/2362
3 years ago
Chris Lu
f0d1e7bd05
skip ec volumes when loading normal volumes
3 years ago
Chris Lu
f58ea6a2ee
add source name to error message
3 years ago
Chris Lu
2e9372dcf7
volume stream read skips deleted content
3 years ago
Chris Lu
5956a8b05a
adjust comment
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
8c6ff55226
add volume not found error type, to reduce error log
3 years ago
Chris Lu
1b942dfa3c
add error message
3 years ago
Chris Lu
7ce97b59d8
go fmt
3 years ago
Chris Lu
f811fd0903
fix build
3 years ago
Chris Lu
5adfdd7982
change to a new bloom filter library
3 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
3 years ago
Chris Lu
c08ac536ed
cloud drive: add support for Wasabi
* disable md5, sha256 checking to avoid reading one chunk twice
* single threaded upload to avoid chunk swapping (to be enhanced later)
3 years ago
Chris Lu
00c4e06caa
cloud drive: s3 configurable force path style
3 years ago
Chris Lu
f0cc130849
do not force path style for better compatibility
3 years ago
Konstantin Lebedev
865b06b7fe
The IEEE assembler optimizations has been submitted and will be part of the Go 1.6 standard library.
https://github.com/klauspost/crc32
3 years ago
Chris Lu
78e8ddf910
Only when tailing volume, the zero-ed cookie should skip checking.
This only happens when checkCookie == false and fsync == false.
3 years ago
Chris Lu
a8617c1a39
tail volume: fix zero cookie problem from batch deletion
3 years ago
Chris Lu
734c980040
volume: support concurrent download data size limit
3 years ago
Chris Lu
9cc84a910f
volume: deletion can skip volume size checking
fix https://github.com/chrislusf/seaweedfs/issues/2225
3 years ago
Chris Lu
49c66e88a0
volume: change all writes to fsync during graceful stopping
fix https://github.com/chrislusf/seaweedfs/issues/2193
3 years ago
Chris Lu
b624090398
go fmt
4 years ago
Chris Lu
24e11d1e90
look back when adding to sorted values
look back when adding to sorted values, before adding it to overflow
4 years ago
Chris Lu
fc8dd58aea
volume: large_volume version has bug when using in memory index
fix https://github.com/chrislusf/seaweedfs/issues/2162
4 years ago
Chris Lu
56eb522b13
fix stats when a collection is deleted
4 years ago
Chris Lu
6c82326575
use bytes.Buffer to reduce memory allocation and gc
4 years ago
Konstantin Lebedev
99ef280c7c
avoid data loss after restarting a container with a volum server
4 years ago
Chris Lu
1aa7e99a89
skip file not found error when deleting
4 years ago
qieqieplus
ac26080bd2
fix concurrent vacuum & delete panic
4 years ago
bingoohuang
cf552417a7
minFreeSpace refactored
4 years ago
bingoohuang
31f1cdeac2
minFreeSpace argument allows size like 10GiB
4 years ago
Chris Lu
ca998328c2
do not add new volumes when below minFreeSpacePercent
fix https://github.com/chrislusf/seaweedfs/issues/2017
4 years ago
Chris Lu
a8114da02d
avoid thundering herd effect
transient errors may cause thundering herd effect to all trying to recover from remove ec shards
4 years ago
Chris Lu
ae74d8f02a
fix error message
related to https://github.com/chrislusf/seaweedfs/issues/2012
4 years ago
Chris Lu
283d703d50
adjust text
4 years ago
Chris Lu
8e404a1433
go fmt
4 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
102a951377
refactor, split into 2 files
4 years ago
Chris Lu
f6e2566ee5
better logs for cookie mismatch
4 years ago
Chris Lu
35d939a1d2
go fmt
4 years ago
Chris Lu
cb423312a4
prevent nil volume message
4 years ago
Chris Lu
972327f966
prevent nil volume nm
4 years ago
Chris Lu
737bde5ab7
refactoring, remove duplicated code
4 years ago