Konstantin Lebedev
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
2 years ago
Guo Lei
f95c25e113
types packages is imported more than onece ( #3838 )
2 years ago
Guo Lei
84c401e693
Optimiz leveldb metric ( #3830 )
* optimiz updating mapmetric for leveldb
* import loading leveldb
* add comments
2 years ago
Ryan Russell
277976bd76
refactor(storage): readability improvements ( #3703 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Guo Lei
c57c79a0ab
optimiz commitig compact ( #3388 )
* optimiz vacuuming volume
* fix bugx
* rename parameters
* fix conflict
* change copyDataBasedOnIndexFile to an instance method
* close needlemap
* optimiz commiting Vacuum volume for leveldb index
* fix bugs
* fix leveldb loading bugs
* refactor
* fix leveldb loading bug
* add leveldb recovery
* add test case for levelDB
* modify test case to cover all the new branches
* use one tmpNm instead of two instances
* refactor
* refactor
* move setWatermark to the end
* add test for watermark and updating leveldb
* fix error logic
* refactor, add test
* check nil before close needlemapeer
add test case
fix metric bug
* add tests, fix bugs
* adjust log level
remove wrong test case
refactor
* avoid duplicate updating metric for leveldb index
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
2f0dda384d
vacuum show LA
2 years ago
guosj
cc7a4b0a6e
correct comment
2 years ago
chrislu
06a8b174b5
also remove Sync() for idx file
3 years ago
chrislu
81d6159290
volume: report error if a volume has nil data backend
fix https://github.com/chrislusf/seaweedfs/issues/3105
3 years ago
chrislu
37ab8909b0
use two flags: v.isCompacting and v.isCommitCompacting
3 years ago
Konstantin Lebedev
1e35b4929f
shell vacuum volume by collection and volume id
3 years ago
guosj
3e7aa1caf5
fix return value in storage/volume_vacuum.go:444
3 years ago
chrislu
c29bc9a367
fix error handling
3 years ago
guosj
d68c27f82d
fix another return value bug
3 years ago
guosj
8f9aa0cddd
fix bugs in return value
3 years ago
Konstantin Lebedev
ef541972f8
updated needle with fsync
3 years ago
Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Chris Lu
1aa7e99a89
skip file not found error when deleting
4 years ago
Chris Lu
400de380f4
volume server: support tcp direct put/get/delete
4 years ago
Chris Lu
7635f6b9fa
disk file avoid file.Stat()
4 years ago
bingoohuang
7256902fb0
fix typo offset.ToAcutalOffset to offset.ToActualOffset
4 years ago
Chris Lu
f3bb645018
file open error
4 years ago
Chris Lu
dc0bc48257
return file open error
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
f2723c1bc8
do not idx file format
revert c9ab8d05fa
4 years ago
Chris Lu
c9ab8d05fa
fixes for reading deleted fid
4 years ago
Chris Lu
6ccd7f0a4d
refactoring
4 years ago
Chris Lu
ee11d98650
refactoring
4 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
4 years ago
Chris Lu
6190fd665d
printout error
5 years ago
Chris Lu
c8ca234773
refactoring
5 years ago
Chris Lu
df9d538044
rename function
5 years ago
Chris Lu
cbfe31a9a8
idx file sync before compaction
5 years ago
Chris Lu
81797a059a
volume: sync volume file right before compaction
fix https://github.com/chrislusf/seaweedfs/issues/1237
5 years ago
Chris Lu
d439d83772
volume: follow compactionBytePerSecond
related to https://github.com/chrislusf/seaweedfs/issues/1108
5 years ago
Chris Lu
d3e1ef64b3
ensure error checking on windows
5 years ago
Chris Lu
88a110e67e
release file handle
5 years ago
Chris Lu
43e6261579
volume: fix memory leak
5 years ago
Chris Lu
f87f2045b3
delete old file first on windows
fix https://github.com/chrislusf/seaweedfs/issues/1210
5 years ago
Chris Lu
757c7d67ad
avoid nil DataBackend
5 years ago
Chris Lu
430b5a49e2
unused code
5 years ago
Chris Lu
d335f04de6
support env variables to overwrite toml file
5 years ago
Chris Lu
c8b2dac6c1
volume: avoid sharing volume dat file handle
possibly help on https://github.com/chrislusf/seaweedfs/issues/1184
5 years ago
Chris Lu
acf7ca7b93
volume: fix compaction
5 years ago
Chris Lu
efd2f50ede
compaction changed to .idx based deletion
5 years ago
Chris Lu
abffe857a1
change btree map to in memory level db
5 years ago
Chris Lu
72a561ab7c
refactoring
5 years ago
Chris Lu
09ca936c78
shell: add ec.decode command
5 years ago
Chris Lu
f60154f330
master load backend storage config from master.toml
5 years ago