chrislu
0d62be4484
WIP
1 month ago
Guo Lei
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 years ago
Guo Lei
f95c25e113
types packages is imported more than onece ( #3838 )
3 years ago
Guo Lei
84c401e693
Optimiz leveldb metric ( #3830 )
* optimiz updating mapmetric for leveldb
* import loading leveldb
* add comments
3 years ago
chrislu
0baf3d38c2
adjust logs
3 years ago
Guo Lei
c57c79a0ab
optimiz commitig compact ( #3388 )
* optimiz vacuuming volume
* fix bugx
* rename parameters
* fix conflict
* change copyDataBasedOnIndexFile to an instance method
* close needlemap
* optimiz commiting Vacuum volume for leveldb index
* fix bugs
* fix leveldb loading bugs
* refactor
* fix leveldb loading bug
* add leveldb recovery
* add test case for levelDB
* modify test case to cover all the new branches
* use one tmpNm instead of two instances
* refactor
* refactor
* move setWatermark to the end
* add test for watermark and updating leveldb
* fix error logic
* refactor, add test
* check nil before close needlemapeer
add test case
fix metric bug
* add tests, fix bugs
* adjust log level
remove wrong test case
refactor
* avoid duplicate updating metric for leveldb index
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
guol-fnst
ac694f0c8f
rename parameter and reuse functions
rename milestone to watermark
3 years ago
guol-fnst
91285bb51d
remove uncessary code
3 years ago
guol-fnst
b9256e0b34
optimiz
3 years ago
guol-fnst
bec9f79659
use snapshot
3 years ago
Chris Lu
bdfed16d42
avoid nil exception
fix https://github.com/chrislusf/seaweedfs/issues/1869
4 years ago
Chris Lu
1ad3200094
skip seek() when index file writes
4 years ago
Chris Lu
f2723c1bc8
do not idx file format
revert c9ab8d05fa
5 years ago
Chris Lu
c9ab8d05fa
fixes for reading deleted fid
5 years ago
Chris Lu
fe01191b5b
support read option readDeleted=true
5 years ago
Chris Lu
6ccd7f0a4d
refactoring
5 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
5 years ago
Chris Lu
4bed1663e2
adjust log level
5 years ago
Chris Lu
ef2b3a0801
leveldb recover error handling
5 years ago
Chris Lu
e5a0787653
filer: leveldb store add auto recovery, report correct error
fix https://github.com/chrislusf/seaweedfs/issues/1326
5 years ago
Chris Lu
3a35632d58
sync before closing file
merge changes from 1747fc2d52
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
6 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
6 years ago
Chris Lu
644c5c27b4
refactoring
6 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
17ac1290c0
volume: load ec shards during heartbeats to master
6 years ago
Chris Lu
46a675ecc2
align memory to avoid nil with atomic operations
6 years ago
Chris Lu
e5506152c0
refactoring
6 years ago
Chris Lu
8a5ce16e96
weed volume: remove boltdb, btree options, add options for leveldb medium, large
6 years ago
Chris Lu
9924fa3b1a
weed volume: disable block cache on leveldb
saving 8MB for each volume, but at the cost of slower lookup
6 years ago
Chris Lu
000ee725fc
refactor Offset into a struct of bytes
6 years ago
Chris Lu
1f030af06f
adjusting startup logging
7 years ago
Chris Lu
7e2031b18f
go fmt
7 years ago
Chris Lu
d4d7ced922
refactoring: add type for needle id, offset
later the type size can possibly be adjusted
7 years ago
Chris Lu
5bfb72d058
faster loading boltdb or leveldb needle map metrics by bloomfilter
avoid btree
7 years ago
Chris Lu
0467195f07
fix file closing on windows
7 years ago
Chris Lu
57c5405657
add todo
7 years ago
Chris Lu
6db1c8bafb
Revert "adjust the needle mapper"
This reverts commit e2c7be3a2e
.
7 years ago
Chris Lu
e2c7be3a2e
adjust the needle mapper
as discussed on
https://github.com/chrislusf/seaweedfs/pull/642#issuecomment-387606960
7 years ago
Yang Pengcheng
a2112e1be0
fix ldb dir deleting
8 years ago
Chris Lu
82c3ccc8dd
add btree for volume index
8 years ago
Chris Lu
13e7069eb9
keep track of total data file size
9 years ago
Chris Lu
5ce6bbf076
directory structure change to work with glide
glide has its own requirements. My previous workaround caused me some
code checkin errors. Need to fix this.
9 years ago
chrislusf
b39c384d6d
Revert "Merge pull request #284 from thinxer/binary"
This reverts commit 3523ad5239
, reversing
changes made to 5d100994b1
.
9 years ago
Jianfei Wang
18254d9aae
replace util/bytes.go with binary.BigEndian
9 years ago
chrislusf
5d100994b1
Revert "Merge pull request #281 from thinxer/binary"
This reverts commit a87fe8ffce
, reversing
changes made to 6876bfa685
.
9 years ago
Jianfei Wang
7bc10d46e3
replace util/bytes.go with binary.BigEndian
9 years ago
chrislusf
86cd40fba8
Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
10 years ago
Stuart P. Bentley
f0c2a2dcb3
Change all chrislusf/weed-fs links to point to chrislu/seaweedfs
10 years ago