Chris Lu
69553e5ba6
convert error fromating to %w everywhere ( #6995 )
3 months ago
Guo Lei
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 years ago
Guo Lei
f95c25e113
types packages is imported more than onece ( #3838 )
3 years ago
Guo Lei
84c401e693
Optimiz leveldb metric ( #3830 )
* optimiz updating mapmetric for leveldb
* import loading leveldb
* add comments
3 years ago
chrislu
0baf3d38c2
adjust logs
3 years ago
Guo Lei
c57c79a0ab
optimiz commitig compact ( #3388 )
* optimiz vacuuming volume
* fix bugx
* rename parameters
* fix conflict
* change copyDataBasedOnIndexFile to an instance method
* close needlemap
* optimiz commiting Vacuum volume for leveldb index
* fix bugs
* fix leveldb loading bugs
* refactor
* fix leveldb loading bug
* add leveldb recovery
* add test case for levelDB
* modify test case to cover all the new branches
* use one tmpNm instead of two instances
* refactor
* refactor
* move setWatermark to the end
* add test for watermark and updating leveldb
* fix error logic
* refactor, add test
* check nil before close needlemapeer
add test case
fix metric bug
* add tests, fix bugs
* adjust log level
remove wrong test case
refactor
* avoid duplicate updating metric for leveldb index
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
guol-fnst
ac694f0c8f
rename parameter and reuse functions
rename milestone to watermark
3 years ago
guol-fnst
91285bb51d
remove uncessary code
3 years ago
guol-fnst
b9256e0b34
optimiz
3 years ago
guol-fnst
bec9f79659
use snapshot
3 years ago
Chris Lu
bdfed16d42
avoid nil exception
fix https://github.com/chrislusf/seaweedfs/issues/1869
5 years ago
Chris Lu
1ad3200094
skip seek() when index file writes
5 years ago
Chris Lu
f2723c1bc8
do not idx file format
revert c9ab8d05fa
5 years ago
Chris Lu
c9ab8d05fa
fixes for reading deleted fid
5 years ago
Chris Lu
fe01191b5b
support read option readDeleted=true
5 years ago
Chris Lu
6ccd7f0a4d
refactoring
5 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
5 years ago
Chris Lu
4bed1663e2
adjust log level
5 years ago
Chris Lu
ef2b3a0801
leveldb recover error handling
5 years ago
Chris Lu
e5a0787653
filer: leveldb store add auto recovery, report correct error
fix https://github.com/chrislusf/seaweedfs/issues/1326
5 years ago
Chris Lu
3a35632d58
sync before closing file
merge changes from 1747fc2d52
6 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
6 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
6 years ago
Chris Lu
644c5c27b4
refactoring
6 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
17ac1290c0
volume: load ec shards during heartbeats to master
6 years ago
Chris Lu
46a675ecc2
align memory to avoid nil with atomic operations
7 years ago
Chris Lu
e5506152c0
refactoring
7 years ago
Chris Lu
8a5ce16e96
weed volume: remove boltdb, btree options, add options for leveldb medium, large
7 years ago
Chris Lu
9924fa3b1a
weed volume: disable block cache on leveldb
saving 8MB for each volume, but at the cost of slower lookup
7 years ago
Chris Lu
000ee725fc
refactor Offset into a struct of bytes
7 years ago
Chris Lu
1f030af06f
adjusting startup logging
7 years ago
Chris Lu
7e2031b18f
go fmt
7 years ago
Chris Lu
d4d7ced922
refactoring: add type for needle id, offset
later the type size can possibly be adjusted
7 years ago
Chris Lu
5bfb72d058
faster loading boltdb or leveldb needle map metrics by bloomfilter
avoid btree
7 years ago
Chris Lu
0467195f07
fix file closing on windows
7 years ago
Chris Lu
57c5405657
add todo
8 years ago
Chris Lu
6db1c8bafb
Revert "adjust the needle mapper"
This reverts commit e2c7be3a2e
.
8 years ago
Chris Lu
e2c7be3a2e
adjust the needle mapper
as discussed on
https://github.com/chrislusf/seaweedfs/pull/642#issuecomment-387606960
8 years ago
Yang Pengcheng
a2112e1be0
fix ldb dir deleting
8 years ago
Chris Lu
82c3ccc8dd
add btree for volume index
9 years ago
Chris Lu
13e7069eb9
keep track of total data file size
9 years ago
Chris Lu
5ce6bbf076
directory structure change to work with glide
glide has its own requirements. My previous workaround caused me some
code checkin errors. Need to fix this.
10 years ago
chrislusf
b39c384d6d
Revert "Merge pull request #284 from thinxer/binary"
This reverts commit 3523ad5239
, reversing
changes made to 5d100994b1
.
10 years ago
Jianfei Wang
18254d9aae
replace util/bytes.go with binary.BigEndian
10 years ago
chrislusf
5d100994b1
Revert "Merge pull request #281 from thinxer/binary"
This reverts commit a87fe8ffce
, reversing
changes made to 6876bfa685
.
10 years ago
Jianfei Wang
7bc10d46e3
replace util/bytes.go with binary.BigEndian
10 years ago
chrislusf
86cd40fba8
Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
11 years ago
Stuart P. Bentley
f0c2a2dcb3
Change all chrislusf/weed-fs links to point to chrislu/seaweedfs
11 years ago