柏杰
0b0fb9b9e4
avoid data race read volume.IsEmpty ( #4574 )
* avoid data race read volume.IsEmpty
- avoid phantom read isEmpty for onlyEmpty
- use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope
* add Destroy(onlyEmpty: true) test
* add Destroy(onlyEmpty: false) test
* remove unused `IsEmpty()`
* change literal `8` to `SuperBlockSize`
2 years ago
Guo Lei
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
Konstantin Lebedev
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
2 years ago
Konstantin Lebedev
4f7a1f67cd
avoid race conditions for diskLocation.MaxVolumeCount ( #3526 )
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
guol-fnst
b9256e0b34
optimiz
2 years ago
guol-fnst
bec9f79659
use snapshot
2 years ago
guol-fnst
300b383cdf
use 10 or numCPU workers if env is not found
2 years ago
guol-fnst
308a48c0c2
optimiz concurrency
user can customize number of workers via env "GOMAXPROCS"
2 years ago
guol-fnst
26313060a3
speeding up loading volumes
2 years ago
garenchan
8aa19577f4
fix 3238: handle errors for GenerateDirUuid method
3 years ago
guol-fnst
b12944f9c6
fix naming convention
notify volume server of duplicate directoris
improve searching efficiency
3 years ago
guol-fnst
8fab39e775
rename UUID file
fix typo
move locationUUID into DiskLocation
3 years ago
guol-fnst
de6aa9cce8
avoid duplicated volume directory
3 years ago
chrislu
37ab8909b0
use two flags: v.isCompacting and v.isCommitCompacting
3 years ago
chrislu
a129bda7d9
sync data first before stopping
3 years ago
chrislu
50ddd8c8e2
remove debug messages
fix https://github.com/chrislusf/seaweedfs/issues/2514
3 years ago
chrislu
488afa5002
volume: load volume can optionally be skipped, if ec volume exists
fix https://github.com/chrislusf/seaweedfs/issues/2489
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
f0d1e7bd05
skip ec volumes when loading normal volumes
3 years ago
Chris Lu
8c6ff55226
add volume not found error type, to reduce error log
3 years ago
bingoohuang
cf552417a7
minFreeSpace refactored
4 years ago
bingoohuang
31f1cdeac2
minFreeSpace argument allows size like 10GiB
4 years ago
Chris Lu
283d703d50
adjust text
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
Chris Lu
7ce647f27e
support customizable disk type
4 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
4 years ago
Chris Lu
e2076201d7
volume: avoid reprocessing the same volume
fix https://github.com/chrislusf/seaweedfs/issues/1682
4 years ago
Chris Lu
986cbdf7d9
Revert "Merge pull request #1683 from qieqieplus/master"
This reverts commit 8cb67952db
, reversing
changes made to 200e56215a
.
4 years ago
Chris Lu
f56e6d231e
Revert "Merge pull request #1683 from qieqieplus/master"
This reverts commit 8cb67952db
, reversing
changes made to 200e56215a
.
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
chenqieqie
45f902a9b7
smaller critical section
4 years ago
chenqieqie
4e58a4f24e
fix race condition when loading volumes concurrently
4 years ago
Chris Lu
2e8dba571b
adjust volume server UI
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
d156c74ec0
volume server set volume type and heartbeat to the master
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
4 years ago
Chris Lu
3c229eb677
refactor
4 years ago
Chris Lu
6783ae5f8f
rename
4 years ago
Chris Lu
97f706f35b
just refactoring
4 years ago
Chris Lu
b11449f955
pass in dir.idx parameter to DiskLocation
4 years ago
Chris Lu
0dafcf1f5a
volume: detect max volume count changes based on disk usage
fix https://github.com/chrislusf/seaweedfs/issues/1594
4 years ago
Chris Lu
3e925faddd
trim out name extension
4 years ago
Chris Lu
53c3aad875
volume: add a note file to avoid incomplete volume files
fix https://github.com/chrislusf/seaweedfs/issues/1567
4 years ago
Chris Lu
575d7952a1
add available resource stats
fix https://github.com/chrislusf/seaweedfs/issues/1555
4 years ago
Chris Lu
a1c01d716b
volume: avoid deadlock when deleting volumes
fix https://github.com/chrislusf/seaweedfs/issues/1501
4 years ago
James Hartig
8e54e34576
volume: Don't unmount before deleting volume in copy
If we unmount first and then delete, the delete fails because the volume
was unmounted. Delete ends up doing the same thing as the unmount anyways.
4 years ago
Chris Lu
faa5c2e89a
refactoring
5 years ago
Chris Lu
45a9d852d3
go fmt
5 years ago
Evgenii Kozlov
2410ffbd79
Name fix
5 years ago