Chris Lu
|
85f8649320
|
refactor memory mapped file into backend storage
|
5 years ago |
Chris Lu
|
db30a46050
|
skip memory mapped file when compacting
|
5 years ago |
Chris Lu
|
57e441d67b
|
fix compaction logic
|
5 years ago |
Chris Lu
|
4b5ba4927f
|
adjust NewDiskFile() paramaters
|
5 years ago |
Chris Lu
|
19b6a16003
|
changed from os.file to backend.DataStorageBackend
|
5 years ago |
Chris Lu
|
fc412e428b
|
refactor ScanVolumeFileFrom()
|
5 years ago |
Chris Lu
|
faec9076a4
|
adjust parameter names
|
5 years ago |
j.laycock
|
6fc6322c90
|
Change joeslay paths to chrislusf paths
|
5 years ago |
j.laycock
|
5885ab67b3
|
rename volume property MemoryMap to MemoryMapMaxSizeMB
|
5 years ago |
Tom Maxwell
|
4a878c0006
|
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
|
5 years ago |
j.laycock
|
1f01eb78e8
|
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
|
5 years ago |
Tom Maxwell
|
d637d86d22
|
Changes to try and pass the URL parameters through - in memory flag not working still
|
5 years ago |
j.laycock
|
9a459d984b
|
Do not vacuum memory mapped files
|
5 years ago |
j.laycock
|
595a1beff0
|
Swap imports to use joeslay
|
5 years ago |
Chris Lu
|
d829df4f59
|
volume: protect against nil needle map
fix @mastak reported nil problem in https://github.com/chrislusf/seaweedfs/issues/1037
|
5 years ago |
Chris Lu
|
e40634e6b4
|
volume: fail the volume deletion if compaction is in progress
fix https://github.com/chrislusf/seaweedfs/issues/1035
|
5 years ago |
Chris Lu
|
f3b99cbfe5
|
fix wrong alignment fix
|
6 years ago |
Chris Lu
|
644c5c27b4
|
refactoring
|
6 years ago |
Chris Lu
|
33b3366043
|
volume: avoid compacting wait group
|
6 years ago |
Chris Lu
|
a7b1b23c58
|
fix wrong volume count
fix https://github.com/chrislusf/seaweedfs/issues/1013
|
6 years ago |
Chris Lu
|
115558e5f5
|
adjust counters
|
6 years ago |
Chris Lu
|
289fd7eb39
|
count number of volumes and ec shards
|
6 years ago |
Chris Lu
|
17ac1290c0
|
volume: load ec shards during heartbeats to master
|
6 years ago |
Chris Lu
|
cf58fc0e63
|
refactor: extract out the write throttler
|
6 years ago |
Chris Lu
|
b335f81a4f
|
volume: add option to limit compaction speed
|
6 years ago |
Chris Lu
|
3b3651dea3
|
volume: atomic copying file, adds version and stopOffset
|
6 years ago |
Chris Lu
|
ac2727853f
|
fix needle map entry size
|
6 years ago |
Chris Lu
|
e5506152c0
|
refactoring
|
6 years ago |
Chris Lu
|
000ee725fc
|
refactor Offset into a struct of bytes
|
6 years ago |
Chris Lu
|
df95ce0b6c
|
weed backup: efficient delta backup
fix https://github.com/chrislusf/seaweedfs/issues/399
|
6 years ago |
Chris Lu
|
70815e9124
|
WIP
|
6 years ago |
Chris Lu
|
da871896c3
|
weed filer: set grpc port to port + 10000
|
6 years ago |
Chris Lu
|
916b809c08
|
add error checking
|
6 years ago |
bingoohuang
|
ab6be025d7
|
go fmt and fix some typo
|
6 years ago |
bingoohuang
|
6ddfaf33cb
|
extract VolumeFileScanner for ScanVolumeFile
|
6 years ago |
Chris Lu
|
9383c91eb1
|
wait to read again if the volume is compacting
|
6 years ago |
Chris Lu
|
1478d7ea21
|
reduce file seek when writing
|
6 years ago |
Chris Lu
|
f050b22d6c
|
close file in ScanVolumeFile()
fix https://github.com/chrislusf/seaweedfs/issues/761
|
6 years ago |
Chris Lu
|
496a7398d1
|
adjust logging
|
6 years ago |
Chris Lu
|
333709657c
|
adjust log level
|
6 years ago |
Chris Lu
|
a362261972
|
avoid possible racing issue if leveldb or boltdb is used.
remove the to-be-generated files during commit
fix https://github.com/chrislusf/seaweedfs/issues/738
|
6 years ago |
Chris Lu
|
ea8ecf35f4
|
set needle AppendAtNs value during writes
|
7 years ago |
Chris Lu
|
4f317c7e3d
|
working version3
|
7 years ago |
Chris Lu
|
7e2031b18f
|
go fmt
|
7 years ago |
Chris Lu
|
d4d7ced922
|
refactoring: add type for needle id, offset
later the type size can possibly be adjusted
|
7 years ago |
Chris Lu
|
defcd4edc5
|
adjust log level
|
7 years ago |
Chris Lu
|
9bcaa65574
|
avoid divided by 0
fix https://github.com/chrislusf/seaweedfs/issues/650
|
7 years ago |
Chris Lu
|
9ba335a7c4
|
prepare for flexible super block
|
7 years ago |
Chris Lu
|
7f7e4e9885
|
fix error for deleted files during compaction
deletion during commit may cause trouble when make up the difference during commitCompact()
|
7 years ago |
Chris Lu
|
58344980e4
|
preallocate disk space during compaction also, add cleanup for failed compaction
|
7 years ago |