120 Commits (ff3d46637d7adaf364f6384c3d631d16c9741363)

Author SHA1 Message Date
Chris Lu d335f04de6 support env variables to overwrite toml file 5 years ago
Chris Lu c8b2dac6c1 volume: avoid sharing volume dat file handle 5 years ago
Chris Lu acf7ca7b93 volume: fix compaction 5 years ago
Chris Lu efd2f50ede compaction changed to .idx based deletion 5 years ago
Chris Lu abffe857a1 change btree map to in memory level db 5 years ago
Chris Lu 72a561ab7c refactoring 5 years ago
Chris Lu 09ca936c78 shell: add ec.decode command 5 years ago
Chris Lu f60154f330 master load backend storage config from master.toml 5 years ago
Chris Lu 85f8649320 refactor memory mapped file into backend storage 5 years ago
Chris Lu db30a46050 skip memory mapped file when compacting 5 years ago
Chris Lu 57e441d67b fix compaction logic 5 years ago
Chris Lu 4b5ba4927f adjust NewDiskFile() paramaters 5 years ago
Chris Lu 19b6a16003 changed from os.file to backend.DataStorageBackend 5 years ago
Chris Lu fc412e428b refactor ScanVolumeFileFrom() 5 years ago
Chris Lu faec9076a4 adjust parameter names 5 years ago
j.laycock 6fc6322c90 Change joeslay paths to chrislusf paths 5 years ago
j.laycock 5885ab67b3 rename volume property MemoryMap to MemoryMapMaxSizeMB 5 years ago
Tom Maxwell 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve 5 years ago
j.laycock 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct 5 years ago
Tom Maxwell d637d86d22 Changes to try and pass the URL parameters through - in memory flag not working still 5 years ago
j.laycock 9a459d984b Do not vacuum memory mapped files 5 years ago
j.laycock 595a1beff0 Swap imports to use joeslay 5 years ago
Chris Lu d829df4f59 volume: protect against nil needle map 5 years ago
Chris Lu e40634e6b4 volume: fail the volume deletion if compaction is in progress 5 years ago
Chris Lu f3b99cbfe5 fix wrong alignment fix 6 years ago
Chris Lu 644c5c27b4 refactoring 6 years ago
Chris Lu 33b3366043 volume: avoid compacting wait group 6 years ago
Chris Lu a7b1b23c58 fix wrong volume count 6 years ago
Chris Lu 115558e5f5 adjust counters 6 years ago
Chris Lu 289fd7eb39 count number of volumes and ec shards 6 years ago
Chris Lu 17ac1290c0 volume: load ec shards during heartbeats to master 6 years ago
Chris Lu cf58fc0e63 refactor: extract out the write throttler 6 years ago
Chris Lu b335f81a4f volume: add option to limit compaction speed 6 years ago
Chris Lu 3b3651dea3 volume: atomic copying file, adds version and stopOffset 6 years ago
Chris Lu ac2727853f fix needle map entry size 6 years ago
Chris Lu e5506152c0 refactoring 6 years ago
Chris Lu 000ee725fc refactor Offset into a struct of bytes 6 years ago
Chris Lu df95ce0b6c weed backup: efficient delta backup 6 years ago
Chris Lu 70815e9124 WIP 6 years ago
Chris Lu da871896c3 weed filer: set grpc port to port + 10000 6 years ago
Chris Lu 916b809c08 add error checking 6 years ago
bingoohuang ab6be025d7 go fmt and fix some typo 6 years ago
bingoohuang 6ddfaf33cb extract VolumeFileScanner for ScanVolumeFile 6 years ago
Chris Lu 9383c91eb1 wait to read again if the volume is compacting 6 years ago
Chris Lu 1478d7ea21 reduce file seek when writing 6 years ago
Chris Lu f050b22d6c close file in ScanVolumeFile() 6 years ago
Chris Lu 496a7398d1 adjust logging 6 years ago
Chris Lu 333709657c adjust log level 6 years ago
Chris Lu a362261972 avoid possible racing issue if leveldb or boltdb is used. 6 years ago
Chris Lu ea8ecf35f4 set needle AppendAtNs value during writes 7 years ago