79 Commits (0dbaa70af263d2645fa7fef7d884158c2fa2eb59)

Author SHA1 Message Date
Chris Lu cbfe31a9a8 idx file sync before compaction 5 years ago
Chris Lu 81797a059a volume: sync volume file right before compaction 5 years ago
Chris Lu d439d83772 volume: follow compactionBytePerSecond 5 years ago
Chris Lu d3e1ef64b3 ensure error checking on windows 5 years ago
Chris Lu 88a110e67e release file handle 5 years ago
Chris Lu 43e6261579 volume: fix memory leak 5 years ago
Chris Lu f87f2045b3 delete old file first on windows 5 years ago
Chris Lu 757c7d67ad avoid nil DataBackend 5 years ago
Chris Lu 430b5a49e2 unused code 5 years ago
Chris Lu d335f04de6 support env variables to overwrite toml file 5 years ago
Chris Lu c8b2dac6c1 volume: avoid sharing volume dat file handle 5 years ago
Chris Lu acf7ca7b93 volume: fix compaction 5 years ago
Chris Lu efd2f50ede compaction changed to .idx based deletion 5 years ago
Chris Lu abffe857a1 change btree map to in memory level db 5 years ago
Chris Lu 72a561ab7c refactoring 5 years ago
Chris Lu 09ca936c78 shell: add ec.decode command 5 years ago
Chris Lu f60154f330 master load backend storage config from master.toml 5 years ago
Chris Lu 85f8649320 refactor memory mapped file into backend storage 5 years ago
Chris Lu db30a46050 skip memory mapped file when compacting 5 years ago
Chris Lu 57e441d67b fix compaction logic 5 years ago
Chris Lu 4b5ba4927f adjust NewDiskFile() paramaters 5 years ago
Chris Lu 19b6a16003 changed from os.file to backend.DataStorageBackend 5 years ago
Chris Lu fc412e428b refactor ScanVolumeFileFrom() 5 years ago
Chris Lu faec9076a4 adjust parameter names 5 years ago
j.laycock 6fc6322c90 Change joeslay paths to chrislusf paths 5 years ago
j.laycock 5885ab67b3 rename volume property MemoryMap to MemoryMapMaxSizeMB 5 years ago
Tom Maxwell 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve 5 years ago
j.laycock 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct 5 years ago
Tom Maxwell d637d86d22 Changes to try and pass the URL parameters through - in memory flag not working still 5 years ago
j.laycock 9a459d984b Do not vacuum memory mapped files 5 years ago
j.laycock 595a1beff0 Swap imports to use joeslay 5 years ago
Chris Lu d829df4f59 volume: protect against nil needle map 5 years ago
Chris Lu e40634e6b4 volume: fail the volume deletion if compaction is in progress 5 years ago
Chris Lu f3b99cbfe5 fix wrong alignment fix 6 years ago
Chris Lu 644c5c27b4 refactoring 6 years ago
Chris Lu 33b3366043 volume: avoid compacting wait group 6 years ago
Chris Lu a7b1b23c58 fix wrong volume count 6 years ago
Chris Lu 115558e5f5 adjust counters 6 years ago
Chris Lu 289fd7eb39 count number of volumes and ec shards 6 years ago
Chris Lu 17ac1290c0 volume: load ec shards during heartbeats to master 6 years ago
Chris Lu cf58fc0e63 refactor: extract out the write throttler 6 years ago
Chris Lu b335f81a4f volume: add option to limit compaction speed 6 years ago
Chris Lu 3b3651dea3 volume: atomic copying file, adds version and stopOffset 6 years ago
Chris Lu ac2727853f fix needle map entry size 6 years ago
Chris Lu e5506152c0 refactoring 6 years ago
Chris Lu 000ee725fc refactor Offset into a struct of bytes 6 years ago
Chris Lu df95ce0b6c weed backup: efficient delta backup 6 years ago
Chris Lu 70815e9124 WIP 6 years ago
Chris Lu da871896c3 weed filer: set grpc port to port + 10000 6 years ago
Chris Lu 916b809c08 add error checking 6 years ago