25 Commits (0d5355c6141f4d5ff83933f0b7803e88ae1df90b)

Author SHA1 Message Date
Chris Lu 06c15ab35c volume: add special handling for .dat larger than 32GB 4 years ago
Chris Lu 6a92f0bc7a refactoring to typed Size 4 years ago
Chris Lu cbd80253e3 better needle id format 4 years ago
Chris Lu e912fd15e3 renaming 5 years ago
Chris Lu 7ccc31853c hard limit volume file size 5 years ago
Chris Lu 10bd3c6b4b refactoring 5 years ago
Chris Lu f60154f330 master load backend storage config from master.toml 5 years ago
Chris Lu 85f8649320 refactor memory mapped file into backend storage 5 years ago
Chris Lu 19b6a16003 changed from os.file to backend.DataStorageBackend 5 years ago
Chris Lu 7a51a9a582 refactor: simplifying to ReadAt() and WriteAt() 5 years ago
Chris Lu 46ed2ca902 refactoring 5 years ago
j.laycock eb27c2b037 Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size. 5 years ago
j.laycock 6fc6322c90 Change joeslay paths to chrislusf paths 5 years ago
j.laycock 63acc8c972 rename mem_buffer to mBuffer 5 years ago
j.laycock cc756ddd79 Rename End_of_file variable, implement platform indepenent memory_map.go 5 years ago
j.laycock 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct 5 years ago
j.laycock 840ccdc35d Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly 5 years ago
j.laycock 0e5d3b1a70 Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files 5 years ago
Chris Lu 302d9fbc6d adjust error message for file not found 6 years ago
Chris Lu 4f76342cbc WIP 6 years ago
Chris Lu b4b407e403 add grpc ec shard read 6 years ago
Wine93 32f93fb09e style: go fmt for all 6 years ago
Chris Lu 0be2d51c96 read volume lastAppendAtNs when loading a volume 6 years ago
Chris Lu ac2727853f fix needle map entry size 6 years ago
Chris Lu e5506152c0 refactoring 6 years ago
Chris Lu fa176fe80f volume tailing chunks large files 6 years ago
Chris Lu b09e8dbb37 add VolumeStreamFollow, but not used yet 6 years ago
Chris Lu cea5c53bf7 fix length checking 6 years ago
Chris Lu 916b809c08 add error checking 6 years ago
Chris Lu 44647a46c0 needle scanner read appendAtNs 6 years ago
bingoohuang 27093bc2e5 fix needle Append return offset to avoid uint32 overflow 6 years ago
Chris Lu 1478d7ea21 reduce file seek when writing 6 years ago
Chris Lu 168f461761 fix MaxUint8 6 years ago
Chris Lu 8f78a069c6 fix possible name overflow when len(name)>255 6 years ago
Chris Lu 77fadab560 go fmt 7 years ago
Chris Lu 4f317c7e3d working version3 7 years ago
Chris Lu 7e2031b18f go fmt 7 years ago
Chris Lu d4d7ced922 refactoring: add type for needle id, offset 7 years ago
Chris Lu 7f7e4e9885 fix error for deleted files during compaction 7 years ago
Chris Lu 5047bdb4a2 skip bytes cache 8 years ago
Chris Lu ed44f12f6d support Fallocate on linux 8 years ago
sparklxb 86a7c56275 support additional header name-value pairs 8 years ago
Chris Lu 13e7069eb9 keep track of total data file size 8 years ago
霍晓栋 78678f4bcb deleted needle does not need checksum verification 9 years ago
霍晓栋 16f6984d02 refactor data integrity checking code v2 9 years ago
霍晓栋 dda13def2a refactor data integrity checking code 9 years ago
霍晓栋 2e74fb60c8 add data integrity checking 9 years ago
Chris Lu 5ce6bbf076 directory structure change to work with glide 9 years ago
Chris Lu f8b03c45ef properly release memory 9 years ago
chrislusf adcfaa5735 correct cache: fix racing condition 9 years ago