58 Commits (d4db0db220fcdeb62f1cbec9591e8e48e6d21f81)

Author SHA1 Message Date
Chris Lu 5568395edd Revert "Revert "Merge pull request #1299 from song-zhang/master"" 5 years ago
zhangsong 3703c7e176 write request keep compatible with before 5 years ago
Chris Lu afb6a1dbb4 Revert "Merge pull request #1299 from song-zhang/master" 5 years ago
zhangsong f9e8702bb4 use async write to persistent file to disk - part1 5 years ago
Chris Lu 22400c6633 consistent gzip logic 5 years ago
Chris Lu 9b3109a5d8 filer: processing all response headers, no pass through to volume server 5 years ago
Chris Lu 1ae83c2938 go fmt 5 years ago
Chris Lu ea1169dc80 filer cipher: single chunk http POST and PUT and read 5 years ago
Chris Lu 7335e62199 volume: PUT also conditionally gzip compress 5 years ago
Chris Lu 943f4986ef fix possible nil 5 years ago
Chris Lu 9995d3bcb5 remove println 5 years ago
Chris Lu 3eafec4b29 volume: add option to limit file size 5 years ago
Chris Lu 10bd3c6b4b refactoring 5 years ago
Chris Lu f60154f330 master load backend storage config from master.toml 5 years ago
Chris Lu 85f8649320 refactor memory mapped file into backend storage 5 years ago
Chris Lu 4b5ba4927f adjust NewDiskFile() paramaters 5 years ago
Chris Lu cd7ce720c7 fix test 5 years ago
Chris Lu 19b6a16003 changed from os.file to backend.DataStorageBackend 5 years ago
Chris Lu 7a51a9a582 refactor: simplifying to ReadAt() and WriteAt() 5 years ago
Chris Lu 46ed2ca902 refactoring 5 years ago
Chris Lu c9a183eb69 refactor memory map related code 5 years ago
Chris Lu faec9076a4 adjust parameter names 5 years ago
j.laycock eb27c2b037 Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size. 5 years ago
j.laycock 6fc6322c90 Change joeslay paths to chrislusf paths 5 years ago
j.laycock 63acc8c972 rename mem_buffer to mBuffer 5 years ago
Tom Maxwell 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve 5 years ago
j.laycock cc756ddd79 Rename End_of_file variable, implement platform indepenent memory_map.go 5 years ago
j.laycock 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct 5 years ago
j.laycock 595a1beff0 Swap imports to use joeslay 5 years ago
j.laycock 840ccdc35d Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly 5 years ago
j.laycock 0e5d3b1a70 Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files 5 years ago
Chris Lu c2960c7a86 defaulting file ttl to volume ttl 6 years ago
Chris Lu f88a8bda7b ec deletion works 6 years ago
Chris Lu 302d9fbc6d adjust error message for file not found 6 years ago
Chris Lu 4f76342cbc WIP 6 years ago
Chris Lu b4b407e403 add grpc ec shard read 6 years ago
Wine93 32f93fb09e style: go fmt for all 6 years ago
stlpmo-jn 2200ea9cb9 add function ParseFileIdFromString 6 years ago
Chris Lu 0be2d51c96 read volume lastAppendAtNs when loading a volume 6 years ago
Chris Lu ac2727853f fix needle map entry size 6 years ago
Chris Lu e5506152c0 refactoring 6 years ago
Chris Lu b142f9f1d5 go fmt 6 years ago
Chris Lu 7a4b234ea1 divide offset into higher and lower sections 6 years ago
Chris Lu 000ee725fc refactor Offset into a struct of bytes 6 years ago
Chris Lu 95ef4513c8 print out memory size 6 years ago
Chris Lu 346541a101 print out per entry memory usage 6 years ago
Chris Lu 09471b46f9 fix related tests 6 years ago
Chris Lu 5668ed798d memory needle map mark size to be TombstoneFileSize 6 years ago
Chris Lu 141d302492 fix binarySearchCompactSection 6 years ago
Chris Lu 36d13355bb compact map fix bug when iterating 6 years ago