117 Commits (77e4b1376e55e3437d5d18f3fe4c7003882121e8)

Author SHA1 Message Date
Kimbsen ffddecebef do md5 validation AFTER decompression 5 years ago
Chris Lu fe60db404a prepare for zstd 5 years ago
Kimbsen 6b1e93ba0b check request header not part header for content-encoding 5 years ago
Kimbsen 38626cb584 don't forget the last few bytes 5 years ago
Kimbsen 8d1f6cd567 added optional md5 verification of uploaded data 5 years ago
Chris Lu de5ca9b258 remove fixJpgOrientation 5 years ago
Chris Lu 3080c197e3 rename UnCompressData to DecompressData 5 years ago
Chris Lu e912fd15e3 renaming 5 years ago
Chris Lu 16fe132a20 detect mime type before replicating to other volume servers 5 years ago
Chris Lu 7ccc31853c hard limit volume file size 5 years ago
Chris Lu 5568395edd Revert "Revert "Merge pull request #1299 from song-zhang/master"" 5 years ago
zhangsong 3703c7e176 write request keep compatible with before 5 years ago
Chris Lu afb6a1dbb4 Revert "Merge pull request #1299 from song-zhang/master" 5 years ago
zhangsong f9e8702bb4 use async write to persistent file to disk - part1 5 years ago
Chris Lu 22400c6633 consistent gzip logic 5 years ago
Chris Lu 9b3109a5d8 filer: processing all response headers, no pass through to volume server 5 years ago
Chris Lu 1ae83c2938 go fmt 5 years ago
Chris Lu ea1169dc80 filer cipher: single chunk http POST and PUT and read 5 years ago
Chris Lu 7335e62199 volume: PUT also conditionally gzip compress 5 years ago
Chris Lu 943f4986ef fix possible nil 5 years ago
Chris Lu 9995d3bcb5 remove println 5 years ago
Chris Lu 3eafec4b29 volume: add option to limit file size 5 years ago
Chris Lu 10bd3c6b4b refactoring 5 years ago
Chris Lu f60154f330 master load backend storage config from master.toml 5 years ago
Chris Lu 85f8649320 refactor memory mapped file into backend storage 5 years ago
Chris Lu 4b5ba4927f adjust NewDiskFile() paramaters 5 years ago
Chris Lu cd7ce720c7 fix test 5 years ago
Chris Lu 19b6a16003 changed from os.file to backend.DataStorageBackend 5 years ago
Chris Lu 7a51a9a582 refactor: simplifying to ReadAt() and WriteAt() 5 years ago
Chris Lu 46ed2ca902 refactoring 5 years ago
Chris Lu c9a183eb69 refactor memory map related code 5 years ago
Chris Lu faec9076a4 adjust parameter names 5 years ago
j.laycock eb27c2b037 Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size. 5 years ago
j.laycock 6fc6322c90 Change joeslay paths to chrislusf paths 5 years ago
j.laycock 63acc8c972 rename mem_buffer to mBuffer 5 years ago
Tom Maxwell 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve 5 years ago
j.laycock cc756ddd79 Rename End_of_file variable, implement platform indepenent memory_map.go 5 years ago
j.laycock 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct 5 years ago
j.laycock 595a1beff0 Swap imports to use joeslay 5 years ago
j.laycock 840ccdc35d Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly 5 years ago
j.laycock 0e5d3b1a70 Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files 5 years ago
Chris Lu c2960c7a86 defaulting file ttl to volume ttl 6 years ago
Chris Lu f88a8bda7b ec deletion works 6 years ago
Chris Lu 302d9fbc6d adjust error message for file not found 6 years ago
Chris Lu 4f76342cbc WIP 6 years ago
Chris Lu b4b407e403 add grpc ec shard read 6 years ago
Wine93 32f93fb09e style: go fmt for all 6 years ago
stlpmo-jn 2200ea9cb9 add function ParseFileIdFromString 6 years ago
Chris Lu 0be2d51c96 read volume lastAppendAtNs when loading a volume 6 years ago
Chris Lu ac2727853f fix needle map entry size 6 years ago