Chris Lu
5071f528f6
testing compilation with remove package
12 years ago
Chris Lu
7e0951ad9c
testing compilation with remove package
12 years ago
Chris Lu
55f2627fcf
testing new directory structure
12 years ago
Chris Lu
ab6fb13ad7
avoid the "src" folder
12 years ago
Chris Lu
1b6f53cdac
remove binary accidentally checked in
12 years ago
Chris Lu
cb4e8ec16b
re-organize code directory structure
12 years ago
Chris Lu
d3b267bac2
Issue 15: Stress test corrupts volume
Checked in for GThomas(tgulacsi78)
I've also met with partial writes (pipe closed on localhost), and also
met with real corruption: after some partial write, the data size in
needle header was read as some huuuuge number, which resulted in memory
panic.
Please consider the attached patch for ensuring full writes (seeks back
to the beginning on needle append error). Hope this helps.
Tested with a small tmpfs, lot of "no space left on device" :)
(sudo umount -lf /tmp/weed; mkdir -p /tmp/weed && sudo mount -o
size=128M,mode=4777 -t tmpfs tmpfs /tmp/weed && bin/weed master
-mdir=/tmp/weed -debug=true & bin/weed volume -dir=/tmp/weed
-debug=true)
GThomas
12 years ago
Chris Lu
0b7a235c17
ensure file name does not contain any "/"
12 years ago
Chris Lu
f2af477324
added file name format when exporting. patch from Tamás Gulácsi
12 years ago
Chris Lu
84e1a59df7
add option to output to stdout - patch from Tamás Gulácsi
report file size correctly
12 years ago
Chris Lu
030dde227a
promptive error message
12 years ago
Chris Lu
06444b7c52
up the version to 0.28 beta
12 years ago
Chris Lu
c3ef8b433c
adjust text
12 years ago
Chris Lu
97556f6023
formatting
12 years ago
Chris Lu
81b9175c7a
re-factoring volume file scanning code
add export function
fix bugs on deleted byte counting
12 years ago
Chris Lu
f35b958d90
adding visit function for the NeedleMap
12 years ago
Chris Lu
866d15023d
better error handling, check in for Gulácsi Tamás
12 years ago
Chris Lu
768eaff4b8
fix debug message error
12 years ago
Chris Lu
ec7dfeeaf8
ignore compiled binary file
12 years ago
Chris Lu
921f1c626a
fix debug message displaying
12 years ago
Chris Lu
b0c7df0c3b
go fmt for all source codes
12 years ago
Chris Lu
ca9056d673
cosmetics change
12 years ago
Chris Lu
84c9ac66ac
add git ignore
12 years ago
Chris Lu
50fafa3a2c
Revert "sort writables to be able to skew write probability to lesser ids (older volumes)"
This reverts commit ce7394f3bf
.
12 years ago
Chris Lu
a502b78c3f
Revert "add error return for (Un)GzipData"
This reverts commit 8243710351
.
12 years ago
Chris Lu
bf9c4ed033
Revert "add cmd/dump - a dumper"
This reverts commit 5d2a1e8d48
.
12 years ago
Chris Lu
d1494ea786
Revert "add CdbMap"
This reverts commit bf0ccf3461
.
12 years ago
Chris Lu
5b49065a57
Revert "add Frozen attribute to VolumeInfo"
This reverts commit dd685fdd8d
.
12 years ago
Chris Lu
3b21317863
Revert "add "freeze" subcommand to volume"
This reverts commit f262fed197
.
12 years ago
Chris Lu
ee08e38126
Revert "fix errors with frozen volume loading"
This reverts commit 92ffba2ab9
.
12 years ago
Chris Lu
be83a56bb9
Merge remote-tracking branch 'choose_remote_name/cdb'
12 years ago
Chris Lu
5f278c6bd7
move to 0.27
12 years ago
Tamás Gulácsi
92ffba2ab9
fix errors with frozen volume loading
12 years ago
Tamás Gulácsi
f262fed197
add "freeze" subcommand to volume
12 years ago
Tamás Gulácsi
dd685fdd8d
add Frozen attribute to VolumeInfo
12 years ago
Tamás Gulácsi
bf0ccf3461
add CdbMap
12 years ago
Tamás Gulácsi
5d2a1e8d48
add cmd/dump - a dumper
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
12 years ago
Tamás Gulácsi
8243710351
add error return for (Un)GzipData
12 years ago
Tamás Gulácsi
ce7394f3bf
sort writables to be able to skew write probability to lesser ids (older volumes)
12 years ago
Chris Lu
8fb8ebdf14
master can redirect GET/DELETE/POST requests to volume servers. So
clients does not always need to remember the volume server locations.
This is good for low~medium sized web site traffic.
12 years ago
Chris Lu
e9eb8949ba
set to beta version for 0.27
12 years ago
Chris Lu
3c8dd8592a
compare read file size with in-memory file size
12 years ago
Chris Lu
c35fe9d631
escape file name when there is a quote inside
12 years ago
Chris Lu
018f0b73be
properly handle quick volume server restart
12 years ago
Chris Lu
264678c9b1
Default more not to gzip since gzip can be done on client side.
12 years ago
Chris Lu
46b8c4cc98
use bits in needle.Flags to mark hasName and hasMime
12 years ago
Chris Lu
9b95430e9f
add store metadata:file name, mime type, is_gzipped
add support to upload .gz file directly
12 years ago
Chris Lu
37afb31d05
parallel logic for read and write
12 years ago
Chris Lu
315879ce47
fix write error
12 years ago
Chris Lu
1943647860
can read/write files in format version 2
12 years ago