Chris Lu
							
						 
						
							
							
							
								
							
								38f4425a65 
								
							
								 
							
						 
						
							
							
								
								checking error  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								79d11ac951 
								
							
								 
							
						 
						
							
							
								
								go vet  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								d4e5a22e53 
								
							
								 
							
						 
						
							
							
								
								rename from cmd to weed for easier "go build"  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								37a1a70cc3 
								
							
								 
							
						 
						
							
							
								
								remove unused files  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								7743ddd7db 
								
							
								 
							
						 
						
							
							
								
								Merge remote-tracking branch 'origin/master'  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								5071f528f6 
								
							
								 
							
						 
						
							
							
								
								testing compilation with remove package  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								7e0951ad9c 
								
							
								 
							
						 
						
							
							
								
								testing compilation with remove package  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								55f2627fcf 
								
							
								 
							
						 
						
							
							
								
								testing new directory structure  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								ab6fb13ad7 
								
							
								 
							
						 
						
							
							
								
								avoid the "src" folder  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								1b6f53cdac 
								
							
								 
							
						 
						
							
							
								
								remove binary accidentally checked in  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								cb4e8ec16b 
								
							
								 
							
						 
						
							
							
								
								re-organize code directory structure  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								d3b267bac2 
								
							
								 
							
						 
						
							
							
								
								Issue 15:	Stress test corrupts volume  
							
							 
							
							 
							
							
								
 
							
							
							Checked in for GThomas(tgulacsi78)
I've also met with partial writes (pipe closed on localhost), and also
met with real corruption: after some partial write, the data size in
needle header was read as some huuuuge number, which resulted in memory
panic.
Please consider the attached patch for ensuring full writes (seeks back
to the beginning on needle append error). Hope this helps.
Tested with a small tmpfs, lot of "no space left on device" :)
(sudo umount -lf /tmp/weed; mkdir -p /tmp/weed && sudo mount -o
size=128M,mode=4777 -t tmpfs tmpfs /tmp/weed && bin/weed master
-mdir=/tmp/weed -debug=true & bin/weed volume -dir=/tmp/weed
-debug=true)
GThomas 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								0b7a235c17 
								
							
								 
							
						 
						
							
							
								
								ensure file name does not contain any "/"  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								f2af477324 
								
							
								 
							
						 
						
							
							
								
								added file name format when exporting. patch from Tamás Gulácsi  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								84e1a59df7 
								
							
								 
							
						 
						
							
							
								
								add option to output to stdout - patch from Tamás Gulácsi  
							
							 
							
							 
							
							
								
 
							
							
							report file size correctly 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								030dde227a 
								
							
								 
							
						 
						
							
							
								
								promptive error message  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								06444b7c52 
								
							
								 
							
						 
						
							
							
								
								up the version to 0.28 beta  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								c3ef8b433c 
								
							
								 
							
						 
						
							
							
								
								adjust text  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								97556f6023 
								
							
								 
							
						 
						
							
							
								
								formatting  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								81b9175c7a 
								
							
								 
							
						 
						
							
							
								
								re-factoring volume file scanning code  
							
							 
							
							 
							
							
								
 
							
							
							add export function
fix bugs on deleted byte counting 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								f35b958d90 
								
							
								 
							
						 
						
							
							
								
								adding visit function for the NeedleMap  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								866d15023d 
								
							
								 
							
						 
						
							
							
								
								better error handling, check in for Gulácsi Tamás  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								768eaff4b8 
								
							
								 
							
						 
						
							
							
								
								fix debug message error  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								ec7dfeeaf8 
								
							
								 
							
						 
						
							
							
								
								ignore compiled binary file  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								921f1c626a 
								
							
								 
							
						 
						
							
							
								
								fix debug message displaying  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								b0c7df0c3b 
								
							
								 
							
						 
						
							
							
								
								go fmt for all source codes  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								ca9056d673 
								
							
								 
							
						 
						
							
							
								
								cosmetics change  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								84c9ac66ac 
								
							
								 
							
						 
						
							
							
								
								add git ignore  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								50fafa3a2c 
								
							
								 
							
						 
						
							
							
								
								Revert "sort writables to be able to skew write probability to lesser ids (older volumes)"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit ce7394f3bf . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								a502b78c3f 
								
							
								 
							
						 
						
							
							
								
								Revert "add error return for (Un)GzipData"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit 8243710351 . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								bf9c4ed033 
								
							
								 
							
						 
						
							
							
								
								Revert "add cmd/dump - a dumper"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit 5d2a1e8d48 . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								d1494ea786 
								
							
								 
							
						 
						
							
							
								
								Revert "add CdbMap"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit bf0ccf3461 . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								5b49065a57 
								
							
								 
							
						 
						
							
							
								
								Revert "add Frozen attribute to VolumeInfo"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit dd685fdd8d . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								3b21317863 
								
							
								 
							
						 
						
							
							
								
								Revert "add "freeze" subcommand to volume"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit f262fed197 . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								ee08e38126 
								
							
								 
							
						 
						
							
							
								
								Revert "fix errors with frozen volume loading"  
							
							 
							
							 
							
							
								
 
							
							
							This reverts commit 92ffba2ab9 . 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								be83a56bb9 
								
							
								 
							
						 
						
							
							
								
								Merge remote-tracking branch 'choose_remote_name/cdb'  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								5f278c6bd7 
								
							
								 
							
						 
						
							
							
								
								move to 0.27  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								92ffba2ab9 
								
							
								 
							
						 
						
							
							
								
								fix errors with frozen volume loading  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								f262fed197 
								
							
								 
							
						 
						
							
							
								
								add "freeze" subcommand to volume  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								dd685fdd8d 
								
							
								 
							
						 
						
							
							
								
								add Frozen attribute to VolumeInfo  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								bf0ccf3461 
								
							
								 
							
						 
						
							
							
								
								add CdbMap  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								5d2a1e8d48 
								
							
								 
							
						 
						
							
							
								
								add cmd/dump - a dumper  
							
							 
							
							 
							
							
								
 
							
							
							Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose. 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								8243710351 
								
							
								 
							
						 
						
							
							
								
								add error return for (Un)GzipData  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Tamás Gulácsi
							
						 
						
							
							
							
								
							
								ce7394f3bf 
								
							
								 
							
						 
						
							
							
								
								sort writables to be able to skew write probability to lesser ids (older volumes)  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								8fb8ebdf14 
								
							
								 
							
						 
						
							
							
								
								master can redirect GET/DELETE/POST requests to volume servers. So  
							
							 
							
							 
							
							
								
 
							
							
							clients does not always need to remember the volume server locations.
This is good for low~medium sized web site traffic. 
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								e9eb8949ba 
								
							
								 
							
						 
						
							
							
								
								set to beta version for 0.27  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								3c8dd8592a 
								
							
								 
							
						 
						
							
							
								
								compare read file size with in-memory file size  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								c35fe9d631 
								
							
								 
							
						 
						
							
							
								
								escape file name when there is a quote inside  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								018f0b73be 
								
							
								 
							
						 
						
							
							
								
								properly handle quick volume server restart  
							
							 
							
							
								
 
							
							
						 
						13 years ago  
					 
				
					
						
							
							
								 
								Chris Lu
							
						 
						
							
							
							
								
							
								264678c9b1 
								
							
								 
							
						 
						
							
							
								
								Default more not to gzip since gzip can be done on client side.  
							
							 
							
							
								
 
							
							
						 
						13 years ago