00c621abb8 
								
									
								
							
								 
							
						 
						
							
							
								
								Fix dumb typo in  08556257 ( #6844 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bed0a64693 
								
									
								
							
								 
							
						 
						
							
							
								
								New `needle_map.CompactMap()` implementation for reduced memory usage ( #6842 )  
							
							
 
							
							
							* Rework `needle_map.CompactMap()` to maximize memory efficiency.
* Use a memory-efficient structure for `CompactMap` needle value entries.
This slightly complicates the code, but makes a **massive** difference
in memory efficiency - preliminary results show a ~30% reduction in
heap usage, with no measurable performance impact otherwise.
* Clean up type for `CompactMap` chunk IDs.
* Add a small comment description for `CompactMap()`.
* Add the old version of `CompactMap()` for comparison purposes. 
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b25561d0d7 
								
							
								 
							
						 
						
							
							
								
								3.89  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								d40746f34e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix insert beyond look back window ( #6838 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								9ffc8bcb54 
								
									
								
							
								 
							
						 
						
							
							
								
								Further improve memory usage of `needle_map.CompactMap()`. ( #6825 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								2e1506c31e 
								
									
								
							
								 
							
						 
						
							
							
								
								Rewrite `needle_map.CompactMap()` for more efficient memory usage ( #6813 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b7de4a967e 
								
									
								
							
								 
							
						 
						
							
							
								
								fix: compact_map get error mismatching cokie ( #3748 )  
							
							
 
							
							
							* fix: compact_map get error
* fix: CompactSection delete lock and move test to compact_map
Co-authored-by: shibinbin <shibinbin@megvii.com> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								21c0587900 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								625fd16a2e 
								
							
								 
							
						 
						
							
							
								
								reduce upfront memory usage for low density volume  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								24e11d1e90 
								
							
								 
							
						 
						
							
							
								
								look back when adding to sorted values  
							
							
 
							
							
							look back when adding to sorted values, before adding it to overflow 
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fc8dd58aea 
								
							
								 
							
						 
						
							
							
								
								volume: large_volume version has bug when using in memory index  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/2162  
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								99ecf63276 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fe01191b5b 
								
							
								 
							
						 
						
							
							
								
								support read option readDeleted=true  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6ccd7f0a4d 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6a92f0bc7a 
								
							
								 
							
						 
						
							
							
								
								refactoring to typed Size  
							
							
 
							
							
							Go is amazing with refactoring! 
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6fc6322c90 
								
							
								 
							
						 
						
							
							
								
								Change joeslay paths to chrislusf paths  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								595a1beff0 
								
							
								 
							
						 
						
							
							
								
								Swap imports to use joeslay  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec75b2d761 
								
							
								 
							
						 
						
							
							
								
								volume: fix bug with 8000GB version if using in memory index  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/994  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3f9ecee40f 
								
							
								 
							
						 
						
							
							
								
								working with reading remote intervals  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								87f63b9c08 
								
							
								 
							
						 
						
							
							
								
								generate ec01~ec14, generate ecx file with sorted needle values  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e5506152c0 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b142f9f1d5 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7a4b234ea1 
								
							
								 
							
						 
						
							
							
								
								divide offset into higher and lower sections  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5668ed798d 
								
							
								 
							
						 
						
							
							
								
								memory needle map mark size to be TombstoneFileSize  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/850  
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								141d302492 
								
							
								 
							
						 
						
							
							
								
								fix binarySearchCompactSection  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								36d13355bb 
								
							
								 
							
						 
						
							
							
								
								compact map fix bug when iterating  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								42cb9b76c4 
								
							
								 
							
						 
						
							
							
								
								reduce needle map memory usage by 25%  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5741134ca0 
								
							
								 
							
						 
						
							
							
								
								change overflow from map to slice  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec5a305624 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9d3be33e5c 
								
							
								 
							
						 
						
							
							
								
								optimize a little bit  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7e2031b18f 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d4d7ced922 
								
							
								 
							
						 
						
							
							
								
								refactoring: add type for needle id, offset  
							
							
 
							
							
							later the type size can possibly be adjusted 
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								82c3ccc8dd 
								
							
								 
							
						 
						
							
							
								
								add btree for volume index  
							
							
								
 
							
							
						 
						9 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								59022b6fe0 
								
							
								 
							
						 
						
							
							
								
								fix byte counter on loading index file  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/441  
							
						 
						9 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								01cbd5cb58 
								
							
								 
							
						 
						
							
							
								
								lock  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/367  
							
						 
						9 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								101e784577 
								
							
								 
							
						 
						
							
							
								
								add locking on possible concurrent map access  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/328  
							
						 
						9 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5ce6bbf076 
								
							
								 
							
						 
						
							
							
								
								directory structure change to work with glide  
							
							
 
							
							
							glide has its own requirements. My previous workaround caused me some
code checkin errors. Need to fix this. 
							
						 
						10 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								46a89a7d61 
								
							
								 
							
						 
						
							
							
								
								fix concurrent write map  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/311  
							
						 
						10 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								36a31771f1 
								
							
								 
							
						 
						
							
							
								
								Add Key String() function  
							
							
								
 
							
							
						 
						11 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								85bfab612c 
								
							
								 
							
						 
						
							
							
								
								Add comments  
							
							
								
 
							
							
						 
						11 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b07d81fb08 
								
							
								 
							
						 
						
							
							
								
								follow golint suggestions  
							
							
								
 
							
							
						 
						11 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								179d36ba0e 
								
							
								 
							
						 
						
							
							
								
								formatting code by: goimports -w=true .  
							
							
								
 
							
							
						 
						11 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								53eacb4341 
								
							
								 
							
						 
						
							
							
								
								fix issue 52  
							
							
 
							
							
							keep compact section sorted when input data are not ordered 
							
						 
						12 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ed154053c8 
								
							
								 
							
						 
						
							
							
								
								switching to temporarily use glog library  
							
							
								
 
							
							
						 
						12 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								79d11ac951 
								
							
								 
							
						 
						
							
							
								
								go vet  
							
							
								
 
							
							
						 
						13 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								5071f528f6 
								
							
								 
							
						 
						
							
							
								
								testing compilation with remove package  
							
							
								
 
							
							
						 
						13 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ab6fb13ad7 
								
							
								 
							
						 
						
							
							
								
								avoid the "src" folder  
							
							
								
 
							
							
						 
						13 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								cb4e8ec16b 
								
							
								 
							
						 
						
							
							
								
								re-organize code directory structure  
							
							
								
 
							
							
						 
						13 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f35b958d90 
								
							
								 
							
						 
						
							
							
								
								adding visit function for the NeedleMap  
							
							
								
 
							
							
						 
						13 years ago