4511c2cc1f 
								
									
								
							
								 
							
						 
						
							
							
								
								Changes logging function ( #6919 )  
							
							
 
							
							
							* updated logging methods for stores
* updated logging methods for stores
* updated logging methods for filer
* updated logging methods for uploader and http_util
* updated logging methods for weed server
---------
Co-authored-by: akosov <a.kosov@kryptonite.ru> 
							
						 
						4 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								90c128e7a6 
								
									
								
							
								 
							
						 
						
							
							
								
								Context-based logging with request ID ( #6899 )  
							
							
								
 
							
							
						 
						4 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c602f53a6e 
								
							
								 
							
						 
						
							
							
								
								tail-volume-uses-the-source-volume-version  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								96632a34b1 
								
							
								 
							
						 
						
							
							
								
								add version to volume proto  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								283d9e0079 
								
									
								
							
								 
							
						 
						
							
							
								
								Add context with request ( #6824 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								165af32d6b 
								
									
								
							
								 
							
						 
						
							
							
								
								added context to filer_client method calls ( #6808 )  
							
							
 
							
							
							Co-authored-by: akosov <a.kosov@kryptonite.ru> 
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								5182d46e22 
								
									
								
							
								 
							
						 
						
							
							
								
								Added middleware for processing request_id grpc and http requests ( #6805 )  
							
							
								
 
							
							
						 
						5 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9d8b975ff9 
								
							
								 
							
						 
						
							
							
								
								sync pb  
							
							
								
 
							
							
						 
						7 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								02773a6107 
								
									
								
							
								 
							
						 
						
							
							
								
								Accumulated changes for message queue ( #6600 )  
							
							
 
							
							
							* rename
* set agent address
* refactor
* add agent sub
* pub messages
* grpc new client
* can publish records via agent
* send init message with session id
* fmt
* check cancelled request while waiting
* use sessionId
* handle possible nil stream
* subscriber process messages
* separate debug port
* use atomic int64
* less logs
* minor
* skip io.EOF
* rename
* remove unused
* use saved offsets
* do not reuse session, since always session id is new after restart
remove last active ts from SessionEntry
* simplify printing
* purge unused
* just proxy the subscription, skipping the session step
* adjust offset types
* subscribe offset type and possible value
* start after the known tsns
* avoid wrongly set startPosition
* move
* remove
* refactor
* typo
* fix
* fix changed path 
							
						 
						8 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								cc05874d06 
								
									
								
							
								 
							
						 
						
							
							
								
								Add message queue agent ( #6463 )  
							
							
 
							
							
							* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent 
							
						 
						9 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								3b1ac77e1f 
								
									
								
							
								 
							
						 
						
							
							
								
								worm grace period and retention time support ( #6404 )  
							
							
 
							
							
							Signed-off-by: lou <alex1988@outlook.com> 
							
						 
						10 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec155022e7 
								
							
								 
							
						 
						
							
							
								
								"golang.org/x/exp/slices" => "slices" and go fmt  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9873b033d1 
								
							
								 
							
						 
						
							
							
								
								backward compatible vif loading  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2f3d820f52 
								
							
								 
							
						 
						
							
							
								
								rename proto field  
							
							
 
							
							
							This should not have any impact. 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ae5bd0667a 
								
							
								 
							
						 
						
							
							
								
								rename proto field from DestroyTime to expire_at_sec  
							
							
 
							
							
							For TTL volume converted into EC volume, this change may leave the volumes staying. 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								4dc33cc143 
								
									
								
							
								 
							
						 
						
							
							
								
								fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )  
							
							
 
							
							
							the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								d056c0ddf2 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(volume): don't persist RO state in specific cases ( #6058 )  
							
							
 
							
							
							* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								6c986e9d70 
								
									
								
							
								 
							
						 
						
							
							
								
								improve worm support ( #5983 )  
							
							
 
							
							
							* improve worm support
Signed-off-by: lou <alex1988@outlook.com>
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com>
* remove flag
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* typo
Signed-off-by: lou <alex1988@outlook.com>
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								15965f7c54 
								
									
								
							
								 
							
						 
						
							
							
								
								[shell] fix volume grow in shell ( #5992 )  
							
							
 
							
							
							* fix volume grow in shell
* revert add Async
* check available volume space
* create a VolumeGrowRequest and remove unnecessary fields 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								f9e141a412 
								
									
								
							
								 
							
						 
						
							
							
								
								persist readonly state to volume info ( #5977 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a4b25a642d 
								
							
								 
							
						 
						
							
							
								
								math/rand => math/rand/v2  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0cf2c15828 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								0b00706454 
								
									
								
							
								 
							
						 
						
							
							
								
								EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )  
							
							
 
							
							
							* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com> 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								fdf7193ae7 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								07f4998188 
								
							
								 
							
						 
						
							
							
								
								add dat file size into vif for EC  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								4fee496b49 
								
							
								 
							
						 
						
							
							
								
								conditional delete  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9dd008f8f1 
								
							
								 
							
						 
						
							
							
								
								add version to filer  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9dcc576499 
								
							
								 
							
						 
						
							
							
								
								Revert "add collection for buckets"  
							
							
 
							
							
							This reverts commit 96af571219 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								96af571219 
								
							
								 
							
						 
						
							
							
								
								add collection for buckets  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c030cb3ce9 
								
							
								 
							
						 
						
							
							
								
								bootstrap filer from one peer  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								7988ee0805 
								
									
								
							
								 
							
						 
						
							
							
								
								[fs.verify] skip failed files if entry not found on filerStore ( #5693 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								464611f614 
								
							
								 
							
						 
						
							
							
								
								optionally skip deleting file chunks  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f8a22038c5 
								
							
								 
							
						 
						
							
							
								
								passing along publisher name  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								edc87c16f9 
								
							
								 
							
						 
						
							
							
								
								balance subscribers  
							
							
 
							
							
							need to ensure the offsets are persisted 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d40b350f54 
								
							
								 
							
						 
						
							
							
								
								coordinator receives unassignment ack  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2190d59bc3 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
 
							
							
							ToDo
1. handle unassignment on client side
2. get notified of completed unassignment
3. in consumer_group.go, balance and send unassignment 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3b7f24b1fc 
								
							
								 
							
						 
						
							
							
								
								unused  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d8ab22012a 
								
							
								 
							
						 
						
							
							
								
								track offset  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								c6db3f31a1 
								
							
								 
							
						 
						
							
							
								
								start consuming ASAP  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b1871427c3 
								
							
								 
							
						 
						
							
							
								
								persist consumer group offset  
							
							
 
							
							
							1. use one follower
2. read write consumer group offset 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								94742b8ace 
								
							
								 
							
						 
						
							
							
								
								add subscribe follower  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								372bd8d71d 
								
							
								 
							
						 
						
							
							
								
								consumer instance passing MaxPartitionCount to coordinator  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7a9b115cc2 
								
							
								 
							
						 
						
							
							
								
								rename  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f2f4630029 
								
							
								 
							
						 
						
							
							
								
								rename field types  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								111a4e1126 
								
							
								 
							
						 
						
							
							
								
								add field index  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								cc1ce3de87 
								
							
								 
							
						 
						
							
							
								
								all record fields are optional by default  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0847a17484 
								
							
								 
							
						 
						
							
							
								
								convert to parquet schema and value  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								04fb4c34e3 
								
							
								 
							
						 
						
							
							
								
								add proto for value  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								48fe50df81 
								
							
								 
							
						 
						
							
							
								
								minor  
							
							
								
 
							
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0cbf364a3d 
								
							
								 
							
						 
						
							
							
								
								all fields are optional  
							
							
								
 
							
							
						 
						2 years ago