vadimartynov
							
						 
						
							
							
								
								
							
							
								
							
								8aae82dd71 
								
									
								
							
								 
							
						 
						
							
							
								
								Added context for the MasterClient's methods to avoid endless loops ( #5628 )  
							
							 
							
							 
							
							
								
 
							
							
							* Added context for the MasterClient's methods to avoid endless loops
* Returned WithClient function. Added WithClientCustomGetMaster function
* Hid unused ctx arguments
* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions
* Changed the context termination check in the tryConnectToMaster function
* Added a child context to the tryConnectToMaster function
* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark 
							
						 
						1 year ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								89a1fd1751 
								
							
								 
							
						 
						
							
							
								
								Squashed commit of the following:  
							
							 
							
							 
							
							
								
 
							
							
							commit 4827425146 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Sep 16 15:05:38 2023 -0700
    balancer works
commit 3b50139f68 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:22:32 2023 -0700
    comments
commit 7f685ce7ba 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 15 22:20:05 2023 -0700
    adjust APIs
commit 436d99443b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 14 23:49:05 2023 -0700
    receive broker stats
commit b771fefa37 
Merge: 0a851ec00  890881037 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 13 00:03:47 2023 -0700
    Merge branch 'master' into sub
commit 0a851ec00b 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Sep 10 22:01:25 2023 -0700
    Create balancer.go
commit 39941edc0b 
Author: chrislu <chris.lu@gmail.com>
Date:   Thu Sep 7 23:55:19 2023 -0700
    add publisher shutdown
commit 875f562779 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:16:41 2023 -0700
    server side send response at least once per second
commit 984b6c54cf 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 23:15:29 2023 -0700
    ack interval 128
commit 2492a45499 
Author: chrislu <chris.lu@gmail.com>
Date:   Wed Sep 6 22:39:46 2023 -0700
    ack interval
commit ba67e6ca29 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:50 2023 -0700
    api for sub
commit 9e4f985698 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Sep 4 21:43:30 2023 -0700
    publish, benchmark
commit cb470d44df 
Author: chrislu <chris.lu@gmail.com>
Date:   Fri Sep 1 00:36:51 2023 -0700
    can pub and sub
commit 1eb2da46d5 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:02:12 2023 -0700
    connect and publish
commit 504ae8383a 
Author: chrislu <chris.lu@gmail.com>
Date:   Mon Aug 28 09:01:25 2023 -0700
    protoc version
commit dbcba75271 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:59:04 2023 -0700
    rename to lookup
commit c9caf33119 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 18:33:46 2023 -0700
    move functions
commit 4d6c18d86f 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 17:50:59 2023 -0700
    pub sub initial tests
commit 4eb8e8624d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:14:39 2023 -0700
    rename
commit 1990456670 
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 27 13:13:14 2023 -0700
    sub
commit 905911853d 
Author: chrislu <chris.lu@gmail.com>
Date:   Sat Aug 26 13:39:21 2023 -0700
    adjust proto 
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4827425146 
								
							
								 
							
						 
						
							
							
								
								balancer works  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								Nico D'Cotta
							
						 
						
							
							
								
								
							
							
								
							
								796b7508f3 
								
									
								
							
								 
							
						 
						
							
							
								
								Implement SRV lookups for filer ( #4767 )  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								31b2751aff 
								
							
								 
							
						 
						
							
							
								
								clone volume locations in case they are changed  
							
							 
							
							 
							
							
								
 
							
							
							fix https://github.com/seaweedfs/seaweedfs/issues/4642  
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								8ec1bc2c99 
								
							
								 
							
						 
						
							
							
								
								remove unused cluster node leader  
							
							 
							
							
								
 
							
							
						 
						2 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3cc7b90414 
								
							
								 
							
						 
						
							
							
								
								print wait in progress  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								5294b6dd4d 
								
							
								 
							
						 
						
							
							
								
								remove volume server tcp client  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Ryan Russell
							
						 
						
							
							
								
								
							
							
								
							
								150ce9f3f6 
								
									
								
							
								 
							
						 
						
							
							
								
								docs(wdclient): readability fix ( #3685 )  
							
							 
							
							 
							
							
								
 
							
							
							Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org> 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Ryan Russell
							
						 
						
							
							
								
								
							
							
								
							
								72d8a9f9a8 
								
									
								
							
								 
							
						 
						
							
							
								
								refactor(exclusive_locker): `Interval` readability batch of updates ( #3668 )  
							
							 
							
							 
							
							
								
 
							
							
							* refactor(filechunk_manifest): `localProcesed` -> `localProcessed`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `saveChunkedFileIntevalToStorage` -> `saveChunkedFileIntervalToStorage`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `SafeRenewInteval` -> `SafeRenewInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `InitLockInteval` -> `InitLockInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `RenewInteval` -> `RenewInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org> 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Ryan Russell
							
						 
						
							
							
								
								
							
							
								
							
								c9f573eed8 
								
									
								
							
								 
							
						 
						
							
							
								
								docs: `indicates` readability comment fix ( #3659 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								721c6197f9 
								
									
								
							
								 
							
						 
						
							
							
								
								skip deltaBeat if dn is zero ( #3630 )  
							
							 
							
							 
							
							
								
 
							
							
							* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629 
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								01a25755c5 
								
									
								
							
								 
							
						 
						
							
							
								
								[filer] masterClient updates volume adjust log level ( #3610 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								LHHDZ
							
						 
						
							
							
								
								
							
							
								
							
								bc629665de 
								
									
								
							
								 
							
						 
						
							
							
								
								fix bug due to data racing on VidMap ( #3606 )  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								de5263364b 
								
							
								 
							
						 
						
							
							
								
								master client: use GetMaster() for latest master address  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								e583dbdd2a 
								
							
								 
							
						 
						
							
							
								
								more detailed error  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								ae6292f9f0 
								
							
								 
							
						 
						
							
							
								
								rename variable  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								e16dda88e4 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid race conditions access to  MasterClient.currentMaster ( #3538 )  
							
							 
							
							 
							
							
								
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/3510  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								f5156cf3a8 
								
							
								 
							
						 
						
							
							
								
								rename varaible  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								e90ab4ac60 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid race conditions for OnPeerUpdate ( #3525 )  
							
							 
							
							 
							
							
								
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/3524  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								askeipx
							
						 
						
							
							
								
								
							
							
								
							
								2e78a522ab 
								
									
								
							
								 
							
						 
						
							
							
								
								remove old raft servers if they don't answer to pings for too long ( #3398 )  
							
							 
							
							 
							
							
								
 
							
							
							* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								57e7582c36 
								
							
								 
							
						 
						
							
							
								
								refactoring  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								cb476a53ff 
								
							
								 
							
						 
						
							
							
								
								remove logs  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								4d4cd0948d 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid infinite loop WaitUntilConnected() ( #3431 )  
							
							 
							
							 
							
							
								
 
							
							
							https://github.com/seaweedfs/seaweedfs/issues/3421  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								4d08393b7c 
								
									
								
							
								 
							
						 
						
							
							
								
								filer prefer volume server in same data center ( #3405 )  
							
							 
							
							 
							
							
								
 
							
							
							* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404 
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
								
								
							
							
								
							
								22181dd018 
								
									
								
							
								 
							
						 
						
							
							
								
								refactor FilerRequest metrics ( #3402 )  
							
							 
							
							 
							
							
								
 
							
							
							* refactor FilerRequest metrics
* avoid double count proxy
* defer to 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								be0ec7bc2f 
								
							
								 
							
						 
						
							
							
								
								fix test  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								1f161f53dc 
								
							
								 
							
						 
						
							
							
								
								add back rack  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								68065128b8 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								LHHDZ
							
						 
						
							
							
							
								
							
								994a2dec78 
								
							
								 
							
						 
						
							
							
								
								fix `vid_map_test` tests  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								LHHDZ
							
						 
						
							
							
							
								
							
								58c02d6429 
								
							
								 
							
						 
						
							
							
								
								Solve the problem that `LookupFileId` lookup urls is empty due to leader switching  
							
							 
							
							 
							
							
								
 
							
							
							The vidMap structure is modified to a linked list structure (the length is limited to 5). When the vidMap is reset, the current vidMap is added to the new vidMap as a cache node. When the query locations is empty, the cache node is searched to avoid problems when the master switches leaders. 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
							
								
							
								01996bccf8 
								
							
								 
							
						 
						
							
							
								
								Use fallback if urls are not found  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								9f20d3ebd1 
								
							
								 
							
						 
						
							
							
								
								add dc and rack  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								石昌林
							
						 
						
							
							
							
								
							
								200a862701 
								
							
								 
							
						 
						
							
							
								
								fixed `volume xx not found` caused by missing VolumeLocation events  
							
							 
							
							 
							
							
								
 
							
							
							When the requested master node is the leader, `VolumeLocation` or `ClusterNodeUpdate` may be returned here. If it is `VolumeLocation`, the update will be performed while resetting the vidMap, otherwise the event will be lost 
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
							
								
							
								9bff097b01 
								
							
								 
							
						 
						
							
							
								
								currentMaster redirected  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
							
								
							
								6c20a3b622 
								
							
								 
							
						 
						
							
							
								
								avoid set currentMaster k8s svc.local discoveruy service domains  
							
							 
							
							 
							
							
								
 
							
							
							https://github.com/chrislusf/seaweedfs/issues/2589  
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								3ce46c3566 
								
							
								 
							
						 
						
							
							
								
								fix entry full url lookup  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								石昌林
							
						 
						
							
							
							
								
							
								f1ea906c13 
								
							
								 
							
						 
						
							
							
								
								Code comment optimization  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								石昌林
							
						 
						
							
							
							
								
							
								0c8e033e68 
								
							
								 
							
						 
						
							
							
								
								When the connection with the leader is disconnected, the vidMap should not be reset immediately, but should be reset after connecting to a new leader  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								9c517d2b35 
								
							
								 
							
						 
						
							
							
								
								masterclient: fallback to directly querying master in case of missing volume id location  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								ningfd
							
						 
						
							
							
							
								
							
								338705f375 
								
							
								 
							
						 
						
							
							
								
								fix(wdclient): GetLocations return  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								6adc42147f 
								
							
								 
							
						 
						
							
							
								
								fresh filer store bootstrap from the oldest peer  
							
							 
							
							
								
 
							
							
						 
						3 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								94635e9b5c 
								
							
								 
							
						 
						
							
							
								
								filer: add filer group  
							
							 
							
							
								
 
							
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								bc888226fc 
								
							
								 
							
						 
						
							
							
								
								erasure coding: tracking encoded/decoded volumes  
							
							 
							
							 
							
							
								
 
							
							
							If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here. 
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								4b5c0e3fa9 
								
							
								 
							
						 
						
							
							
								
								check cluster connectivities  
							
							 
							
							
								
 
							
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								21e0898631 
								
							
								 
							
						 
						
							
							
								
								refactor: change masters from a slice to a map  
							
							 
							
							
								
 
							
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								433fde4b18 
								
							
								 
							
						 
						
							
							
								
								move error to a separate file  
							
							 
							
							 
							
							
								
 
							
							
							This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing" 
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								Konstantin Lebedev
							
						 
						
							
							
							
								
							
								28efe31524 
								
							
								 
							
						 
						
							
							
								
								new master metrics  
							
							 
							
							
								
 
							
							
						 
						4 years ago  
					 
				
					
						
							
							
								 
								chrislu
							
						 
						
							
							
							
								
							
								9f9ef1340c 
								
							
								 
							
						 
						
							
							
								
								use streaming mode for long poll grpc calls  
							
							 
							
							 
							
							
								
 
							
							
							streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed. 
							
						 
						4 years ago