vadimartynov
8aae82dd71
Added context for the MasterClient's methods to avoid endless loops ( #5628 )
* Added context for the MasterClient's methods to avoid endless loops
* Returned WithClient function. Added WithClientCustomGetMaster function
* Hid unused ctx arguments
* Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions
* Changed the context termination check in the tryConnectToMaster function
* Added a child context to the tryConnectToMaster function
* Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
6 months ago
chrislu
89a1fd1751
Squashed commit of the following:
commit 4827425146
Author: chrislu <chris.lu@gmail.com>
Date: Sat Sep 16 15:05:38 2023 -0700
balancer works
commit 3b50139f68
Author: chrislu <chris.lu@gmail.com>
Date: Fri Sep 15 22:22:32 2023 -0700
comments
commit 7f685ce7ba
Author: chrislu <chris.lu@gmail.com>
Date: Fri Sep 15 22:20:05 2023 -0700
adjust APIs
commit 436d99443b
Author: chrislu <chris.lu@gmail.com>
Date: Thu Sep 14 23:49:05 2023 -0700
receive broker stats
commit b771fefa37
Merge: 0a851ec00
890881037
Author: chrislu <chris.lu@gmail.com>
Date: Wed Sep 13 00:03:47 2023 -0700
Merge branch 'master' into sub
commit 0a851ec00b
Author: chrislu <chris.lu@gmail.com>
Date: Sun Sep 10 22:01:25 2023 -0700
Create balancer.go
commit 39941edc0b
Author: chrislu <chris.lu@gmail.com>
Date: Thu Sep 7 23:55:19 2023 -0700
add publisher shutdown
commit 875f562779
Author: chrislu <chris.lu@gmail.com>
Date: Wed Sep 6 23:16:41 2023 -0700
server side send response at least once per second
commit 984b6c54cf
Author: chrislu <chris.lu@gmail.com>
Date: Wed Sep 6 23:15:29 2023 -0700
ack interval 128
commit 2492a45499
Author: chrislu <chris.lu@gmail.com>
Date: Wed Sep 6 22:39:46 2023 -0700
ack interval
commit ba67e6ca29
Author: chrislu <chris.lu@gmail.com>
Date: Mon Sep 4 21:43:50 2023 -0700
api for sub
commit 9e4f985698
Author: chrislu <chris.lu@gmail.com>
Date: Mon Sep 4 21:43:30 2023 -0700
publish, benchmark
commit cb470d44df
Author: chrislu <chris.lu@gmail.com>
Date: Fri Sep 1 00:36:51 2023 -0700
can pub and sub
commit 1eb2da46d5
Author: chrislu <chris.lu@gmail.com>
Date: Mon Aug 28 09:02:12 2023 -0700
connect and publish
commit 504ae8383a
Author: chrislu <chris.lu@gmail.com>
Date: Mon Aug 28 09:01:25 2023 -0700
protoc version
commit dbcba75271
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 27 18:59:04 2023 -0700
rename to lookup
commit c9caf33119
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 27 18:33:46 2023 -0700
move functions
commit 4d6c18d86f
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 27 17:50:59 2023 -0700
pub sub initial tests
commit 4eb8e8624d
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 27 13:14:39 2023 -0700
rename
commit 1990456670
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 27 13:13:14 2023 -0700
sub
commit 905911853d
Author: chrislu <chris.lu@gmail.com>
Date: Sat Aug 26 13:39:21 2023 -0700
adjust proto
1 year ago
chrislu
4827425146
balancer works
1 year ago
Nico D'Cotta
796b7508f3
Implement SRV lookups for filer ( #4767 )
1 year ago
chrislu
31b2751aff
clone volume locations in case they are changed
fix https://github.com/seaweedfs/seaweedfs/issues/4642
1 year ago
chrislu
8ec1bc2c99
remove unused cluster node leader
2 years ago
chrislu
3cc7b90414
print wait in progress
2 years ago
chrislu
5294b6dd4d
remove volume server tcp client
2 years ago
Ryan Russell
150ce9f3f6
docs(wdclient): readability fix ( #3685 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
72d8a9f9a8
refactor(exclusive_locker): `Interval` readability batch of updates ( #3668 )
* refactor(filechunk_manifest): `localProcesed` -> `localProcessed`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `saveChunkedFileIntevalToStorage` -> `saveChunkedFileIntervalToStorage`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `SafeRenewInteval` -> `SafeRenewInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `InitLockInteval` -> `InitLockInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor: `RenewInteval` -> `RenewInterval`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
c9f573eed8
docs: `indicates` readability comment fix ( #3659 )
2 years ago
Konstantin Lebedev
721c6197f9
skip deltaBeat if dn is zero ( #3630 )
* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix
2 years ago
Konstantin Lebedev
01a25755c5
[filer] masterClient updates volume adjust log level ( #3610 )
2 years ago
LHHDZ
bc629665de
fix bug due to data racing on VidMap ( #3606 )
2 years ago
chrislu
de5263364b
master client: use GetMaster() for latest master address
2 years ago
chrislu
e583dbdd2a
more detailed error
2 years ago
chrislu
ae6292f9f0
rename variable
2 years ago
Konstantin Lebedev
e16dda88e4
avoid race conditions access to MasterClient.currentMaster ( #3538 )
https://github.com/seaweedfs/seaweedfs/issues/3510
2 years ago
chrislu
f5156cf3a8
rename varaible
2 years ago
Konstantin Lebedev
e90ab4ac60
avoid race conditions for OnPeerUpdate ( #3525 )
https://github.com/seaweedfs/seaweedfs/issues/3524
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
57e7582c36
refactoring
2 years ago
chrislu
cb476a53ff
remove logs
2 years ago
Konstantin Lebedev
4d4cd0948d
avoid infinite loop WaitUntilConnected() ( #3431 )
https://github.com/seaweedfs/seaweedfs/issues/3421
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
Konstantin Lebedev
22181dd018
refactor FilerRequest metrics ( #3402 )
* refactor FilerRequest metrics
* avoid double count proxy
* defer to
2 years ago
chrislu
be0ec7bc2f
fix test
2 years ago
chrislu
1f161f53dc
add back rack
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
68065128b8
add dc and rack
3 years ago
LHHDZ
994a2dec78
fix `vid_map_test` tests
2 years ago
LHHDZ
58c02d6429
Solve the problem that `LookupFileId` lookup urls is empty due to leader switching
The vidMap structure is modified to a linked list structure (the length is limited to 5). When the vidMap is reset, the current vidMap is added to the new vidMap as a cache node. When the query locations is empty, the cache node is searched to avoid problems when the master switches leaders.
2 years ago
Konstantin Lebedev
01996bccf8
Use fallback if urls are not found
2 years ago
chrislu
9f20d3ebd1
add dc and rack
3 years ago
石昌林
200a862701
fixed `volume xx not found` caused by missing VolumeLocation events
When the requested master node is the leader, `VolumeLocation` or `ClusterNodeUpdate` may be returned here. If it is `VolumeLocation`, the update will be performed while resetting the vidMap, otherwise the event will be lost
3 years ago
Konstantin Lebedev
9bff097b01
currentMaster redirected
3 years ago
Konstantin Lebedev
6c20a3b622
avoid set currentMaster k8s svc.local discoveruy service domains
https://github.com/chrislusf/seaweedfs/issues/2589
3 years ago
chrislu
3ce46c3566
fix entry full url lookup
3 years ago
石昌林
f1ea906c13
Code comment optimization
3 years ago
石昌林
0c8e033e68
When the connection with the leader is disconnected, the vidMap should not be reset immediately, but should be reset after connecting to a new leader
3 years ago
chrislu
9c517d2b35
masterclient: fallback to directly querying master in case of missing volume id location
3 years ago
ningfd
338705f375
fix(wdclient): GetLocations return
3 years ago
chrislu
6adc42147f
fresh filer store bootstrap from the oldest peer
3 years ago
chrislu
94635e9b5c
filer: add filer group
3 years ago
chrislu
bc888226fc
erasure coding: tracking encoded/decoded volumes
If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here.
3 years ago
chrislu
4b5c0e3fa9
check cluster connectivities
3 years ago
chrislu
21e0898631
refactor: change masters from a slice to a map
3 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
3 years ago
Konstantin Lebedev
28efe31524
new master metrics
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago