chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
chrislu
b70cb3e0b2
upgrade protoc to 3.17.3
$brew install protobuf
$ protoc --version
libprotoc 3.17.3
$ go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.26
$ go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@v1.1
3 years ago
Chris Lu
4729a57cc0
use constants
3 years ago
Chris Lu
5ea86ef1da
Revert "master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()"
This reverts commit af71ae11aa
.
3 years ago
Chris Lu
af71ae11aa
master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()
3 years ago
Chris Lu
5160eb08f7
shell: optionally read filer address from master
3 years ago
Chris Lu
2baed2e1e9
avoid possible metadata subscription data loss
Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
cc7714fdbe
logging changes to debug
4 years ago
Chris Lu
8f8738867f
add retry to assign volume
fix https://github.com/chrislusf/seaweedfs/issues/2056
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
394513f598
filer: ensure seamless meta data updates
4 years ago
Chris Lu
723ae11db4
refactoring in order to adjust volume server url later
4 years ago
Chris Lu
daf0a449f7
properly cancel context for streaming grpc
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
eb7929a971
rename filer2 to filer
4 years ago
Chris Lu
ef75ce8a34
use UTC for all time related folders
4 years ago
Chris Lu
b69cb74c03
read meta logs by timestamp
pass in event ts when moving logs
meta aggregator reads in memory logs only
4 years ago
Chris Lu
ca658a97c5
add signatures to messages to avoid double processing
4 years ago
Chris Lu
55e40b08fc
refactoring
5 years ago
Chris Lu
31e23e9783
filer: support active<=>active filer replication
5 years ago
Chris Lu
45a9d852d3
go fmt
5 years ago
Chris Lu
d3925d086c
add delete channel
5 years ago
Chris Lu
081ee6fe34
reduc logs
5 years ago
Chris Lu
bff09fb74f
fix looping
5 years ago
Chris Lu
f5684839a2
add DeleteTopic
5 years ago
Chris Lu
3a57aef7a9
sync subscribe()
5 years ago
Chris Lu
95ca9dd8a2
subscribe support cancel
5 years ago
Chris Lu
f11233cd49
simplify disconnected stream detection
5 years ago
Chris Lu
85b53ac510
detect disconnected subscribers
5 years ago
Chris Lu
b0de01ff3b
able to detect disconnected subscribers
5 years ago
Chris Lu
e02a8c67da
revert to one subscriber one thread
5 years ago
Chris Lu
ca4017dd87
rename
5 years ago
Chris Lu
25257acd51
rename
5 years ago
Chris Lu
a7959c1c48
multiple subscriber with same subscriberId shares the topic manager
rename topicControl to topicCursor
5 years ago
Chris Lu
2f243f5b0b
refactor
5 years ago
Chris Lu
d5a8297a1c
able to connect publisher
5 years ago
Chris Lu
39e72fb23c
go fmt
5 years ago
Chris Lu
6bf3eb69cb
async chan write read, no write for closed chan
5 years ago
Chris Lu
d693e77418
add pub sub md5
5 years ago
Chris Lu
07d7abe428
add deleteTopic, refactoring
5 years ago
Chris Lu
dfccc3c263
able to read chan and write chan
5 years ago
Chris Lu
1e3e4b3072
add broker connects to filer
5 years ago
Chris Lu
871efa4fc1
refactoring
some previous chunk etag was using md5, which should be wrong.
5 years ago
Chris Lu
ea809a45ab
add cipher key
5 years ago
Chris Lu
f9b6178b8f
log messages
5 years ago