chrislu
c030cb3ce9
bootstrap filer from one peer
10 months ago
Konstantin Lebedev
7988ee0805
[fs.verify] skip failed files if entry not found on filerStore ( #5693 )
10 months ago
chrislu
464611f614
optionally skip deleting file chunks
11 months ago
chrislu
7a9b115cc2
rename
1 year ago
chrislu
f2f4630029
rename field types
1 year ago
chrislu
111a4e1126
add field index
1 year ago
chrislu
cc1ce3de87
all record fields are optional by default
1 year ago
chrislu
0847a17484
convert to parquet schema and value
1 year ago
chrislu
04fb4c34e3
add proto for value
1 year ago
chrislu
48fe50df81
minor
1 year ago
chrislu
0cbf364a3d
all fields are optional
1 year ago
chrislu
d45a372615
add schema.proto
1 year ago
chrislu
66a878af39
add control message to data message
1 year ago
chrislu
546ae87c39
send is_close message to broker
1 year ago
chrislu
c9df613b6b
add publisher name for debugging
1 year ago
chrislu
ab9fc0ad70
simplify
1 year ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
1 year ago
chrislu
7003ce7425
publisher is able to fully send data and receive acks
still needs to close the pipes cleanly
1 year ago
chrislu
516cba7053
remove FollowInMemoryMessages
1 year ago
chrislu
6f75a0af55
ask follower to follow
1 year ago
chrislu
28f8f33d6a
include key in LogEntry
1 year ago
chrislu
7e443ef0a1
latest protoc-gen-go
1 year ago
chrislu
ead27a4f59
publish init add followers
1 year ago
chrislu
1b4484bf0a
go fmt
1 year ago
Chris Lu
e27deed4bc
upgrade protoc
1 year ago
chrislu
d41792461c
lock returns host and owner
1 year ago
chrislu
34a78ffad0
remove isForPublish from LookupTopicBrokers
also adds a return parameter: whether the topic exists or not
1 year ago
chrislu
49428a303b
add batch index for each memory buffer
1 year ago
chrislu
e8611ed85d
subscribe with partition offset
1 year ago
chrislu
ee41dbb7fc
rename functions
1 year ago
chrislu
1fed37bed0
add offset
1 year ago
chrislu
093fdc1621
subscriber can get assignments
1 year ago
chrislu
c950a40aad
subscriber keep connected to the balancer
1 year ago
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
1 year ago
chrislu
deb86ff4a6
upgrading grpc
2 years ago
chrislu
de0b969b36
Revert "rename"
This reverts commit 35b5264ab7
.
2 years ago
Konstantin Lebedev
1cac5d983d
fix: disallow file name too long when writing a file ( #4881 )
* fix: disallow file name too long when writing a file
* bool LongerName to MaxFilenameLength
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
chrislu
35b5264ab7
rename
2 years ago
Konstantin Lebedev
2b3e39397e
fix: skipping checking active volumes with the same number of files at the moment ( #4893 )
* fix: skipping checking active volumes with the same number of files at the moment
https://github.com/seaweedfs/seaweedfs/issues/4140
* refactor with comments
https://github.com/seaweedfs/seaweedfs/issues/4140
* add TestShouldSkipVolume
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
chrislu
b02fdeabff
RetryForever => RetryUntil
2 years ago
chrislu
ebd6f96d35
adjust mq.proto
2 years ago
chrislu
358cba43ef
update proto generated files
2 years ago
chrislu
d7c211fe8c
adjust mq proto
2 years ago
chrislu
9d589b48e6
rename function
2 years ago
Konstantin Lebedev
f8b94cac0e
[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )
* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
chrislu
3cf9b8d621
create topic and report topic
2 years ago
chrislu
b3f94feede
do create topic
2 years ago
chrislu
0361c321b4
add CreateTopic API
2 years ago
chrislu
6c6655de9d
wip
2 years ago
chrislu
340aea9b34
add broker leader
2 years ago