Konstantin Lebedev
7988ee0805
[fs.verify] skip failed files if entry not found on filerStore ( #5693 )
6 months ago
chrislu
464611f614
optionally skip deleting file chunks
6 months ago
chrislu
7a9b115cc2
rename
8 months ago
chrislu
f2f4630029
rename field types
8 months ago
chrislu
111a4e1126
add field index
8 months ago
chrislu
cc1ce3de87
all record fields are optional by default
8 months ago
chrislu
0847a17484
convert to parquet schema and value
8 months ago
chrislu
04fb4c34e3
add proto for value
8 months ago
chrislu
48fe50df81
minor
8 months ago
chrislu
0cbf364a3d
all fields are optional
8 months ago
chrislu
d45a372615
add schema.proto
9 months ago
chrislu
66a878af39
add control message to data message
9 months ago
chrislu
546ae87c39
send is_close message to broker
9 months ago
chrislu
c9df613b6b
add publisher name for debugging
9 months ago
chrislu
ab9fc0ad70
simplify
9 months ago
chrislu
205d2285f3
setup follower by publisher
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
9 months ago
chrislu
7003ce7425
publisher is able to fully send data and receive acks
still needs to close the pipes cleanly
9 months ago
chrislu
516cba7053
remove FollowInMemoryMessages
9 months ago
chrislu
6f75a0af55
ask follower to follow
10 months ago
chrislu
28f8f33d6a
include key in LogEntry
10 months ago
chrislu
7e443ef0a1
latest protoc-gen-go
10 months ago
chrislu
ead27a4f59
publish init add followers
10 months ago
chrislu
1b4484bf0a
go fmt
10 months ago
Chris Lu
e27deed4bc
upgrade protoc
11 months ago
chrislu
d41792461c
lock returns host and owner
11 months ago
chrislu
34a78ffad0
remove isForPublish from LookupTopicBrokers
also adds a return parameter: whether the topic exists or not
11 months ago
chrislu
49428a303b
add batch index for each memory buffer
12 months ago
chrislu
e8611ed85d
subscribe with partition offset
12 months ago
chrislu
ee41dbb7fc
rename functions
12 months ago
chrislu
1fed37bed0
add offset
12 months ago
chrislu
093fdc1621
subscriber can get assignments
1 year ago
chrislu
c950a40aad
subscriber keep connected to the balancer
1 year ago
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
1 year ago
chrislu
deb86ff4a6
upgrading grpc
1 year ago
chrislu
de0b969b36
Revert "rename"
This reverts commit 35b5264ab7
.
1 year ago
Konstantin Lebedev
1cac5d983d
fix: disallow file name too long when writing a file ( #4881 )
* fix: disallow file name too long when writing a file
* bool LongerName to MaxFilenameLength
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
1 year ago
chrislu
35b5264ab7
rename
1 year ago
Konstantin Lebedev
2b3e39397e
fix: skipping checking active volumes with the same number of files at the moment ( #4893 )
* fix: skipping checking active volumes with the same number of files at the moment
https://github.com/seaweedfs/seaweedfs/issues/4140
* refactor with comments
https://github.com/seaweedfs/seaweedfs/issues/4140
* add TestShouldSkipVolume
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
1 year ago
chrislu
b02fdeabff
RetryForever => RetryUntil
1 year ago
chrislu
ebd6f96d35
adjust mq.proto
1 year ago
chrislu
358cba43ef
update proto generated files
1 year ago
chrislu
d7c211fe8c
adjust mq proto
1 year ago
chrislu
9d589b48e6
rename function
1 year ago
Konstantin Lebedev
f8b94cac0e
[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )
* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
chrislu
3cf9b8d621
create topic and report topic
1 year ago
chrislu
b3f94feede
do create topic
1 year ago
chrislu
0361c321b4
add CreateTopic API
1 year ago
chrislu
6c6655de9d
wip
1 year ago
chrislu
340aea9b34
add broker leader
1 year ago
chrislu
a65088d739
broker report stats to balancer
1 year ago