Tree: fb41d03a11

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

collect-public-metrics

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/parquet-go/parquet-go-0.25.0

dependabot/go_modules/go.etcd.io/etcd/client/v3-3.5.21

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

more-efficient-copy-object

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

3.85

3.86

3.87

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'fb41d03a11'

${ noResults }

Commit Graph

61 Commits (fb41d03a11f3673b15bb91088070eb4f47bfaf96)

Author	SHA1	Message	Date
Chris Lu	cc05874d06	Add message queue agent (#6463) * scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent	4 months ago
chrislu	ec155022e7	"golang.org/x/exp/slices" => "slices" and go fmt	5 months ago
Chris Lu	dc784bf217	merge current message queue code changes (#6201) * listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory	6 months ago
chrislu	ff47956530	add helper functions	7 months ago
chrislu	270e91b0be	adds locking	9 months ago
chrislu	b6fd1ff4ce	refactor	9 months ago
chrislu	d218fe54fa	go fmt	12 months ago
chrislu	b1871427c3	persist consumer group offset 1. use one follower 2. read write consumer group offset	1 year ago
chrislu	8d5bb7420d	rename	1 year ago
chrislu	1f20178ded	subscriber receives partitions and dispatch to processors	1 year ago
chrislu	ccdd9cd8de	refactor	1 year ago
chrislu	f37c0d0d7a	comment out println	1 year ago
chrislu	f07875e8e1	send flush message to follower before shutting down logBuffer	1 year ago
chrislu	e568e742c9	renaming	1 year ago
chrislu	47975e75bf	purge old code	1 year ago
chrislu	237e68059d	shutdown follower if no clients, not only publishers to avoid overhead when a publisher repeatedly send one message and close	1 year ago
chrislu	c9df613b6b	add publisher name for debugging	1 year ago
chrislu	ca4f89a6f6	simplify	1 year ago
chrislu	0d55bddc75	logs	1 year ago
chrislu	e3c8be7f89	LocalPartition shutdown	1 year ago
chrislu	ab9fc0ad70	simplify	1 year ago
chrislu	7463058299	change visibility	1 year ago
chrislu	dab5454332	publish and send to follower	1 year ago
chrislu	f249f831b1	MaybeShutdownLocalPartition refactor	1 year ago
chrislu	2a0ab7e90d	fix	1 year ago
chrislu	059a120708	refactor	1 year ago
chrislu	7d87c1d2bb	refactor	1 year ago
chrislu	5cc94a05b9	separate goroutine to send ack to publisher	1 year ago
chrislu	f67c8309d8	rename	1 year ago
chrislu	205d2285f3	setup follower by publisher * the subscriber would getOrGen a local partition and wait * the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.	1 year ago
chrislu	6ef3e6bcad	logging	1 year ago
chrislu	8e5068fd2f	notify	1 year ago
chrislu	529fa8c4c8	go fmt	1 year ago
chrislu	64a32730a2	add size()	1 year ago
chrislu	6f75a0af55	ask follower to follow	1 year ago
chrislu	3b28433cb1	change LogBuffer visibility in LocalPartition	1 year ago
chrislu	1b4484bf0a	go fmt	1 year ago
chrislu	fdf0ea8e11	passing partition info	1 year ago
chrislu	3795d8dca8	release local topic partition if no publisher and subscribers	1 year ago
chrislu	ba73199174	reuse local partition	1 year ago
chrislu	fa59a5d67e	read from disk if not in memory	1 year ago
chrislu	45994641e9	lint	1 year ago
chrislu	6a7a679137	passing partition generation timestamp	1 year ago
chrislu	d51efddf5c	flush to disk Need to do: read from disk	1 year ago
chrislu	49428a303b	add batch index for each memory buffer	1 year ago
chrislu	093fdc1621	subscriber can get assignments	1 year ago
Chris Lu	580940bf82	Merge accumulated changes related to message queue (#5098) * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment	1 year ago
chrislu	bf13f3ced7	add subscriber coordinator	2 years ago
chrislu	734178093e	refactor TopicPartition struct	2 years ago
chrislu	23f334dd13	comment	2 years ago