Tree: f2db746690

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'f2db746690'

${ noResults }

Commit Graph

59 Commits (f2db746690b903c50d512db568d739a91a00179e)

Author	SHA1	Message	Date
Chris Lu	dc784bf217	merge current message queue code changes (#6201) * listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory	2 months ago
chrislu	ff47956530	add helper functions	3 months ago
chrislu	270e91b0be	adds locking	4 months ago
chrislu	b6fd1ff4ce	refactor	4 months ago
chrislu	d218fe54fa	go fmt	7 months ago
chrislu	b1871427c3	persist consumer group offset 1. use one follower 2. read write consumer group offset	7 months ago
chrislu	8d5bb7420d	rename	7 months ago
chrislu	1f20178ded	subscriber receives partitions and dispatch to processors	7 months ago
chrislu	ccdd9cd8de	refactor	9 months ago
chrislu	f37c0d0d7a	comment out println	9 months ago
chrislu	f07875e8e1	send flush message to follower before shutting down logBuffer	9 months ago
chrislu	e568e742c9	renaming	9 months ago
chrislu	47975e75bf	purge old code	9 months ago
chrislu	237e68059d	shutdown follower if no clients, not only publishers to avoid overhead when a publisher repeatedly send one message and close	9 months ago
chrislu	c9df613b6b	add publisher name for debugging	9 months ago
chrislu	ca4f89a6f6	simplify	9 months ago
chrislu	0d55bddc75	logs	9 months ago
chrislu	e3c8be7f89	LocalPartition shutdown	9 months ago
chrislu	ab9fc0ad70	simplify	9 months ago
chrislu	7463058299	change visibility	9 months ago
chrislu	dab5454332	publish and send to follower	9 months ago
chrislu	f249f831b1	MaybeShutdownLocalPartition refactor	9 months ago
chrislu	2a0ab7e90d	fix	9 months ago
chrislu	059a120708	refactor	9 months ago
chrislu	7d87c1d2bb	refactor	9 months ago
chrislu	5cc94a05b9	separate goroutine to send ack to publisher	9 months ago
chrislu	f67c8309d8	rename	9 months ago
chrislu	205d2285f3	setup follower by publisher * the subscriber would getOrGen a local partition and wait * the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.	9 months ago
chrislu	6ef3e6bcad	logging	9 months ago
chrislu	8e5068fd2f	notify	9 months ago
chrislu	529fa8c4c8	go fmt	9 months ago
chrislu	64a32730a2	add size()	9 months ago
chrislu	6f75a0af55	ask follower to follow	10 months ago
chrislu	3b28433cb1	change LogBuffer visibility in LocalPartition	10 months ago
chrislu	1b4484bf0a	go fmt	10 months ago
chrislu	fdf0ea8e11	passing partition info	11 months ago
chrislu	3795d8dca8	release local topic partition if no publisher and subscribers	11 months ago
chrislu	ba73199174	reuse local partition	11 months ago
chrislu	fa59a5d67e	read from disk if not in memory	11 months ago
chrislu	45994641e9	lint	12 months ago
chrislu	6a7a679137	passing partition generation timestamp	12 months ago
chrislu	d51efddf5c	flush to disk Need to do: read from disk	12 months ago
chrislu	49428a303b	add batch index for each memory buffer	12 months ago
chrislu	093fdc1621	subscriber can get assignments	1 year ago
Chris Lu	580940bf82	Merge accumulated changes related to message queue (#5098) * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment	1 year ago
chrislu	bf13f3ced7	add subscriber coordinator	1 year ago
chrislu	734178093e	refactor TopicPartition struct	1 year ago
chrislu	23f334dd13	comment	1 year ago
chrislu	c7e05e4e71	ensure latest stats are reported	1 year ago
chrislu	1492bf7552	fix listing topics	1 year ago