Tree: efdebf712e

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'efdebf712e'

${ noResults }

Commit Graph

43 Commits (efdebf712e0d8470d18c34297f1c2651207b1224)

Author	SHA1	Message	Date
Chris Lu	dc784bf217	merge current message queue code changes (#6201) * listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory	2 months ago
chrislu	25b2850e7d	refactor out FilerClientAccessor	7 months ago
chrislu	d1f0c40402	remove per-message debug logs	7 months ago
chrislu	df9d889489	fix size calculation	7 months ago
chrislu	f7b818483a	fix cases when buffer wraps around	7 months ago
chrislu	ad2b878130	fix inflight message tracker	7 months ago
chrislu	f0b9e163a0	avoid nil stopChan	7 months ago
chrislu	a5874954dc	less logs	7 months ago
chrislu	edc87c16f9	balance subscribers need to ensure the offsets are persisted	7 months ago
chrislu	6366898af2	add market	7 months ago
chrislu	96b326a304	use type ConsumerGroupInstanceId	7 months ago
chrislu	37d1ee562d	refactor	7 months ago
chrislu	d40b350f54	coordinator receives unassignment ack	7 months ago
chrislu	554ae09f82	rename	7 months ago
chrislu	6ef2d010aa	rename file	7 months ago
chrislu	67e6051585	rename Coordinator to SubCoordinator	7 months ago
chrislu	d5abffa42c	rename Balancer to PubBalancer	7 months ago
chrislu	2190d59bc3	refactor ToDo 1. handle unassignment on client side 2. get notified of completed unassignment 3. in consumer_group.go, balance and send unassignment	7 months ago
chrislu	3148dec1f6	avoid concurrent processing for the same key	7 months ago
chrislu	3622196881	go fmt	7 months ago
chrislu	d8ab22012a	track offset	7 months ago
chrislu	2b07a40da5	add InflightMessageTracker	7 months ago
chrislu	c6db3f31a1	start consuming ASAP	7 months ago
chrislu	b1871427c3	persist consumer group offset 1. use one follower 2. read write consumer group offset	7 months ago
chrislu	759a8e50cf	remove logs	7 months ago
chrislu	972e9faaa2	move initial assignment to rebalance logic	7 months ago
chrislu	6e5075e14e	move read write topic config into filer client accessor	7 months ago
chrislu	ac63f2b5a1	refactor	7 months ago
chrislu	844a1a0192	rename	7 months ago
chrislu	372bd8d71d	consumer instance passing MaxPartitionCount to coordinator	7 months ago
chrislu	2142842f82	refactor	7 months ago
chrislu	205d2285f3	setup follower by publisher * the subscriber would getOrGen a local partition and wait * the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.	9 months ago
chrislu	1b4484bf0a	go fmt	10 months ago
chrislu	34839237ab	refactor	11 months ago
chrislu	2828ccbb30	refactor	11 months ago
chrislu	f750a5e03b	passing timestamp	12 months ago
chrislu	6a7a679137	passing partition generation timestamp	12 months ago
chrislu	35869b5c80	subscriber can be notified of the assignment change when topic is just configured Next: Subscriber needs to read by the timestamp offset.	12 months ago
chrislu	2845230329	passing broker into the assignments	1 year ago
chrislu	093fdc1621	subscriber can get assignments	1 year ago
chrislu	c950a40aad	subscriber keep connected to the balancer	1 year ago
chrislu	e0727071c8	go fmt	1 year ago
Chris Lu	580940bf82	Merge accumulated changes related to message queue (#5098) * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment	1 year ago