Tree: 2595f269d1

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/aws/aws-sdk-go-v2/service/s3-1.71.1

dependabot/go_modules/google.golang.org/grpc-1.69.2

dependabot/go_modules/google.golang.org/protobuf-1.36.1

dependabot/go_modules/modernc.org/mathutil-1.7.0

dependabot/go_modules/modernc.org/sqlite-1.34.4

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '2595f269d1'

${ noResults }

Commit Graph

94 Commits (2595f269d16f09682ff6531a0e545283d0964468)

Author	SHA1	Message	Date
Chris Lu	33b3366043	volume: avoid compacting wait group	6 years ago
Chris Lu	a7b1b23c58	fix wrong volume count fix https://github.com/chrislusf/seaweedfs/issues/1013	6 years ago
Chris Lu	115558e5f5	adjust counters	6 years ago
Chris Lu	289fd7eb39	count number of volumes and ec shards	6 years ago
Chris Lu	17ac1290c0	volume: load ec shards during heartbeats to master	6 years ago
Chris Lu	cf58fc0e63	refactor: extract out the write throttler	6 years ago
Chris Lu	b335f81a4f	volume: add option to limit compaction speed	6 years ago
Chris Lu	3b3651dea3	volume: atomic copying file, adds version and stopOffset	6 years ago
Chris Lu	ac2727853f	fix needle map entry size	6 years ago
Chris Lu	e5506152c0	refactoring	6 years ago
Chris Lu	000ee725fc	refactor Offset into a struct of bytes	6 years ago
Chris Lu	df95ce0b6c	weed backup: efficient delta backup fix https://github.com/chrislusf/seaweedfs/issues/399	6 years ago
Chris Lu	70815e9124	WIP	6 years ago
Chris Lu	da871896c3	weed filer: set grpc port to port + 10000	6 years ago
Chris Lu	916b809c08	add error checking	6 years ago
bingoohuang	ab6be025d7	go fmt and fix some typo	6 years ago
bingoohuang	6ddfaf33cb	extract VolumeFileScanner for ScanVolumeFile	6 years ago
Chris Lu	9383c91eb1	wait to read again if the volume is compacting	6 years ago
Chris Lu	1478d7ea21	reduce file seek when writing	6 years ago
Chris Lu	f050b22d6c	close file in ScanVolumeFile() fix https://github.com/chrislusf/seaweedfs/issues/761	6 years ago
Chris Lu	496a7398d1	adjust logging	6 years ago
Chris Lu	333709657c	adjust log level	6 years ago
Chris Lu	a362261972	avoid possible racing issue if leveldb or boltdb is used. remove the to-be-generated files during commit fix https://github.com/chrislusf/seaweedfs/issues/738	6 years ago
Chris Lu	ea8ecf35f4	set needle AppendAtNs value during writes	7 years ago
Chris Lu	4f317c7e3d	working version3	7 years ago
Chris Lu	7e2031b18f	go fmt	7 years ago
Chris Lu	d4d7ced922	refactoring: add type for needle id, offset later the type size can possibly be adjusted	7 years ago
Chris Lu	defcd4edc5	adjust log level	7 years ago
Chris Lu	9bcaa65574	avoid divided by 0 fix https://github.com/chrislusf/seaweedfs/issues/650	7 years ago
Chris Lu	9ba335a7c4	prepare for flexible super block	7 years ago
Chris Lu	7f7e4e9885	fix error for deleted files during compaction deletion during commit may cause trouble when make up the difference during commitCompact()	7 years ago
Chris Lu	58344980e4	preallocate disk space during compaction also, add cleanup for failed compaction	7 years ago
Chris Lu	5047bdb4a2	skip bytes cache	8 years ago
Chris Lu	82c3ccc8dd	add btree for volume index	8 years ago
brstgt	4fb5bb09b6	Remove obsolete property Volume.dataFileSize	8 years ago
Chris Lu	ed44f12f6d	support Fallocate on linux	8 years ago
Chris Lu	13e7069eb9	keep track of total data file size	8 years ago
霍晓栋	ce1f7ab662	makediff func with UT case	8 years ago
霍晓栋	ed848425c7	supplemental data between compacting and commit compacting	8 years ago
Chris Lu	dffad65f2f	fix compilation	8 years ago
Chris Lu	7e29218327	add a template for makeupDiff	8 years ago
Chris Lu	1bc041b46d	add a new way to manually compact corrupted volume fix https://github.com/chrislusf/seaweedfs/issues/371	8 years ago
Chris Lu	5ce6bbf076	directory structure change to work with glide glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.	9 years ago
Chris Lu	766512c475	close current needle map when switching	9 years ago
chrislusf	9b8f8f4bb9	add logging	10 years ago
chrislusf	8f88d382a5	Rename variables	10 years ago
chrislusf	66317b8438	Increase compact revision during each compaction	10 years ago
Stuart P. Bentley	f0c2a2dcb3	Change all chrislusf/weed-fs links to point to chrislu/seaweedfs	10 years ago
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	10 years ago
chrislusf	020ba6c9a8	add leveldb support for needle map This supposedly should reduce memory consumption. However, for tests with millions of, this shows consuming more memories. Need to see whether this will work out. If not, later boltdb will be tested.	10 years ago