Tree: 3148dec1f6

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/aws/aws-sdk-go-v2/service/s3-1.71.1

dependabot/go_modules/google.golang.org/grpc-1.69.2

dependabot/go_modules/google.golang.org/protobuf-1.36.1

dependabot/go_modules/modernc.org/mathutil-1.7.0

dependabot/go_modules/modernc.org/sqlite-1.34.4

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '3148dec1f6'

${ noResults }

Commit Graph

31 Commits (3148dec1f6314123d63f0b8e8060e13070ae9556)

Author	SHA1	Message	Date
Guo Lei	5b905fb2b7	Lazy loading (#3958) * types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
Guo Lei	84c401e693	Optimiz leveldb metric (#3830) * optimiz updating mapmetric for leveldb * import loading leveldb * add comments	2 years ago
Guo Lei	c57c79a0ab	optimiz commitig compact (#3388) * optimiz vacuuming volume * fix bugx * rename parameters * fix conflict * change copyDataBasedOnIndexFile to an instance method * close needlemap * optimiz commiting Vacuum volume for leveldb index * fix bugs * fix leveldb loading bugs * refactor * fix leveldb loading bug * add leveldb recovery * add test case for levelDB * modify test case to cover all the new branches * use one tmpNm instead of two instances * refactor * refactor * move setWatermark to the end * add test for watermark and updating leveldb * fix error logic * refactor, add test * check nil before close needlemapeer add test case fix metric bug * add tests, fix bugs * adjust log level remove wrong test case refactor * avoid duplicate updating metric for leveldb index	2 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2 years ago
Chris Lu	1ad3200094	skip seek() when index file writes	4 years ago
Chris Lu	a1210d1e8d	Revert "volume: avoid file.stat(), file.seek() if possible during writes" This reverts commit c78409a598.	4 years ago
Chris Lu	c78409a598	volume: avoid file.stat(), file.seek() if possible during writes	4 years ago
bingoohuang	94ea3bd3a5	renaming NeedleMapType to NeedleMapKind	4 years ago
Chris Lu	9ac4935f22	read from volume index file directly instead of open a separate file fix https://github.com/chrislusf/seaweedfs/issues/1640 read from volume index file directly instead of open a separate file, to ensure reading latest index entries.	4 years ago
Chris Lu	f2723c1bc8	do not idx file format revert c9ab8d05fa	4 years ago
Chris Lu	c9ab8d05fa	fixes for reading deleted fid	4 years ago
Chris Lu	6a92f0bc7a	refactoring to typed Size Go is amazing with refactoring!	4 years ago
Chris Lu	cbfe31a9a8	idx file sync before compaction	5 years ago
j.laycock	6fc6322c90	Change joeslay paths to chrislusf paths	5 years ago
Chris Lu	02710f9624	refactoring: remove unused functions	5 years ago
j.laycock	595a1beff0	Swap imports to use joeslay	5 years ago
Chris Lu	17ac1290c0	volume: load ec shards during heartbeats to master	6 years ago
Chris Lu	87f63b9c08	generate ec01~ec14, generate ecx file with sorted needle values	6 years ago
Chris Lu	177f3add81	adjust memory layout to avoid possible nil pointer	6 years ago
Chris Lu	e5506152c0	refactoring	6 years ago
Chris Lu	b142f9f1d5	go fmt	6 years ago
Chris Lu	3555628ad5	weed volume: fix bug, remove boltdb, btree	6 years ago
Chris Lu	8a5ce16e96	weed volume: remove boltdb, btree options, add options for leveldb medium, large	6 years ago
Chris Lu	7e2031b18f	go fmt	7 years ago
Chris Lu	d4d7ced922	refactoring: add type for needle id, offset later the type size can possibly be adjusted	7 years ago
Chris Lu	5bfb72d058	faster loading boltdb or leveldb needle map metrics by bloomfilter avoid btree	7 years ago
Chris Lu	82c3ccc8dd	add btree for volume index	8 years ago
Chris Lu	13e7069eb9	keep track of total data file size	8 years ago
霍晓栋	dda13def2a	refactor data integrity checking code	9 years ago
Chris Lu	5ce6bbf076	directory structure change to work with glide glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.	9 years ago
chrislusf	b39c384d6d	Revert "Merge pull request #284 from thinxer/binary" This reverts commit 3523ad5239, reversing changes made to 5d100994b1.	9 years ago
Jianfei Wang	a192373c25	storage: do not copy sync.Mutex by value	9 years ago
Jianfei Wang	18254d9aae	replace util/bytes.go with binary.BigEndian	9 years ago
chrislusf	5d100994b1	Revert "Merge pull request #281 from thinxer/binary" This reverts commit a87fe8ffce, reversing changes made to 6876bfa685.	9 years ago
Jianfei Wang	7bc10d46e3	replace util/bytes.go with binary.BigEndian	9 years ago
chrislusf	86cd40fba8	Add "weed backup" command. This is a pre-cursor for asynchronous replication.	10 years ago
Stuart P. Bentley	f0c2a2dcb3	Change all chrislusf/weed-fs links to point to chrislu/seaweedfs	10 years ago
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	10 years ago
chrislusf	020ba6c9a8	add leveldb support for needle map This supposedly should reduce memory consumption. However, for tests with millions of, this shows consuming more memories. Need to see whether this will work out. If not, later boltdb will be tested.	10 years ago
chrislusf	9d8a6d2562	adjust log printing	10 years ago
Chris Lu	af416189f1	Cleanup error printing.	10 years ago
Brian McQueen	d56c748fa8	switch it back to chris's repo	10 years ago
Brian McQueen	c0dfdf4392	switch to my forked repo	10 years ago
Chris Lu	179d36ba0e	formatting code by: goimports -w=true .	10 years ago
wyy	4126280d55	use github.com/chrislusf instead of github.com/aszxqw	10 years ago
wyy	1cd19447e3	use github.com/aszxqw instead of code.google.com/p	10 years ago
Chris Lu	faf497feb8	Important Fix: Avoid overwriting the index file!!!	11 years ago
Chris Lu	3b5035c468	1. v0.54 2. go vet found many printing format errors	11 years ago
Chris Lu	51939efeac	1. volume server now sends master server its max file key, so that master server does not need to store the sequence on disk any more 2. fix raft server's failure to init cluster during bootstrapping	11 years ago
Chris Lu	3dbebfd1e1	Thread-safe fixes: 1. avoid sharing []byte 2. switch to use ReadAt()	11 years ago