Branch: master

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'master'

${ noResults }

Commit Graph

41 Commits (master)

Author	SHA1	Message	Date
Guo Lei	5b905fb2b7	Lazy loading (#3958) * types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
Guo Lei	f95c25e113	types packages is imported more than onece (#3838)	2 years ago
Guo Lei	84c401e693	Optimiz leveldb metric (#3830) * optimiz updating mapmetric for leveldb * import loading leveldb * add comments	2 years ago
chrislu	0baf3d38c2	adjust logs	2 years ago
Guo Lei	c57c79a0ab	optimiz commitig compact (#3388) * optimiz vacuuming volume * fix bugx * rename parameters * fix conflict * change copyDataBasedOnIndexFile to an instance method * close needlemap * optimiz commiting Vacuum volume for leveldb index * fix bugs * fix leveldb loading bugs * refactor * fix leveldb loading bug * add leveldb recovery * add test case for levelDB * modify test case to cover all the new branches * use one tmpNm instead of two instances * refactor * refactor * move setWatermark to the end * add test for watermark and updating leveldb * fix error logic * refactor, add test * check nil before close needlemapeer add test case fix metric bug * add tests, fix bugs * adjust log level remove wrong test case refactor * avoid duplicate updating metric for leveldb index	2 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2 years ago
guol-fnst	ac694f0c8f	rename parameter and reuse functions rename milestone to watermark	2 years ago
guol-fnst	91285bb51d	remove uncessary code	2 years ago
guol-fnst	b9256e0b34	optimiz	2 years ago
guol-fnst	bec9f79659	use snapshot	2 years ago
Chris Lu	bdfed16d42	avoid nil exception fix https://github.com/chrislusf/seaweedfs/issues/1869	4 years ago
Chris Lu	1ad3200094	skip seek() when index file writes	4 years ago
Chris Lu	f2723c1bc8	do not idx file format revert c9ab8d05fa	4 years ago
Chris Lu	c9ab8d05fa	fixes for reading deleted fid	4 years ago
Chris Lu	fe01191b5b	support read option readDeleted=true	4 years ago
Chris Lu	6ccd7f0a4d	refactoring	4 years ago
Chris Lu	6a92f0bc7a	refactoring to typed Size Go is amazing with refactoring!	4 years ago
Chris Lu	4bed1663e2	adjust log level	5 years ago
Chris Lu	ef2b3a0801	leveldb recover error handling	5 years ago
Chris Lu	e5a0787653	filer: leveldb store add auto recovery, report correct error fix https://github.com/chrislusf/seaweedfs/issues/1326	5 years ago
Chris Lu	3a35632d58	sync before closing file merge changes from 1747fc2d52	5 years ago
j.laycock	6fc6322c90	Change joeslay paths to chrislusf paths	5 years ago
j.laycock	595a1beff0	Swap imports to use joeslay	5 years ago
Chris Lu	644c5c27b4	refactoring	6 years ago
Chris Lu	f88a8bda7b	ec deletion works	6 years ago
Chris Lu	17ac1290c0	volume: load ec shards during heartbeats to master	6 years ago
Chris Lu	46a675ecc2	align memory to avoid nil with atomic operations	6 years ago
Chris Lu	e5506152c0	refactoring	6 years ago
Chris Lu	8a5ce16e96	weed volume: remove boltdb, btree options, add options for leveldb medium, large	6 years ago
Chris Lu	9924fa3b1a	weed volume: disable block cache on leveldb saving 8MB for each volume, but at the cost of slower lookup	6 years ago
Chris Lu	000ee725fc	refactor Offset into a struct of bytes	6 years ago
Chris Lu	1f030af06f	adjusting startup logging	6 years ago
Chris Lu	7e2031b18f	go fmt	7 years ago
Chris Lu	d4d7ced922	refactoring: add type for needle id, offset later the type size can possibly be adjusted	7 years ago
Chris Lu	5bfb72d058	faster loading boltdb or leveldb needle map metrics by bloomfilter avoid btree	7 years ago
Chris Lu	0467195f07	fix file closing on windows	7 years ago
Chris Lu	57c5405657	add todo	7 years ago
Chris Lu	6db1c8bafb	Revert "adjust the needle mapper" This reverts commit e2c7be3a2e.	7 years ago
Chris Lu	e2c7be3a2e	adjust the needle mapper as discussed on https://github.com/chrislusf/seaweedfs/pull/642#issuecomment-387606960	7 years ago
Yang Pengcheng	a2112e1be0	fix ldb dir deleting	7 years ago
Chris Lu	82c3ccc8dd	add btree for volume index	8 years ago
Chris Lu	13e7069eb9	keep track of total data file size	8 years ago
Chris Lu	5ce6bbf076	directory structure change to work with glide glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.	9 years ago
chrislusf	b39c384d6d	Revert "Merge pull request #284 from thinxer/binary" This reverts commit 3523ad5239, reversing changes made to 5d100994b1.	9 years ago
Jianfei Wang	18254d9aae	replace util/bytes.go with binary.BigEndian	9 years ago
chrislusf	5d100994b1	Revert "Merge pull request #281 from thinxer/binary" This reverts commit a87fe8ffce, reversing changes made to 6876bfa685.	9 years ago
Jianfei Wang	7bc10d46e3	replace util/bytes.go with binary.BigEndian	9 years ago
chrislusf	86cd40fba8	Add "weed backup" command. This is a pre-cursor for asynchronous replication.	10 years ago
Stuart P. Bentley	f0c2a2dcb3	Change all chrislusf/weed-fs links to point to chrislu/seaweedfs	10 years ago
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	10 years ago