Tree: 98aa9cc068

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '98aa9cc068'

${ noResults }

Commit Graph

45 Commits (98aa9cc068cdfedc199a0a5c8a22ecd9813d47e3)

Author	SHA1	Message	Date
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	10 years ago
chrislusf	020ba6c9a8	add leveldb support for needle map This supposedly should reduce memory consumption. However, for tests with millions of, this shows consuming more memories. Need to see whether this will work out. If not, later boltdb will be tested.	10 years ago
chrislusf	78bc7b393f	tweaking ui	10 years ago
chrislusf	b07d81fb08	follow golint suggestions	10 years ago
chrislusf	f511b507a5	Add read only public port on volume server Add read only public port on volume server	10 years ago
Chris Lu	f7998f8652	merge conflicts	10 years ago
Chris Lu	7b4a53b2c1	Add optional admin port to volume server, to seperate admin operations from normal file operations.	10 years ago
Lei Xue	029e3a3822	fix some typos	10 years ago
yanyiwu	5b7628cf08	use github.com/golang/protobuf/proto instead of code.google.com/p/goprotobuf/proto	10 years ago
yanyiwu	5a40f539f2	fix bug: upload a file which already existed return a wrong file size.	10 years ago
Brian McQueen	d56c748fa8	switch it back to chris's repo	10 years ago
Brian McQueen	c0dfdf4392	switch to my forked repo	10 years ago
Chris Lu	179d36ba0e	formatting code by: goimports -w=true .	10 years ago
wyy	4126280d55	use github.com/chrislusf instead of github.com/aszxqw	11 years ago
wyy	1cd19447e3	use github.com/aszxqw instead of code.google.com/p	11 years ago
Chris Lu	b9aee2defb	add TTL support The volume TTL and file TTL are not necessarily the same. as long as file TTL is smaller than volume TTL, it'll be fine. volume TTL is used when assigning file id, e.g. http://.../dir/assign?ttl=3h file TTL is used when uploading	11 years ago
Chris Lu	e8e8d11bd3	Refactor out weedfs vacuum.	11 years ago
Chris Lu	8c04c5ed5f	remove the println	11 years ago
Chris Lu	1818a2a2da	Change to protocol buffer for volume-join-masster message Reduced size to about 1/5 of the previous json format message	11 years ago
Chris Lu	637469e656	log the volume server connected to which master server	11 years ago
Chris Lu	3b5035c468	1. v0.54 2. go vet found many printing format errors	11 years ago
Chris Lu	51939efeac	1. volume server now sends master server its max file key, so that master server does not need to store the sequence on disk any more 2. fix raft server's failure to init cluster during bootstrapping	11 years ago
Chris Lu	9653a54766	added typed join result	11 years ago
Chris Lu	56a3d30e75	batch delete on volume servers	11 years ago
Chris Lu	59f6a13609	adding lots of different stats	11 years ago
Chris Lu	37dd41ab91	print out log message	11 years ago
Chris Lu	3fec41b911	remove unnecessary code	11 years ago
Chris Lu	cd10c277b2	can now delete a collection! Is this a dangerous feature? Only enabling deleting "benchmark" collections for now.	11 years ago
Chris Lu	27c74a7e66	Major: change replication_type to ReplicaPlacement, hopefully cleaner code works for 9 possible ReplicaPlacement xyz x : number of copies on other data centers y : number of copies on other racks z : number of copies on current rack x y z each can be 0,1,2 Minor: weed server "-mdir" default to "-dir" if empty	11 years ago
Chris Lu	edae676913	1. volume server auto detect clustered master nodes 2. remove operation package dependency on storage	11 years ago
Chris Lu	0e5c4e432d	report when size is closing to the volume limit fix error	11 years ago
Chris Lu	2a8c60f71b	be lenient when writing, but report right away when volume size limit is exceeded	11 years ago
Chris Lu	3b68711139	support for collections!	11 years ago
Chris Lu	3f5f8657d2	add a command to force compaction of a volume, removing deleted files	12 years ago
Chris Lu	82b74c7940	issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com> some basic changes to parse upload url	12 years ago
Chris Lu	ed154053c8	switching to temporarily use glog library	12 years ago
Chris Lu	123b0cc2df	fix for issue #35	12 years ago
Chris Lu	ff1c04c486	fix issue 34	12 years ago
Chris Lu	d4105f9b46	add support for multiple folders and multiple max limit: eg -dir=folder1,folder2,folder3 -max=7,8,9	12 years ago
Chris Lu	d1fcf1fd67	add error when size limit is reached	12 years ago
Chris Lu	50269b74ce	add dataCenter option when assign file keys add dataCenter option when starting volume servers some work related to freeze a volume. Not tested yet.	12 years ago
Chris Lu	fb635146a1	refactoring needle mapper interface to separate index file storage logic out	12 years ago
Chris Lu	3222d40871	fix compilation error	12 years ago
Chris Lu	95dc977608	accurate error messages during writing	12 years ago
Chris Lu	a4369b35a7	merge changes from about dealing with read only volumes. 97482255d5.diff	12 years ago
Chris Lu	db8e27be6e	add lots of error checking by GThomas	12 years ago
Chris Lu	5071f528f6	testing compilation with remove package	12 years ago
Chris Lu	55f2627fcf	testing new directory structure	12 years ago
Chris Lu	ab6fb13ad7	avoid the "src" folder	12 years ago
Chris Lu	cb4e8ec16b	re-organize code directory structure	12 years ago