Tree: 2ff727a32d

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '2ff727a32d'

${ noResults }

Commit Graph

79 Commits (2ff727a32d6d879a49ff5848b592518c96bb6403)

Author	SHA1	Message	Date
Chris Lu	ac2727853f	fix needle map entry size	6 years ago
Chris Lu	e5506152c0	refactoring	6 years ago
Chris Lu	b09e8dbb37	add VolumeStreamFollow, but not used yet	6 years ago
Chris Lu	f567777d64	volume: fix needle checking for deleted needles	6 years ago
Chris Lu	000ee725fc	refactor Offset into a struct of bytes	6 years ago
Chris Lu	df95ce0b6c	weed backup: efficient delta backup fix https://github.com/chrislusf/seaweedfs/issues/399	6 years ago
bingoohuang	6ddfaf33cb	extract VolumeFileScanner for ScanVolumeFile	6 years ago
bingoohuang	27093bc2e5	fix needle Append return offset to avoid uint32 overflow	6 years ago
Chris Lu	badd8fdf8f	shortcut for empty file	6 years ago
Chris Lu	6b5d6bb5a6	adjust error names	6 years ago
Chris Lu	9383c91eb1	wait to read again if the volume is compacting	6 years ago
Chris Lu	1478d7ea21	reduce file seek when writing	6 years ago
Chris Lu	f64dc7465b	remove index file fix https://github.com/chrislusf/seaweedfs/issues/793	6 years ago
Chris Lu	86dd933596	go fmt	6 years ago
Chris Lu	2697d6a4fb	fix deleting bucket	6 years ago
Chris Lu	f9dbaf6292	delete file by name instead of referencing the dataFile pointer	6 years ago
alex8224	8d3f9c0b75	fix invalid point when delete collection	6 years ago
Chris Lu	f050b22d6c	close file in ScanVolumeFile() fix https://github.com/chrislusf/seaweedfs/issues/761	6 years ago
Chris Lu	ac793a3c5a	clean remove all left over files when deleting a collection	6 years ago
Chris Lu	ea8ecf35f4	set needle AppendAtNs value during writes	7 years ago
Chris Lu	4f317c7e3d	working version3	7 years ago
Chris Lu	3edfe1d28f	extend export command to show tombstone + change output format to CSV merging https://github.com/chrislusf/seaweedfs/pull/610 and add "-limit" option	7 years ago
Chris Lu	d4d7ced922	refactoring: add type for needle id, offset later the type size can possibly be adjusted	7 years ago
Chris Lu	9ba335a7c4	prepare for flexible super block	7 years ago
Chris Lu	5047bdb4a2	skip bytes cache	8 years ago
brstgt	4fb5bb09b6	Remove obsolete property Volume.dataFileSize	8 years ago
brstgt	18b3afc97a	Log volumeId if dataFileSize != actual data file size - improve log types	8 years ago
brstgt	0c898df430	Log volumeId if dataFileSize != actual data file size	8 years ago
Chris Lu	13e7069eb9	keep track of total data file size	8 years ago
Chris Lu	d981eb282f	refactor volume_read_write.go out of volume.go	9 years ago
Chris Lu	576573711a	refactoring	9 years ago
Chris Lu	3d8df0f709	refactor volume_loading.go out of volume.go	9 years ago
Chris Lu	582d5d526c	refactoring	9 years ago
Chris Lu	3713119ab9	adjust verification logic. 1. log file name for easier debugging 2. remove unused version in readIndexEntryAtOffset() 3. if indexSize==0, the dataFile usually still has a super block of size 8. So skipping this case.	9 years ago
霍晓栋	16f6984d02	refactor data integrity checking code v2	9 years ago
霍晓栋	dda13def2a	refactor data integrity checking code	9 years ago
霍晓栋	2e74fb60c8	add data integrity checking	9 years ago
Chris Lu	5ce6bbf076	directory structure change to work with glide glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.	9 years ago
Chris Lu	f8b03c45ef	properly release memory fix https://github.com/chrislusf/seaweedfs/issues/301	9 years ago
chrislusf	0649d778a7	pooling []byte reduce the number of requests to make([]byte)	9 years ago
chrislusf	320e946d50	fix ttl change detection https://github.com/chrislusf/seaweedfs/issues/166	10 years ago
chrislusf	430f371a97	fix wrong logic	10 years ago
chrislusf	2c595d2d16	skip isFileUnchanged checking since ttl always change skip checking since ttl always change. Fixing https://github.com/chrislusf/seaweedfs/issues/166	10 years ago
chrislusf	86cd40fba8	Add "weed backup" command. This is a pre-cursor for asynchronous replication.	10 years ago
chrislusf	8f88d382a5	Rename variables	10 years ago
chrislusf	b8314fb054	Textual changes.	10 years ago
Stuart P. Bentley	f0c2a2dcb3	Change all chrislusf/weed-fs links to point to chrislu/seaweedfs	10 years ago
chrislusf	49d639ecab	Add error checking for file reads.	10 years ago
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	10 years ago
chrislusf	020ba6c9a8	add leveldb support for needle map This supposedly should reduce memory consumption. However, for tests with millions of, this shows consuming more memories. Need to see whether this will work out. If not, later boltdb will be tested.	10 years ago