Tree: ac83adc6ce

add-admin-and-worker-to-helm-charts

add-ec-vacuum

add-foundation-db

add_fasthttp_client

add_remote_storage

adding-message-queue-integration-tests

avoid_releasing_temp_file_on_write

changing-to-zap

collect-public-metrics

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

detect-and-plan-ec-tasks

do-not-retry-if-error-is-NotFound

enhance-erasure-coding

fasthttp

filer1_maintenance_branch

fix-GetObjectLockConfigurationHandler

fix-versioning-listing-only

ftp

gh-pages

improve-fuse-mount

improve-fuse-mount2

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

pr-7412

random_access_file

refactor-needle-read-operations

refactor-volume-write

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

testing-sdx-generation

tikv

track-mount-e2e

volume_buffered_writes

worker-execute-ec-tasks

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

3.85

3.86

3.87

3.88

3.89

3.90

3.91

3.92

3.93

3.94

3.95

3.96

3.97

3.98

3.99

4.00

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'ac83adc6ce'

${ noResults }

Commit Graph

113 Commits (ac83adc6ce5e37f50c1abf024e538954446c514d)

Author	SHA1	Message	Date
Chris Lu	d981eb282f	refactor volume_read_write.go out of volume.go	9 years ago
Chris Lu	576573711a	refactoring	9 years ago
Chris Lu	3d8df0f709	refactor volume_loading.go out of volume.go	9 years ago
Chris Lu	582d5d526c	refactoring	9 years ago
Chris Lu	3713119ab9	adjust verification logic. 1. log file name for easier debugging 2. remove unused version in readIndexEntryAtOffset() 3. if indexSize==0, the dataFile usually still has a super block of size 8. So skipping this case.	9 years ago
霍晓栋	16f6984d02	refactor data integrity checking code v2	9 years ago
霍晓栋	dda13def2a	refactor data integrity checking code	9 years ago
霍晓栋	2e74fb60c8	add data integrity checking	9 years ago
Chris Lu	5ce6bbf076	directory structure change to work with glide glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.	10 years ago
Chris Lu	f8b03c45ef	properly release memory fix https://github.com/chrislusf/seaweedfs/issues/301	10 years ago
chrislusf	0649d778a7	pooling []byte reduce the number of requests to make([]byte)	10 years ago
chrislusf	320e946d50	fix ttl change detection https://github.com/chrislusf/seaweedfs/issues/166	10 years ago
chrislusf	430f371a97	fix wrong logic	10 years ago
chrislusf	2c595d2d16	skip isFileUnchanged checking since ttl always change skip checking since ttl always change. Fixing https://github.com/chrislusf/seaweedfs/issues/166	10 years ago
chrislusf	86cd40fba8	Add "weed backup" command. This is a pre-cursor for asynchronous replication.	11 years ago
chrislusf	8f88d382a5	Rename variables	11 years ago
chrislusf	b8314fb054	Textual changes.	11 years ago
Stuart P. Bentley	f0c2a2dcb3	Change all chrislusf/weed-fs links to point to chrislu/seaweedfs	11 years ago
chrislusf	49d639ecab	Add error checking for file reads.	11 years ago
chrislusf	1b6ab2f6af	Add boltdb for volume needle map boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.	11 years ago
chrislusf	020ba6c9a8	add leveldb support for needle map This supposedly should reduce memory consumption. However, for tests with millions of, this shows consuming more memories. Need to see whether this will work out. If not, later boltdb will be tested.	11 years ago
chrislusf	d48d76cb4f	adding special handling to recover data if possible For bug #87 and #93, add special handling to recover data if possible.	11 years ago
Chris Lu	af416189f1	Cleanup error printing.	11 years ago
Lei Xue	029e3a3822	fix some typos	11 years ago
yanyiwu	5a40f539f2	fix bug: upload a file which already existed return a wrong file size.	11 years ago
Brian McQueen	d56c748fa8	switch it back to chris's repo	11 years ago
Brian McQueen	c0dfdf4392	switch to my forked repo	11 years ago
Chris Lu	179d36ba0e	formatting code by: goimports -w=true .	11 years ago
Chris Lu	e9a8999f63	print error the correct way.	11 years ago
wyy	4126280d55	use github.com/chrislusf instead of github.com/aszxqw	11 years ago
wyy	1cd19447e3	use github.com/aszxqw instead of code.google.com/p	11 years ago
Chris Lu	b9aee2defb	add TTL support The volume TTL and file TTL are not necessarily the same. as long as file TTL is smaller than volume TTL, it'll be fine. volume TTL is used when assigning file id, e.g. http://.../dir/assign?ttl=3h file TTL is used when uploading	11 years ago
Chris Lu	4c58cef24a	a bit refactoring to prepare for volume format change and backward compatibility.	11 years ago
Chris Lu	4b7b439be9	Reduce memory usage for "weed fix"	12 years ago
Chris Lu	fe3f06435e	Refactor out volume vacuum.	12 years ago
Chris Lu	e7aaa24da8	Refactor out volume vacuum.	12 years ago
Chris Lu	3b5035c468	1. v0.54 2. go vet found many printing format errors	12 years ago
Chris Lu	a0955aa4dd	refactor functions	12 years ago
Chris Lu	0563773944	switch to ReadAt() for thread-safe read fix bugs during volume compaction	12 years ago
Chris Lu	af32b52727	1. no locks for all read operations! Switching to pread for all reads. 2. prevent heartbeat lost when vacuuming, by removing locks on Size() function	12 years ago
Chris Lu	cd10c277b2	can now delete a collection! Is this a dangerous feature? Only enabling deleting "benchmark" collections for now.	12 years ago
Chris Lu	e6e85a6b2c	truncate file content during creating	12 years ago
Chris Lu	27c74a7e66	Major: change replication_type to ReplicaPlacement, hopefully cleaner code works for 9 possible ReplicaPlacement xyz x : number of copies on other data centers y : number of copies on other racks z : number of copies on current rack x y z each can be 0,1,2 Minor: weed server "-mdir" default to "-dir" if empty	12 years ago
Chris Lu	67125688ed	Avoid creating *.dat file when reading and it does not exist	12 years ago
Chris Lu	cda2a6b510	trivial refactoring	12 years ago
Chris Lu	aed74b5568	adjust function name	12 years ago
Chris Lu	3b68711139	support for collections!	12 years ago
Chris Lu	9e9b2c0703	log changes	12 years ago
Chris Lu	3f5f8657d2	add a command to force compaction of a volume, removing deleted files	12 years ago
Chris Lu	69ac6b6bf6	Issue 45 in weed-fs: [Compact issue] Offset overflow New issue 45 by hieu.hcmus@gmail.com: [Compact issue] Offset overflow http://code.google.com/p/weed-fs/issues/detail?id=45 You are using uint32(Maximum 4Gb) to store needle offset(Maximum 32Gb) when compacting. Currently It is ok if the volume size is < 4gb Change variable "offset" in ScanVolumeFile function to uint64 to fix the issue.	12 years ago