Tree: 1a6842c477

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '1a6842c477'

${ noResults }

Commit Graph

829 Commits (1a6842c4777d0110476b9595016f0a1e90a45093)

Author	SHA1	Message	Date
Konstantin Lebedev	764d9cb105	[voluche.chek.disk] needles older than the cutoff time are not missing yet (#3922) needles older than the cutoff time are not missing yet https://github.com/seaweedfs/seaweedfs/issues/3919	2 years ago
Eric Yang	51d462f204	ADHOC: volume fsck using append at ns (#3906) * ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
chrislu	d880fc2bb3	fix merge	2 years ago
Konstantin Lebedev	6253058d9d	ensure monotonic n.AppendAtNs in each place (#3880) https://github.com/seaweedfs/seaweedfs/issues/3852 Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
Konstantin Lebedev	452202f35b	ReadNeedleMeta recovery panic occurred (#3883) ReadNeedleMeta panic occurred https://github.com/seaweedfs/seaweedfs/issues/3882	2 years ago
chrislu	e3ea544d40	skip reading needle if size is invalid related to https://github.com/seaweedfs/seaweedfs/issues/3882	2 years ago
chrislu	f2d9049e6a	fix size variable	2 years ago
chrislu	184fbb6c50	volume server: remote tier volumes only soft delete in local index fix https://github.com/seaweedfs/seaweedfs/issues/3889	2 years ago
Konstantin Lebedev	e20f0dbd2d	avoid data race of TraverseBfs (#3856) * avoid data race of TraverseBfs * close is enough avoid panic I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255 I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c] goroutine 287 [running]: github.com/seaweedfs/seaweedfs/weed/storage.(*SortedFileNeedleMap).Close(0x0) /Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load.func1() /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?) /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...) /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1) /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes.func2() /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9 created by github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150	2 years ago
Konstantin Lebedev	2f72103c83	avoid load volume file with BytesOffset mismatch (#3841) * avoid load volume file with BytesOffset mismatch https://github.com/seaweedfs/seaweedfs/issues/2966 * set BytesOffset if has not VolumeInfoFile * typos fail => failed * exit if bytesOffset mismatch	2 years ago
chrislu	9c8678ded9	ensure monotonic n.AppendAtNs fix https://github.com/seaweedfs/seaweedfs/issues/3852	2 years ago
Konstantin Lebedev	1f7e52c63e	vacuum metrics and force sync dst files (#3832)	2 years ago
Guo Lei	f95c25e113	types packages is imported more than onece (#3838)	2 years ago
chrislu	e55076c46f	cloud tier: add retry when copying data file fix https://github.com/seaweedfs/seaweedfs/issues/3828	2 years ago
Guo Lei	84c401e693	Optimiz leveldb metric (#3830) * optimiz updating mapmetric for leveldb * import loading leveldb * add comments	2 years ago
Konstantin Lebedev	5b28c3f728	revert disabling FSync for non Mac (#3814)	2 years ago
binbinshi	b7de4a967e	fix: compact_map get error mismatching cokie (#3748) * fix: compact_map get error * fix: CompactSection delete lock and move test to compact_map Co-authored-by: shibinbin <shibinbin@megvii.com>	2 years ago
Viktor Kuzmin	f8d3ff466d	Allow parallel volume loading from different dirs during startup. (#3802)	2 years ago
Eric Yang	56c94cc08e	ADHOC: filter deleted files from idx file binary search (#3763) * ADHOC: filter deleted files from idx file binary search * remove unwanted check Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
Konstantin Lebedev	301b678147	[volume] Add new volumes to HUP(reload) signal (#3755) Add new volumes to HUP(reload) signal	2 years ago
chrislu	06748f2771	remove unused code	2 years ago
Ryan Russell	277976bd76	refactor(storage): readability improvements (#3703) Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>	2 years ago
famosss	d949a238b8	volume: add "readBufSize" option to customize read optimization (#3702) * simplify a bit * feat: volume: add "readBufSize" option to customize read optimization * refactor : redbufSIze -> readBufferSize * simplify a bit * simplify a bit	2 years ago
chrislu	896a85d6e4	volume: add "hasSlowRead" option to customize read optimization	2 years ago
chrislu	21c0587900	go fmt	2 years ago
chrislu	0baf3d38c2	adjust logs	2 years ago
Eric Yang	ddd6bee970	ADHOC: Volume fsck use a time cutoff param (#3626) * ADHOC: cut off volumn fsck * more * fix typo * add test * modify name * fix comment * fix comments * nit * fix typo * Update weed/shell/command_volume_fsck.go Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
famosss	41af5a6ee5	simplify a bit (#3631)	2 years ago
chrislu	64e75a286e	simplify a bit	2 years ago
chrislu	d14d029c73	reduce v.dataFileAccessLock lock scope	2 years ago
chrislu	406a80da4b	adjust variable names	2 years ago
chrislu	2bfc8970d2	refactor: move ReadNeedleDataInto into volume_read.go	2 years ago
chrislu	9b084d4c88	purge tcp implementation	2 years ago
Eric Yang	b324a6536c	ADHOC: add read needle meta grpc (#3581) * ADHOC: add read needle meta grpc * add test * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
chrislu	39340f7e42	cloud tier: s3 consume all read response body fix https://github.com/seaweedfs/seaweedfs/issues/3584	2 years ago
chrislu	7c6324b114	adjust log level	2 years ago
chrislu	8c5759a06d	minor optimization	2 years ago
Konstantin Lebedev	ade94b0d0a	avoid race conditions access to SuperBlock.Version (#3539) * avoid race conditions access to SuperBlock.Version https://github.com/seaweedfs/seaweedfs/issues/3515 * superBlockAccessLock replace to sync.Mutex	2 years ago
chrislu	3f3a1341d8	make CodeQL happy	2 years ago
chrislu	e0f4366f4c	more detailed error related to https://github.com/seaweedfs/seaweedfs/issues/3528	2 years ago
Konstantin Lebedev	4f7a1f67cd	avoid race conditions for diskLocation.MaxVolumeCount (#3526)	2 years ago
Guo Lei	c57c79a0ab	optimiz commitig compact (#3388) * optimiz vacuuming volume * fix bugx * rename parameters * fix conflict * change copyDataBasedOnIndexFile to an instance method * close needlemap * optimiz commiting Vacuum volume for leveldb index * fix bugs * fix leveldb loading bugs * refactor * fix leveldb loading bug * add leveldb recovery * add test case for levelDB * modify test case to cover all the new branches * use one tmpNm instead of two instances * refactor * refactor * move setWatermark to the end * add test for watermark and updating leveldb * fix error logic * refactor, add test * check nil before close needlemapeer add test case fix metric bug * add tests, fix bugs * adjust log level remove wrong test case refactor * avoid duplicate updating metric for leveldb index	2 years ago
Guo Lei	762dc219a6	fix deletecount bug (#3499)	2 years ago
Guo Lei	81e7e6ceb3	the statistical methord for fileCount should stay same (#3477) the statistical methord for fileCount between should stay same They all equal to the entry count in .idx file. relate to commit(c7892bc)	2 years ago
chrislu	c7892bc7c4	volume: file counter should be all files address https://github.com/seaweedfs/seaweedfs/pull/3388#issuecomment-1220466228	2 years ago
chrislu	4d72a1ce6e	s3: remove deleted collection during metrics reporting fix https://github.com/seaweedfs/seaweedfs/issues/3453	2 years ago
chrislu	2b580a7566	also migrate jsonpb	2 years ago
chrislu	eaeb141b09	move proto package	2 years ago
chrislu	93261f5199	Revert "Refactor for Sync method (#3426)" This reverts commit 670cb759f8. with the pr weed/storage () - (master) > go test -count=1 ./... ok github.com/seaweedfs/seaweedfs/weed/storage 18.486s ? github.com/seaweedfs/seaweedfs/weed/storage/backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/backend/memory_map 0.025s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/s3_backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding 0.864s ? github.com/seaweedfs/seaweedfs/weed/storage/idx [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/needle 0.110s ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map 24.414s ok github.com/seaweedfs/seaweedfs/weed/storage/super_block 0.203s ? github.com/seaweedfs/seaweedfs/weed/storage/types [no test files] ? github.com/seaweedfs/seaweedfs/weed/storage/volume_info [no test files] weed/storage () - (master) > weed/storage () - (master) > without the pr weed/storage () - (master) > weed/storage () - (master) > go test -count=1 ./... ok github.com/seaweedfs/seaweedfs/weed/storage 1.617s ? github.com/seaweedfs/seaweedfs/weed/storage/backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/backend/memory_map 0.026s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/s3_backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding 0.906s ? github.com/seaweedfs/seaweedfs/weed/storage/idx [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/needle 0.202s ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map 24.533s ok github.com/seaweedfs/seaweedfs/weed/storage/super_block 0.280s ? github.com/seaweedfs/seaweedfs/weed/storage/types [no test files] ? github.com/seaweedfs/seaweedfs/weed/storage/volume_info [no test files]	2 years ago
Rain Li	670cb759f8	Refactor for Sync method (#3426)	2 years ago