Tree: 3d7baa30cd

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/aws/aws-sdk-go-v2/service/s3-1.71.1

dependabot/go_modules/google.golang.org/grpc-1.69.2

dependabot/go_modules/google.golang.org/protobuf-1.36.1

dependabot/go_modules/modernc.org/mathutil-1.7.0

dependabot/go_modules/modernc.org/sqlite-1.34.4

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '3d7baa30cd'

${ noResults }

Commit Graph

69 Commits (3d7baa30cd08478db39414509aba628e219c1e8b)

Author	SHA1	Message	Date
chrislu	e037c71ec3	adjust text	2 years ago
chrislu	67b8c2853a	add line return	2 years ago
Chris Lu	d4566d4aaa	more solid weed mount (#4089) * compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec47. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation	2 years ago
chrislu	70a4c98b00	refactor filer_pb.Entry and filer.Entry to use GetChunks() for later locking on reading chunks	2 years ago
Konstantin Lebedev	0999f9b7ff	[volume.fsck] collect ids without cut off time for finding missing data from volumes (#3934) collect all file ids from the file without cut off time for finding missing data from volumes	2 years ago
Konstantin Lebedev	a322ba042e	[volume.fsck] param volumeId is comma separated the volume id (#3933) volume.fsck param volumeId is comma separated the volume id Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
Konstantin Lebedev	c0deaa4948	[volume.fsck] check needles status from volume server (#3926) check needles status from volume server	2 years ago
Konstantin Lebedev	bf8a9d2db1	[volume.chek.disk] sync of deletions the fix (#3923) * sync of deletions the fix * avoid return if only partiallyDeletedNeedles * refactor sync deletions	2 years ago
chrislu	ea2637734a	refactor filer proto chunk variable from mtime to modified_ts_ns	2 years ago
Eric Yang	51d462f204	ADHOC: volume fsck using append at ns (#3906) * ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
chrislu	377870f4a9	keep system log data	2 years ago
Konstantin Lebedev	7836f7574e	[volume.fsck] hotfix apply purging and add option verifyNeedle #3860 (#3861) * fix apply purging and add verifyNeedle * common readSourceNeedleBlob * use consts	2 years ago
Konstantin Lebedev	f19c9e3d9d	Volume fsck by volume (#3851) * refactor * refactor args verbose and writer * refactor readFilerFileIdFile * fix filter by collectMtime * skip system log collection	2 years ago
Eric Yang	56c94cc08e	ADHOC: filter deleted files from idx file binary search (#3763) * ADHOC: filter deleted files from idx file binary search * remove unwanted check Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
chrislu	b6d7556dda	skip truncation on error fix https://github.com/seaweedfs/seaweedfs/issues/3746	2 years ago
Eric Yang	ddd6bee970	ADHOC: Volume fsck use a time cutoff param (#3626) * ADHOC: cut off volumn fsck * more * fix typo * add test * modify name * fix comment * fix comments * nit * fix typo * Update weed/shell/command_volume_fsck.go Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	2 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2 years ago
chrislu	271b5aed96	shell: volume.fsck add a note for -reallyDeleteFromVolume option	3 years ago
Konstantin Lebedev	d4343ab7da	forcePurging desc	3 years ago
Konstantin Lebedev	ae56b2c00f	change forcePurging to a pointer	3 years ago
Konstantin Lebedev	6d2fda27d2	delete missing data from volumes in one replica	3 years ago
Konstantin Lebedev	7f1383a41e	findExtraChunksInVolumeServers in consideration of replication	3 years ago
Konstantin Lebedev	3817e05dd0	fix collect filer files	3 years ago
Konstantin Lebedev	3cedb21bb7	skip new entities	3 years ago
Konstantin Lebedev	1d9e30d8c0	fsck replicas	3 years ago
Konstantin Lebedev	4f5b018a02	collecting only bucket volumes	3 years ago
banjiaojuhao	f7f2a597dd	minor	3 years ago
Radtoo	724ce04b1c	We picked the second flag's name.	3 years ago
Radtoo	fbe7ed7927	Revert the the flag to "reallyDeleteFromVolume".	3 years ago
chrislu	f18803424a	volume.balance: add delay during tight loop fix https://github.com/chrislusf/seaweedfs/issues/2637	3 years ago
Radtoo	fbb14e0ea8	Adding separate toggle to purge absent vols While this toggle is basically required to clean out entries for deleted volumes, having a separate description + toggling this separately seems like a good idea so people get a chance to check if their volumes are all mounted/connected as expected. Also renamed forcePurge to just purge.	3 years ago
Radtoo	6b17f45da2	Also delete paths for which a volume is entirely absent.	3 years ago
Radtoo	fa0cfdfb7f	Added basic deletion capabilities to fsck.	3 years ago
chrislu	ce2049cdb6	refactoring, move genFn before saveFn	3 years ago
chrislu	60dc450091	skip fixing read only volumes fix https://github.com/chrislusf/seaweedfs/issues/2562	3 years ago
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	3 years ago
chrislu	94e5c0a454	skip purging from ec volumes	3 years ago
chrislu	a2d3f89c7b	add lock messages	3 years ago
Chris Lu	9ccfc1cfee	Update command_volume_fsck.go minor	3 years ago
Chris Lu	71a94267c9	Update command_volume_fsck.go remove unused code	3 years ago
Eng Zer Jun	a23bcbb7ec	refactor: move from io/ioutil to io and os package The io/ioutil package has been deprecated as of Go 1.16, see https://golang.org/doc/go1.16#ioutil. This commit replaces the existing io/ioutil functions with their new definitions in io and os packages. Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>	3 years ago
Chris Lu	119d5908dd	shell: do not need to lock to see volume -h	3 years ago
Chris Lu	e5fc35ed0c	change server address from string to a type	3 years ago
Chris Lu	333cdce485	add verbose message	3 years ago
Chris Lu	4deac06da0	log fix	3 years ago
Chris Lu	7ab389e7ec	optimization: improve random range query for large files	3 years ago
Chris Lu	01adc567aa	shell: volume.fsck deletes a volume is the volume has only orphaned data. fix https://github.com/chrislusf/seaweedfs/issues/2190	4 years ago
Chris Lu	d013d6d968	shell: volume.fsck "reallyDeleteFromVolume" should send padded file ids to delete fix https://github.com/chrislusf/seaweedfs/issues/2188	4 years ago
Chris Lu	08377fecb8	fixes	4 years ago
Chris Lu	1cac2f2278	shell: volume.fsck checks missing chunks in filer fix https://github.com/chrislusf/seaweedfs/issues/2154	4 years ago