Tree: d95a4561e0

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/aws/aws-sdk-go-v2/service/s3-1.71.1

dependabot/go_modules/google.golang.org/grpc-1.69.2

dependabot/go_modules/google.golang.org/protobuf-1.36.1

dependabot/go_modules/modernc.org/mathutil-1.7.0

dependabot/go_modules/modernc.org/sqlite-1.34.4

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'd95a4561e0'

${ noResults }

Commit Graph

49 Commits (d95a4561e01ceaeda8ab9ca4d6e1fd05b0d58d58)

Author	SHA1	Message	Date
Chris Lu	d4566d4aaa	more solid weed mount (#4089) * compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec47. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation	2 years ago
chrislu	9d230521a4	report write error	2 years ago
Ryan Russell	72d8a9f9a8	refactor(exclusive_locker): `Interval` readability batch of updates (#3668) * refactor(filechunk_manifest): `localProcesed` -> `localProcessed` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor: `saveChunkedFileIntevalToStorage` -> `saveChunkedFileIntervalToStorage` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor: `SafeRenewInteval` -> `SafeRenewInterval` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor: `InitLockInteval` -> `InitLockInterval` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor: `RenewInteval` -> `RenewInterval` Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>	2 years ago
chrislu	689b4ecdcc	remove unused collection and replication from upload result	2 years ago
chrislu	eaeb141b09	move proto package	2 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2 years ago
geekboood	fdacd94af5	fix: invalid chunk data when failed to read manifests	3 years ago
chrislu	a5cdcc7e63	fix reading files larger than 20GB due to manifest resolving bug	3 years ago
chrislu	59cc3c0bfd	fix reading files larger than 20GB due to manifest resolving bug this is introduced since Mar 08 2022	3 years ago
chrislu	53513475bf	mount: add back random read support avoid too much memory used also	3 years ago
banjiaojuhao	f7f2a597dd	minor	3 years ago
chrislu	6f3ec989a7	fix manifest batch size	3 years ago
banjiaojuhao	a07c93f4dd	filer: reset bytesBuffer before use	3 years ago
chrislu	6fbbc78574	stream reading a whole chunk	3 years ago
chrislu	7b1a713d2a	remove dead code	3 years ago
chrislu	3a58b7bac6	a little safer	3 years ago
chrislu	28b395bef4	better control for reader caching	3 years ago
chrislu	a152f17937	mount: improve read performance on random reads	3 years ago
Chris Lu	7bf891c00a	randomize same-dc servers and other-dc servers	3 years ago
Chris Lu	7348d2ae63	randomize traffic if replicated	3 years ago
Chris Lu	574485ec69	better IP v6 support	3 years ago
Chris Lu	0c66b173a4	fix	3 years ago
Chris Lu	e02a317d3d	adjust retry logic in case some data is partially written	3 years ago
Chris Lu	2d519c6cb6	adjust the retry logic	3 years ago
Chris Lu	b961fcd338	filer: stream read from volume server, reduce memory usage	3 years ago
Chris Lu	7ab389e7ec	optimization: improve random range query for large files	3 years ago
Chris Lu	93c37cfded	Update filechunk_manifest.go	3 years ago
Chris Lu	2f7c7afdec	refactor: remove unused parameter	4 years ago
Chris Lu	d48dd0c738	use []byte directly instead of bytes.Buffer	4 years ago
Chris Lu	4b1ed227d1	revert fasthttp changes related to https://github.com/chrislusf/seaweedfs/issues/1907	4 years ago
Konstantin Lebedev	7194a5e7bf	avoid http error: superfluous response.WriteHeader https://github.com/chrislusf/seaweedfs/issues/1838	4 years ago
Chris Lu	7d9dc3c6a2	use fasthttp lib to read	4 years ago
Chris Lu	2b76854641	add "weed filer.cat" to read files directly from volume servers	4 years ago
Chris Lu	8750cac090	move to util.RetryWaitTime	4 years ago
Chris Lu	d75bc62196	to read files that are quickly changing	4 years ago
Chris Lu	0542911e29	go fmt	4 years ago
Chris Lu	58fa506491	minor	4 years ago
Chris Lu	3f7d1d1bf1	Only wait on retryable requests	4 years ago
Chris Lu	d155f907c2	mount: configurable read wait time	4 years ago
Chris Lu	6da8eef54f	fix logic error	4 years ago
Chris Lu	5d01dd28a6	add logging	4 years ago
Chris Lu	8d34eb0050	mount:exponentially backoff if read error for about 10 minutes	4 years ago
Chris Lu	6e1f936efd	refactoring	4 years ago
Chris Lu	8676db0f6a	adjust logging	4 years ago
Chris Lu	a8624c2e4f	read from alternative replica related to https://github.com/chrislusf/seaweedfs/issues/1512	4 years ago
Chris Lu	2e7c361a0d	hardlink deletion factors in hardlink counter	4 years ago
Chris Lu	eb7929a971	rename filer2 to filer	4 years ago
Chris Lu	f2a8574448	filer and mount deletion resolves manifest chunks also	4 years ago
Chris Lu	99ecf63276	go fmt	4 years ago
Chris Lu	2cdad77d82	fix checkin error	4 years ago