Tree: 36f81bd462

add-message-queue-agent

add_fasthttp_client

add_remote_storage

avoid_releasing_temp_file_on_write

create-table-snapshot-api-design

data_query_pushdown

dependabot/go_modules/github.com/aws/aws-sdk-go-v2/service/s3-1.71.1

dependabot/go_modules/google.golang.org/grpc-1.69.2

dependabot/go_modules/google.golang.org/protobuf-1.36.1

dependabot/go_modules/modernc.org/mathutil-1.7.0

dependabot/go_modules/modernc.org/sqlite-1.34.4

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

fasthttp

filer1_maintenance_branch

ftp

gh-pages

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

tikv

track-mount-e2e

volume_buffered_writes

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '36f81bd462'

${ noResults }

Commit Graph

48 Commits (36f81bd46205db0ee9d8a0df2200713240dab8d0)

Author	SHA1	Message	Date
Chris Lu	d4566d4aaa	more solid weed mount (#4089) * compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec47. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation	2 years ago
chrislu	388f82f322	minor	2 years ago
chrislu	77e4b1376e	refactoring	2 years ago
Patrick Schmidt	3f758820c1	Fix FUSE server buffer leaks in file gaps (#3472) * Fix FUSE server buffer leaks in file gaps This change zeros read buffers when encountering file gaps during file/chunk reads in FUSE mounts. It prevents leaking internal buffers of the FUSE server which could otherwise reveal metadata, directory listings, file contents and other data related to FUSE API calls. The issue was that buffers are reused, but when a file gap was found the buffer was not zeroed accordingly and the existing data of the buffer was kept and returned. * Move zero logic into its own method	2 years ago
Konstantin Lebedev	4d08393b7c	filer prefer volume server in same data center (#3405) * initial prefer same data center https://github.com/seaweedfs/seaweedfs/issues/3404 * GetDataCenter * prefer same data center for ReplicationSource * GetDataCenterId * remove glog	2 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2 years ago
chrislu	f2f0482dd3	mount: random read also try to use the local cache first	2 years ago
chrislu	53513475bf	mount: add back random read support avoid too much memory used also	3 years ago
chrislu	941ced60a4	download 2 chunks if at the beginning of a file	3 years ago
chrislu	551d00d51a	prefetch other chunks when stream reading	3 years ago
chrislu	3345a50d9b	prefetch 2 chunks	3 years ago
chrislu	28b395bef4	better control for reader caching	3 years ago
banjiaojuhao	45e9c83421	padding zero for sparse file	3 years ago
chrislu	9a00c17555	reader: avoid wrong pattern detection due to lock waiting	3 years ago
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	3 years ago
chrislu	b541e39a2c	fix tests	3 years ago
chrislu	4c1368d621	fix test	3 years ago
chrislu	0cb9036f66	mount: only cache the first chunk on stream read	3 years ago
chrislu	a152f17937	mount: improve read performance on random reads	3 years ago
Chris Lu	1737af480a	adjust logs	4 years ago
Nathan Hawkins	042de9359c	make reader_at handle random reads more efficiently for FUSE	4 years ago
Chris Lu	990fa69bfe	add back AdjustedUrl() related code	4 years ago
Chris Lu	00707ec00f	mount: outsideContainerClusterMode proxy through filer Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.	4 years ago
Chris Lu	6ca10725b8	Revert "mount: when outside cluster network, use filer as proxy to access volume servers" This reverts commit 096e088d7b.	4 years ago
Chris Lu	096e088d7b	mount: when outside cluster network, use filer as proxy to access volume servers	4 years ago
Chris Lu	de876c795d	minor fix	4 years ago
Chris Lu	2b76854641	add "weed filer.cat" to read files directly from volume servers	4 years ago
Chris Lu	8e78187a97	add back last read chunk cache to reader and properly close the reader	4 years ago
Chris Lu	900d22c6ec	mount: avoid memory leaking read buffer fix https://github.com/chrislusf/seaweedfs/issues/1654 the reader goes together with the file handle, which may stay for a long time.	4 years ago
Chris Lu	8750cac090	move to util.RetryWaitTime	4 years ago
Chris Lu	df8d976bb0	refactoring	4 years ago
Chris Lu	bd103c143a	add lock for vidCache	4 years ago
Chris Lu	93bcf56514	file read report EOF fix https://github.com/chrislusf/seaweedfs/issues/1344	4 years ago
Chris Lu	723ae11db4	refactoring in order to adjust volume server url later	4 years ago
Chris Lu	d155f907c2	mount: configurable read wait time	4 years ago
Chris Lu	8a52379ecb	add retry if volume can not be found	4 years ago
Chris Lu	cff8bb6554	return proper error	4 years ago
Chris Lu	b2ee5873fb	fix error not being returned	4 years ago
Chris Lu	eed492b73b	randomize file locations	4 years ago
Chris Lu	a8624c2e4f	read from alternative replica related to https://github.com/chrislusf/seaweedfs/issues/1512	4 years ago
Chris Lu	36492c47ec	adjust	4 years ago
Chris Lu	8f8e9ddbde	adjust API	4 years ago
Chris Lu	6b591b02af	adjust log level	4 years ago
Chris Lu	666859f7cd	mount: read prefetching	4 years ago
Chris Lu	bc47835997	mount: avoid duplicated reads	4 years ago
Chris Lu	8d65ad1444	Revert "mount: adds read prefetching" This reverts commit 692f0614d1.	4 years ago
Chris Lu	692f0614d1	mount: adds read prefetching	4 years ago
Chris Lu	eb7929a971	rename filer2 to filer	4 years ago
Chris Lu	a41588279a	change log level 5 to 4	4 years ago
Chris Lu	99ecf63276	go fmt	4 years ago