chrislu
388f82f322
minor
2 years ago
chrislu
77e4b1376e
refactoring
2 years ago
Patrick Schmidt
3f758820c1
Fix FUSE server buffer leaks in file gaps ( #3472 )
* Fix FUSE server buffer leaks in file gaps
This change zeros read buffers when encountering file gaps during
file/chunk reads in FUSE mounts.
It prevents leaking internal buffers of the FUSE server which could
otherwise reveal metadata, directory listings, file contents and
other data related to FUSE API calls.
The issue was that buffers are reused, but when a file gap was found
the buffer was not zeroed accordingly and the existing data of the
buffer was kept and returned.
* Move zero logic into its own method
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
f2f0482dd3
mount: random read also try to use the local cache first
3 years ago
chrislu
53513475bf
mount: add back random read support
avoid too much memory used also
3 years ago
chrislu
941ced60a4
download 2 chunks if at the beginning of a file
3 years ago
chrislu
551d00d51a
prefetch other chunks when stream reading
3 years ago
chrislu
3345a50d9b
prefetch 2 chunks
3 years ago
chrislu
28b395bef4
better control for reader caching
3 years ago
banjiaojuhao
45e9c83421
padding zero for sparse file
3 years ago
chrislu
9a00c17555
reader: avoid wrong pattern detection due to lock waiting
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
chrislu
b541e39a2c
fix tests
3 years ago
chrislu
4c1368d621
fix test
3 years ago
chrislu
0cb9036f66
mount: only cache the first chunk on stream read
3 years ago
chrislu
a152f17937
mount: improve read performance on random reads
3 years ago
Chris Lu
1737af480a
adjust logs
4 years ago
Nathan Hawkins
042de9359c
make reader_at handle random reads more efficiently for FUSE
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
de876c795d
minor fix
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago
Chris Lu
8e78187a97
add back last read chunk cache to reader and properly close the reader
4 years ago
Chris Lu
900d22c6ec
mount: avoid memory leaking read buffer
fix https://github.com/chrislusf/seaweedfs/issues/1654
the reader goes together with the file handle, which may stay for a long time.
4 years ago
Chris Lu
8750cac090
move to util.RetryWaitTime
4 years ago
Chris Lu
df8d976bb0
refactoring
4 years ago
Chris Lu
bd103c143a
add lock for vidCache
4 years ago
Chris Lu
93bcf56514
file read report EOF
fix https://github.com/chrislusf/seaweedfs/issues/1344
4 years ago
Chris Lu
723ae11db4
refactoring in order to adjust volume server url later
4 years ago
Chris Lu
d155f907c2
mount: configurable read wait time
4 years ago
Chris Lu
8a52379ecb
add retry if volume can not be found
4 years ago
Chris Lu
cff8bb6554
return proper error
4 years ago
Chris Lu
b2ee5873fb
fix error not being returned
4 years ago
Chris Lu
eed492b73b
randomize file locations
4 years ago
Chris Lu
a8624c2e4f
read from alternative replica
related to https://github.com/chrislusf/seaweedfs/issues/1512
4 years ago
Chris Lu
36492c47ec
adjust
4 years ago
Chris Lu
8f8e9ddbde
adjust API
4 years ago
Chris Lu
6b591b02af
adjust log level
4 years ago
Chris Lu
666859f7cd
mount: read prefetching
4 years ago
Chris Lu
bc47835997
mount: avoid duplicated reads
4 years ago
Chris Lu
8d65ad1444
Revert "mount: adds read prefetching"
This reverts commit 692f0614d1
.
4 years ago
Chris Lu
692f0614d1
mount: adds read prefetching
4 years ago
Chris Lu
eb7929a971
rename filer2 to filer
4 years ago
Chris Lu
a41588279a
change log level 5 to 4
4 years ago
Chris Lu
99ecf63276
go fmt
4 years ago
Chris Lu
3e5339337a
minor
4 years ago