chrislu
0da2dfd640
fuse: change to direct io mode
before and after:
chrislu$ time dd if=/dev/random of=/Users/chrislu/tmp/mm/testfile bs=131072 count=8192
8192+0 records in
8192+0 records out
1073741824 bytes transferred in 4.534068 secs (236816430 bytes/sec)
dd if=/dev/random of=/Users/chrislu/tmp/mm/testfile bs=131072 count=8192 0.01s user 3.86s system 84% cpu 4.561 total
chrislu$ time dd if=/dev/random of=/Users/chrislu/tmp/mm/testfile bs=131072 count=8192
8192+0 records in
8192+0 records out
1073741824 bytes transferred in 3.824072 secs (280784948 bytes/sec)
dd if=/dev/random of=/Users/chrislu/tmp/mm/testfile bs=131072 count=8192 0.01s user 3.22s system 83% cpu 3.857 total
3 years ago
chrislu
2422556456
monitor write pattern: avoid timing due to locking
3 years ago
chenkai
47c30e3add
filer list entries use context to break job
3 years ago
chrislu
80db8b13d8
bug: cleanup function was called twice
3 years ago
chrislu
67b723f74e
Filer Server API support fsync
fix https://github.com/chrislusf/seaweedfs/issues/2528
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
chrislu
c935b9669e
2.83
3 years ago
chrislu
eb4ad2546f
use proper chunk size limit option
3 years ago
chrislu
41bbf320bb
use 2MB chunk size. cache size is the wrong option
3 years ago
chrislu
083d8e9ece
add stream writer
this should improve streaming write performance, which is common in many cases, e.g., copying large files.
This is additional to improved random read write operations: 3e69d19380
...19084d87918f297cac15e2471c19306176e0771f
3 years ago
Sebastian Kurfürst
6db49100d6
BUGFIX: add access.ui setting to scaffolded security.toml
... The property is read here: b70cb3e0b2/weed/server/volume_server.go (L69)
3 years ago
chrislu
255a1c7dcd
refactor type names
3 years ago
chrislu
f77ca41769
refactor
3 years ago
chrislu
1d36884845
rename files
3 years ago
chrislu
2d1a1f5e03
rename variables and functions
3 years ago
chrislu
6de331b014
clean up
3 years ago
chrislu
032df784ed
chunked file works now
3 years ago
banjiaojuhao
083bf3a137
filer server: add "datacenter, rack and datanode" for path specific configuration
3 years ago
chrislu
c2aad1c7ff
detect non streaming mode on first write request
3 years ago
chrislu
b541e39a2c
fix tests
3 years ago
chrislu
0ec7bc6710
detect non streaming mode on the first read
3 years ago
chrislu
4c1368d621
fix test
3 years ago
banjiaojuhao
08336be92e
filer server: allow upload file to specific dataNode
3 years ago
chrislu
7b78fc72b0
add page chunk interval list
3 years ago
chrislu
3981d65b68
remove println
3 years ago
chrislu
9a73319b45
mount: different write strategy for streaming write and random write
3 years ago
banjiaojuhao
dda6b90d25
assign fileId according to DataNode with empty DataCenter and Rack
3 years ago
chrislu
4b8dcff448
reverting default admin scripts
fix https://github.com/chrislusf/seaweedfs/issues/2525
this new default value was introduced in 2.80
this affects production environments, e.g., EC is not desired, volume balancing is not preferred, etc.
3 years ago
chrislu
b21a67bbe6
add writer pattern object for later use
3 years ago
chrislu
4fd29dad86
remove writeOnly flag
3 years ago
chrislu
bc96682760
refactor, change file locations
3 years ago
chrislu
866c2657f0
avoid FUSE cache only for the first 512 bytes
3 years ago
chrislu
0cb9036f66
mount: only cache the first chunk on stream read
3 years ago
chrislu
a152f17937
mount: improve read performance on random reads
3 years ago
chrislu
85c526c583
s3: bind to a specific IP
fix https://github.com/chrislusf/seaweedfs/issues/2516
3 years ago
chrislu
5eacff9d4f
log message adds server name
address https://github.com/chrislusf/seaweedfs/issues/2514#issuecomment-995925733
3 years ago
chrislu
50ddd8c8e2
remove debug messages
fix https://github.com/chrislusf/seaweedfs/issues/2514
3 years ago
chrislu
7210558c7b
s3: pass through s3 presigned headers
fix https://github.com/chrislusf/seaweedfs/discussions/2502
3 years ago
chrislu
bf4d7affc0
gateway to remote object store: skip replicating multipart upload part files
fix https://github.com/chrislusf/seaweedfs/issues/2509
3 years ago
chrislu
316f326464
add more help message
3 years ago
Konstantin Lebedev
969f513265
disable audit log for s3 statusHandler
3 years ago
Konstantin Lebedev
34779e8f38
force enable asynchronous I/O sending events to Fluentd
3 years ago
chrislu
c3b73ec23b
2.82
3 years ago
chrislu
7bf14452f7
s3: handle Response-Content-Disposition
3 years ago
chrislu
94e5c0a454
skip purging from ec volumes
3 years ago
chrislu
a2d3f89c7b
add lock messages
3 years ago
chrislu
991a3dca0d
rename file
3 years ago
kmlebedev
4f98553ba9
audit log SignatureVersion
3 years ago
chrislu
2d6fcdf83a
add delay if need to resume from disk
3 years ago
liubaojiang
c7abc34dbb
rename operation returns the correct old parent path
3 years ago