You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Chris Lu
c114e8701f
Address review comments: make prefetch configurable, improve error handling
Changes:
1. Add DefaultPrefetchCount constant (4) to reader_at.go
2. Add GetPrefetchCount() method to ChunkGroup that derives prefetch count
from concurrentReaders (1/4 ratio, min 1, max 8)
3. Pass prefetch count through NewChunkReaderAtFromClient
4. Fix error handling in readDataAtParallel to prioritize errgroup error
5. Update all callers to use DefaultPrefetchCount constant
For mount operations, prefetch scales with -concurrentReaders:
- concurrentReaders=16 (default) -> prefetch=4
- concurrentReaders=32 -> prefetch=8 (capped)
- concurrentReaders=4 -> prefetch=1
For non-mount paths (WebDAV, query engine, MQ), uses DefaultPrefetchCount.
2 months ago
..
admin
muted texts
3 months ago
cluster
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
2 months ago
command
mount: improve read throughput with parallel chunk fetching
2 months ago
credential
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
2 months ago
filer
Address review comments: make prefetch configurable, improve error handling
2 months ago
filer_client
Clean up logs and deprecated functions (#7339)
3 months ago
glog
Add Kafka Gateway (#7231)
3 months ago
iam
S3: Enforce bucket policy (#7471)
2 months ago
iamapi
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
2 months ago
images
Migrates from disintegration/imaging c2019 to cognusion/imaging c2024. (#5533)
2 years ago
kms
S3 API: Add integration with KMS providers (#7152)
5 months ago
mount
mount: improve read throughput with parallel chunk fetching
2 months ago
mq
Address review comments: make prefetch configurable, improve error handling
2 months ago
notification
fix: dead letter message log message (#7072)
6 months ago
operation
filer write request use context without cancellation (#7567)
2 months ago
pb
fix too many pings (#7566)
2 months ago
query
Address review comments: make prefetch configurable, improve error handling
2 months ago
remote_storage
Filer: Fixed critical bugs in the Azure SDK migration (PR #7310) (#7401)
3 months ago
replication
Filer: Fixed critical bugs in the Azure SDK migration (PR #7310) (#7401)
3 months ago
s3api
fmt
2 months ago
security
remove spoof-able request header (#7103)
6 months ago
sequence
remove unused function
2 years ago
server
Address review comments: make prefetch configurable, improve error handling
2 months ago
sftpd
S3 API: Advanced IAM System (#7160)
5 months ago
shell
feat(volume.fix): show all replica locations for misplaced volumes (#7560)
2 months ago
static
Fix Broken Links (#5287)
2 years ago
stats
Metrics: Add Prometheus metrics for concurrent upload tracking (#7555)
2 months ago
storage
Volume Server: avoid aggressive volume assignment (#7501)
2 months ago
telemetry
convert error fromating to %w everywhere (#6995)
6 months ago
topology
master: fix negative active volumes (#7440)
3 months ago
util
4.01
2 months ago
wdclient
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
2 months ago
worker
go fmt
3 months ago
Makefile
test versioning also (#7000)
6 months ago
weed.go
set exit status
10 months ago