You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Chris Lu
c114e8701f
Address review comments: make prefetch configurable, improve error handling
Changes:
1. Add DefaultPrefetchCount constant (4) to reader_at.go
2. Add GetPrefetchCount() method to ChunkGroup that derives prefetch count
from concurrentReaders (1/4 ratio, min 1, max 8)
3. Pass prefetch count through NewChunkReaderAtFromClient
4. Fix error handling in readDataAtParallel to prioritize errgroup error
5. Update all callers to use DefaultPrefetchCount constant
For mount operations, prefetch scales with -concurrentReaders:
- concurrentReaders=16 (default) -> prefetch=4
- concurrentReaders=32 -> prefetch=8 (capped)
- concurrentReaders=4 -> prefetch=1
For non-mount paths (WebDAV, query engine, MQ), uses DefaultPrefetchCount.
5 days ago
..
admin
muted texts
4 weeks ago
cluster
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
1 week ago
command
mount: improve read throughput with parallel chunk fetching
5 days ago
credential
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
1 week ago
filer
Address review comments: make prefetch configurable, improve error handling
5 days ago
filer_client
Clean up logs and deprecated functions (#7339)
2 months ago
glog
Add Kafka Gateway (#7231)
2 months ago
iam
S3: Enforce bucket policy (#7471)
3 weeks ago
iamapi
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
1 week ago
images
Migrates from disintegration/imaging c2019 to cognusion/imaging c2024. (#5533)
2 years ago
kms
S3 API: Add integration with KMS providers (#7152)
3 months ago
mount
mount: improve read throughput with parallel chunk fetching
5 days ago
mq
Address review comments: make prefetch configurable, improve error handling
5 days ago
notification
fix: dead letter message log message (#7072)
4 months ago
operation
filer write request use context without cancellation (#7567)
5 days ago
pb
fix too many pings (#7566)
5 days ago
query
Address review comments: make prefetch configurable, improve error handling
5 days ago
remote_storage
Filer: Fixed critical bugs in the Azure SDK migration (PR #7310) (#7401)
1 month ago
replication
Filer: Fixed critical bugs in the Azure SDK migration (PR #7310) (#7401)
1 month ago
s3api
fmt
6 days ago
security
remove spoof-able request header (#7103)
4 months ago
sequence
remove unused function
1 year ago
server
Address review comments: make prefetch configurable, improve error handling
5 days ago
sftpd
S3 API: Advanced IAM System (#7160)
3 months ago
shell
feat(volume.fix): show all replica locations for misplaced volumes (#7560)
7 days ago
static
Fix Broken Links (#5287)
2 years ago
stats
Metrics: Add Prometheus metrics for concurrent upload tracking (#7555)
1 week ago
storage
Volume Server: avoid aggressive volume assignment (#7501)
2 weeks ago
telemetry
convert error fromating to %w everywhere (#6995)
5 months ago
topology
master: fix negative active volumes (#7440)
4 weeks ago
util
4.01
6 days ago
wdclient
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
1 week ago
worker
go fmt
1 month ago
Makefile
test versioning also (#7000)
5 months ago
weed.go
set exit status
9 months ago