You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Tree: f00cd38393

add-admin-and-worker-to-helm-charts

add-ec-vacuum

add_fasthttp_client

add_remote_storage

adding-message-queue-integration-tests

also-delete-parent-directory-if-empty

avoid_releasing_temp_file_on_write

changing-to-zap

collect-public-metrics

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

detect-and-plan-ec-tasks

do-not-retry-if-error-is-NotFound

enhance-erasure-coding

fasthttp

filer1_maintenance_branch

fix-GetObjectLockConfigurationHandler

fix-versioning-listing-only

ftp

gh-pages

improve-fuse-mount

improve-fuse-mount2

improve-mount-read-throughput

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

pr-7412

random_access_file

refactor-needle-read-operations

refactor-volume-write

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

testing-sdx-generation

tikv

track-mount-e2e

upgrade-versions-to-4.00

volume_buffered_writes

worker-execute-ec-tasks

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

3.85

3.86

3.87

3.88

3.89

3.90

3.91

3.92

3.93

3.94

3.95

3.96

3.97

3.98

3.99

4.00

4.01

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'f00cd38393'

${ noResults }

seaweedfs/weed/server

History

Chris Lu 848bec6d24 Metrics: Add Prometheus metrics for concurrent upload tracking (#7555) * metrics: add Prometheus metrics for concurrent upload tracking Add Prometheus metrics to monitor concurrent upload activity for both filer and S3 servers. This provides visibility into the upload limiting feature added in the previous PR. New Metrics: - SeaweedFS_filer_in_flight_upload_bytes: Current bytes being uploaded to filer - SeaweedFS_filer_in_flight_upload_count: Current number of uploads to filer - SeaweedFS_s3_in_flight_upload_bytes: Current bytes being uploaded to S3 - SeaweedFS_s3_in_flight_upload_count: Current number of uploads to S3 The metrics are updated atomically whenever uploads start or complete, providing real-time visibility into upload concurrency levels. This helps operators: - Monitor upload concurrency in real-time - Set appropriate limits based on actual usage patterns - Detect potential bottlenecks or capacity issues - Track the effectiveness of upload limiting configuration * grafana: add dashboard panels for concurrent upload metrics Add 4 new panels to the Grafana dashboard to visualize the concurrent upload metrics added in this PR: Filer Section: - Filer Concurrent Uploads: Shows current number of concurrent uploads - Filer Concurrent Upload Bytes: Shows current bytes being uploaded S3 Gateway Section: - S3 Concurrent Uploads: Shows current number of concurrent uploads - S3 Concurrent Upload Bytes: Shows current bytes being uploaded These panels help operators monitor upload concurrency in real-time and tune the upload limiting configuration based on actual usage patterns. * more efficient		3 days ago
..
constants	Nit: use `time.Duration`s instead of constants in seconds. (#7438)	4 weeks ago
filer_ui	fix(filer-ui): support folder creation with JWT token in URL (#7271)	3 days ago
master_ui	Fix/parse upload filename (#6241)	1 year ago
postgres	Message Queue: Add sql querying (#7185)	3 months ago
volume_server_ui	Admin: misc improvements on admin server and workers. EC now works. (#7055)	4 months ago
common.go	fixed superfluous response.WriteHeader call" warning	4 weeks ago
common_test.go	jwt check the base file id	7 years ago
filer_grpc_server.go	Add error list each entry func (#7485)	4 days ago
filer_grpc_server_admin.go	Changes logging function (#6919)	5 months ago
filer_grpc_server_dlm.go	Add Kafka Gateway (#7231)	2 months ago
filer_grpc_server_kv.go	fix(filer): add missing return after KvDelete in KvPut with empty value (#6846)	6 months ago
filer_grpc_server_remote.go	Add context with request (#6824)	6 months ago
filer_grpc_server_rename.go	conditional delete	1 year ago
filer_grpc_server_sub_meta.go	avoid repeated reading disk (#7369)	1 month ago
filer_grpc_server_traverse_meta.go	Add error list each entry func (#7485)	4 days ago
filer_grpc_server_traverse_meta_test.go	bootstrap filer from one peer	1 year ago
filer_server.go	Filer, S3: Feature/add concurrent file upload limit (#7554)	3 days ago
filer_server_handlers.go	Metrics: Add Prometheus metrics for concurrent upload tracking (#7555)	3 days ago
filer_server_handlers_copy.go	use one http client	4 months ago
filer_server_handlers_proxy.go	Changes logging function (#6919)	5 months ago
filer_server_handlers_read.go	S3: set identity to request context, and remove obsolete code (#7523)	1 week ago
filer_server_handlers_read_dir.go	Changes logging function (#6919)	5 months ago
filer_server_handlers_tagging.go	Changes logging function (#6919)	5 months ago
filer_server_handlers_write.go	Migrate from deprecated azure-storage-blob-go to modern Azure SDK (#7310)	2 months ago
filer_server_handlers_write_autochunk.go	S3: set identity to request context, and remove obsolete code (#7523)	1 week ago
filer_server_handlers_write_cipher.go	convert error fromating to %w everywhere (#6995)	5 months ago
filer_server_handlers_write_merge.go	S3 API: Add SSE-KMS (#7144)	3 months ago
filer_server_handlers_write_upload.go	S3: Directly read write volume servers (#7481)	2 weeks ago
filer_server_rocksdb.go	move to https://github.com/seaweedfs/seaweedfs	3 years ago
master_grpc_server.go	fix deadlock hang when broadcast to clients (#6184)	1 year ago
master_grpc_server_admin.go	math/rand => math/rand/v2	1 year ago
master_grpc_server_assign.go	add disable volume_growth flag (#7196)	3 months ago
master_grpc_server_cluster.go	math/rand => math/rand/v2	1 year ago
master_grpc_server_collection.go	move to https://github.com/seaweedfs/seaweedfs	3 years ago
master_grpc_server_raft.go	show raft leader via shell (#3796)	3 years ago
master_grpc_server_volume.go	Migrate from deprecated azure-storage-blob-go to modern Azure SDK (#7310)	2 months ago
master_server.go	master: Fix raft url (#7255)	2 months ago
master_server_handlers.go	add disable volume_growth flag (#7196)	3 months ago
master_server_handlers_admin.go	follow grow volume option version	5 months ago
master_server_handlers_ui.go	hide millseconds in up time (#7553)	3 days ago
raft_hashicorp.go	convert error fromating to %w everywhere (#6995)	5 months ago
raft_server.go	master:fix empty target in Build() (#6069)	1 year ago
raft_server_handlers.go	avoid logging nil error (#4659)	2 years ago
volume_grpc_admin.go	pass volume version when creating a volume	5 months ago
volume_grpc_batch_delete.go	fix has changes false if deleted result size eq zero (#4909)	2 years ago
volume_grpc_client_to_master.go	Nit: use `time.Duration`s instead of constants in seconds. (#7438)	4 weeks ago
volume_grpc_copy.go	Admin: misc improvements on admin server and workers. EC now works. (#7055)	4 months ago
volume_grpc_copy_incremental.go	move to https://github.com/seaweedfs/seaweedfs	3 years ago
volume_grpc_erasure_coding.go	Erasure Coding: Ec refactoring (#7396)	1 month ago
volume_grpc_query.go	move to https://github.com/seaweedfs/seaweedfs	3 years ago
volume_grpc_read_all.go	weed/server: remove unneeded err from streamReadOneVolume() signature (#5143)	2 years ago
volume_grpc_read_write.go	ADHOC: volume fsck using append at ns (#3906)	3 years ago
volume_grpc_remote.go	convert error fromating to %w everywhere (#6995)	5 months ago
volume_grpc_tail.go	convert error fromating to %w everywhere (#6995)	5 months ago
volume_grpc_tier_download.go	avoid load volume file with BytesOffset mismatch (#3841)	3 years ago
volume_grpc_tier_upload.go	avoid load volume file with BytesOffset mismatch (#3841)	3 years ago
volume_grpc_vacuum.go	Fix no more writable volumes by delay judgment (#4548)	3 years ago
volume_server.go	Nit: use `time.Duration`s instead of constants in seconds. (#7438)	4 weeks ago
volume_server_handlers.go	fix: pass proxied query param (#7477)	2 weeks ago
volume_server_handlers_admin.go	Admin: misc improvements on admin server and workers. EC now works. (#7055)	4 months ago
volume_server_handlers_helper.go	directory structure change to work with glide	10 years ago
volume_server_handlers_read.go	fix: pass proxied query param (#7477)	2 weeks ago
volume_server_handlers_ui.go	hide millseconds in up time (#7553)	3 days ago
volume_server_handlers_write.go	convert error fromating to %w everywhere (#6995)	5 months ago
webdav_server.go	Context cancellation during reading range reading large files (#7093)	4 months ago
wrapped_webdav_fs.go	fix: return etag with md5 in webdav responses (#5158)	2 years ago