93007c1842
[volume] refactor and add metrics for flight upload and download data limit condition ( #6920 )
* refactor concurrentDownloadLimit
* fix loop
* fix cmdServer
* fix: resolve conversation pr 6920
* Changes logging function (#6919 )
* updated logging methods for stores
* updated logging methods for stores
* updated logging methods for filer
* updated logging methods for uploader and http_util
* updated logging methods for weed server
---------
Co-authored-by: akosov <a.kosov@kryptonite.ru>
* Improve lock ring (#6921 )
* fix flaky lock ring test
* add more tests
* fix: build
* fix: rm import util/version
* fix: serverOptions
* refactoring
---------
Co-authored-by: Aleksey Kosov <rusyak777@list.ru>
Co-authored-by: akosov <a.kosov@kryptonite.ru>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
3 weeks ago
1db7c2b8aa
Add credential storage ( #6938 )
* add credential store interface
* load credential.toml
* lint
* create credentialManager with explicit store type
* add type name
* InitializeCredentialManager
* remove unused functions
* fix missing import
* fix import
* fix nil configuration
3 weeks ago
6b706f9ccd
rename files
*_server.go - main server files
*_management.go - business logic
*_data.go - data structures and types
*_middleware.go - middleware logic
3 weeks ago
f47c4aef5a
object store users
3 weeks ago
4aec3c3fb9
purge unused
3 weeks ago
76d773bf88
viewer, download, properties
3 weeks ago
d4f4c04361
remove ttl for collections
3 weeks ago
2f9321086f
add version, add alpha, add link to enterprise version
3 weeks ago
471910736d
remove ttl from collections
3 weeks ago
757c436a82
collection has multiple disk types
3 weeks ago
b2849ec435
set uid gid
3 weeks ago
ae1d0a82ce
add bucket quota
3 weeks ago
5c2b2e5513
clean up s3 bucket references
3 weeks ago
1defee3d68
Add admin component ( #6928 )
* init version
* relocate
* add s3 bucket link
* refactor handlers into weed/admin folder
* fix login logout
* adding favicon
* remove fall back to http get topology
* grpc dial option, disk total capacity
* show filer count
* fix each volume disk usage
* add filers to dashboard
* adding hosts, volumes, collections
* refactor code and menu
* remove "refresh" button
* fix data for collections
* rename cluster hosts into volume servers
* add masters, filers
* reorder
* adding file browser
* create folder and upload files
* add filer version, created at time
* remove mock data
* remove fields
* fix submenu item highlighting
* fix bucket creation
* purge files
* delete multiple
* fix bucket creation
* remove region from buckets
* add object store with buckets and users
* rendering permission
* refactor
* get bucket objects and size
* link to file browser
* add file size and count for collections page
* paginate the volumes
* fix possible SSRF
https://github.com/seaweedfs/seaweedfs/pull/6928/checks?check_run_id=45108469801
* Update weed/command/admin.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update weed/command/admin.go
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix build
* import
* remove filer CLI option
* remove filer option
* remove CLI options
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
3 weeks ago
e5adc3872a
ensure deleted entries are deleted
fix https://github.com/seaweedfs/seaweedfs/issues/6936
3 weeks ago
7ab3b19e37
remove unused import
3 weeks ago
190bc7f75f
chore(deps): bump google.golang.org/api from 0.238.0 to 0.239.0 ( #6935 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.238.0 to 0.239.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.238.0...v0.239.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-version: 0.239.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
06326ea148
chore(deps): bump gocloud.dev/pubsub/natspubsub from 0.41.0 to 0.42.0 ( #6933 )
Bumps [gocloud.dev/pubsub/natspubsub](https://github.com/google/go-cloud ) from 0.41.0 to 0.42.0.
- [Release notes](https://github.com/google/go-cloud/releases )
- [Commits](https://github.com/google/go-cloud/compare/v0.41.0...v0.42.0 )
---
updated-dependencies:
- dependency-name: gocloud.dev/pubsub/natspubsub
dependency-version: 0.42.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
1e4dab9c5c
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.81.0 to 1.82.0 ( #6934 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.81.0 to 1.82.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.81.0...service/s3/v1.82.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-version: 1.82.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
ec4ef30483
chore(deps): bump actions/setup-go from 4 to 5 ( #6931 )
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 4 to 5.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](https://github.com/actions/setup-go/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: actions/setup-go
dependency-version: '5'
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
73112191e2
chore(deps): bump github.com/rclone/rclone from 1.70.1 to 1.70.2 ( #6930 )
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.70.1 to 1.70.2.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.70.1...v1.70.2 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-version: 1.70.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
f2033e39bc
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.111.0 to 3.111.3 ( #6929 )
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk ) from 3.111.0 to 3.111.3.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases )
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.111.0...v3.111.3 )
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-version: 3.111.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3 weeks ago
060ee1b9d5
fix tests
3 weeks ago
2d0d429d2f
fix disk space calculation
3 weeks ago
3023a6f3a4
update doc
4 weeks ago
a788d9ab53
remove unnecessary code
4 weeks ago
3d519fa2a6
only leader master should send telemetry
4 weeks ago
1733d0ce68
remove features and deployments fields
4 weeks ago
166e36bcd3
use telemetry.seaweedfs.com
4 weeks ago
adc7807451
update deploying
4 weeks ago
52097a1d9b
fix binary location
4 weeks ago
4cd6c3ec36
copy telemetry server
4 weeks ago
a1aab8a083
add telemetry ( #6926 )
* add telemetry
* fix go mod
* add default telemetry server url
* Update README.md
* replace with broker count instead of s3 count
* Update telemetry.pb.go
* github action to deploy
4 weeks ago
29892c43ff
chore(deps): bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 ( #6925 )
4 weeks ago
5e79436498
reference seaweedfs.com
4 weeks ago
877b9b788a
update s3 session cache key ( #6923 )
4 weeks ago
ab49540d2b
use master.toml value if not empty
fix https://github.com/seaweedfs/seaweedfs/issues/6922
4 weeks ago
95261a712e
Improve lock ring ( #6921 )
* fix flaky lock ring test
* add more tests
4 weeks ago
4511c2cc1f
Changes logging function ( #6919 )
* updated logging methods for stores
* updated logging methods for stores
* updated logging methods for filer
* updated logging methods for uploader and http_util
* updated logging methods for weed server
---------
Co-authored-by: akosov <a.kosov@kryptonite.ru>
1 month ago
2cdd8092cc
chore(deps): bump github.com/go-sql-driver/mysql from 1.9.2 to 1.9.3 ( #6916 )
Bumps [github.com/go-sql-driver/mysql](https://github.com/go-sql-driver/mysql ) from 1.9.2 to 1.9.3.
- [Release notes](https://github.com/go-sql-driver/mysql/releases )
- [Changelog](https://github.com/go-sql-driver/mysql/blob/v1.9.3/CHANGELOG.md )
- [Commits](https://github.com/go-sql-driver/mysql/compare/v1.9.2...v1.9.3 )
---
updated-dependencies:
- dependency-name: github.com/go-sql-driver/mysql
dependency-version: 1.9.3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
e222883dd0
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.110.1 to 3.111.0 ( #6918 )
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-version: 3.111.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
3b6155f4ee
chore(deps): bump cloud.google.com/go/storage from 1.54.0 to 1.55.0 ( #6914 )
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.54.0 to 1.55.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.54.0...spanner/v1.55.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-version: 1.55.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
29fa698414
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.80.1 to 1.81.0 ( #6912 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3
Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2 ) from 1.80.1 to 1.81.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.80.1...service/s3/v1.81.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
dependency-version: 1.81.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
f68f55c7e9
chore(deps): bump github.com/rclone/rclone from 1.69.3 to 1.70.1 ( #6909 )
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.69.3 to 1.70.1.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.69.3...v1.70.1 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-version: 1.70.1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
a5bb5e04da
chore(deps): bump docker/setup-buildx-action from 3.11.0 to 3.11.1 ( #6910 )
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 3.11.0 to 3.11.1.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](18ce135bb5
1 month ago
7f1f826468
chore(deps): bump github.com/minio/crc64nvme from 1.0.1 to 1.0.2 ( #6908 )
Bumps [github.com/minio/crc64nvme](https://github.com/minio/crc64nvme ) from 1.0.1 to 1.0.2.
- [Release notes](https://github.com/minio/crc64nvme/releases )
- [Commits](https://github.com/minio/crc64nvme/compare/v1.0.1...v1.0.2 )
---
updated-dependencies:
- dependency-name: github.com/minio/crc64nvme
dependency-version: 1.0.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
47b9db0215
chore(deps): bump golang.org/x/image from 0.27.0 to 0.28.0 ( #6906 )
Bumps [golang.org/x/image](https://github.com/golang/image ) from 0.27.0 to 0.28.0.
- [Commits](https://github.com/golang/image/compare/v0.27.0...v0.28.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/image
dependency-version: 0.28.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
ba8d261591
chore(deps): bump google.golang.org/api from 0.234.0 to 0.238.0 ( #6907 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.234.0 to 0.238.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.234.0...v0.238.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-version: 0.238.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
5f1d2a9745
chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.25.1 ( #6851 )
* chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.25.1
Bumps [github.com/parquet-go/parquet-go](https://github.com/parquet-go/parquet-go ) from 0.24.0 to 0.25.1.
- [Release notes](https://github.com/parquet-go/parquet-go/releases )
- [Changelog](https://github.com/parquet-go/parquet-go/blob/main/CHANGELOG.md )
- [Commits](https://github.com/parquet-go/parquet-go/compare/v0.24.0...v0.25.1 )
---
updated-dependencies:
- dependency-name: github.com/parquet-go/parquet-go
dependency-version: 0.25.1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* adjust to updated API
Fixed Reader Construction: Updated to use parquet.OpenFile() instead of passing io.Reader directly to NewReader()
Fixed EOF Handling: Changed the order of operations to process rows before checking for EOF
Added Zero Row Count Check: Added explicit check for rowCount == 0 as an additional termination condition
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 month ago
b27ba8e984
chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.29.14 to 1.29.17 ( #6905 )
chore(deps): bump github.com/aws/aws-sdk-go-v2/config
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2 ) from 1.29.14 to 1.29.17.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases )
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json )
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.29.14...config/v1.29.17 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
dependency-version: 1.29.17
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1 month ago
Konstantin Lebedev
Chris Lu
chrislu
dependabot[bot]
chalet
Aleksey Kosov