chrislu
6e388e29c9
correcting free volume count, factor it during ec encoding to ensure enough disk space available
fix https://github.com/seaweedfs/seaweedfs/issues/6163
8 months ago
chrislu
ae5bd0667a
rename proto field from DestroyTime to expire_at_sec
For TTL volume converted into EC volume, this change may leave the volumes staying.
8 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
8 months ago
chrislu
35fd1e1c9a
optimize memory usage for large number of volumes
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
8 months ago
dsd
3b840c20e3
change math/rand => math/rand/v2 in volume_layout.go where is a perfo… ( #6006 )
9 months ago
Konstantin Lebedev
34bbaa2cdd
[master] process grow request with must grow ( #5999 )
process grow request with must grow
9 months ago
chrislu
ff3d46637d
better logging for volume growth
9 months ago
chrislu
accba3070a
refactor
9 months ago
Konstantin Lebedev
67a252ee8a
[master] refactor func ShouldGrowVolumes ( #5884 )
9 months ago
chrislu
3c0854e986
unnecessary skipping
10 months ago
chrislu
654b8210f7
parameter name
10 months ago
chrislu
8679870008
fix typo
10 months ago
chrislu
a4b25a642d
math/rand => math/rand/v2
10 months ago
chrislu
ded5e084ea
ensure none zero lastGrowCount
10 months ago
chrislu
4463296811
add parallel vacuuming
10 months ago
chrislu
b3696024d1
add warning for not enough copies when skipping vacuuming volumes
fix https://github.com/seaweedfs/seaweedfs/issues/5906
10 months ago
Riccardo Bertossa
6fe8639504
add http endpoint to get the size of a collection ( #5910 )
10 months ago
augustazz
0b00706454
EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )
* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
10 months ago
wusong
6f58ab7e8b
[master] fix master panic ( #5893 )
10 months ago
Konstantin Lebedev
b2ffcdaab2
[master] do sync grow request only if absolutely necessary ( #5821 )
* do sync grow request only if absolutely necessary
https://github.com/seaweedfs/seaweedfs/pull/5819
* remove check VolumeGrowStrategy Threshold on PickForWrite
* fix fmt.Errorf
11 months ago
wyang
4b1f539ab8
fix allocate reduplicated volumeId to different volume ( #5811 )
* fix allocate reduplicated volumeId to different volume
* only check barrier when read
---------
Co-authored-by: Yang Wang <yangwang@weride.ai>
11 months ago
chrislu
9265be43c0
avoid nil
11 months ago
vadimartynov
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
11 months ago
Konstantin Lebedev
67edf1d014
[master] Do Automatic Volume Grow in background ( #5781 )
* Do Automatic Volume Grow in backgound
* pass lastGrowCount to master
* fix build
* fix count to uint64
11 months ago
Konstantin Lebedev
a53e406c99
[master] refactor HasGrowRequest to atomic bool ( #5782 )
refactor HasGrowRequest to atomit bool
11 months ago
Konstantin Lebedev
33964fa292
metrics stats of volume layout depends on the data center ( #5775 )
stats volume layout depends on the data center
11 months ago
Konstantin Lebedev
04f4b10884
fix: avoid timeout if datacenter does not exist in topology ( #5772 )
* fix: avoid timeout if datacenter does not exist in topology
* fix: error msg
* fix: rm dublicate check
* fix: compare
* revert minor change
11 months ago
小羽
e8537d7172
Different disk labels should not use the same DiskUsages instance while master received volume heatbeat ( #5770 )
11 months ago
Numblgw
73baf82f05
bugfix: unregister ec shards when volume server disconnected ( #5697 )
bugfix unregister ec shards when volume server disconnected
Co-authored-by: liguowei <liguowei@xinye.com>
12 months ago
chrislu
3e7a92061b
pass along volume server grpc port
fix https://github.com/seaweedfs/seaweedfs/issues/5617
1 year ago
chrislu
d218fe54fa
go fmt
1 year ago
chrislu
55976ae04a
avoid repeated calls to heavy-weighted viper
1 year ago
chrislu
31f1f96038
improve perf a bit
1 year ago
Konstantin Lebedev
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk ( #5458 )
1 year ago
Konstantin Lebedev
d5d8b8e2ae
fix panic at isAllWritable ( #5457 )
fix panic
https://github.com/seaweedfs/seaweedfs/issues/5456
1 year ago
Konstantin Lebedev
9c1e0f5811
[master] grow volumes if no writable volumes in current dataCenter ( #5434 )
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886
* fix tests with volume grow
* automatic volume grow one volume
* add ErrorChunkAssign metrics
1 year ago
Konstantin Lebedev
df40908e57
fix panic 5435 ( #5436 )
1 year ago
Konstantin Lebedev
dc9568fc0d
[master] add test for PickForWrite add metrics for volume layout ( #5413 )
1 year ago
Konstantin Lebedev
0f8e76bbd6
fix: clean metric MasterReplicaPlacementMismatch for unregister volume ( #5239 )
1 year ago
chrislu
025f8eb37b
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
1 year ago
chrislu
d4e66cc140
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
1 year ago
chrislu
49fcb48e04
same logic as grpc assign
fix https://github.com/seaweedfs/seaweedfs/issues/5213
1 year ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
1 year ago
chrislu
bebbc9fe44
create volume grow request if the selected volume is close to full
1 year ago
chrislu
c6b1dc7058
remove unused code
1 year ago
chrislu
b62066d38f
adding DiskType to /dir/status output
2 years ago
chrislu
645ae8c57b
Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs ""
This reverts commit 8cb42c39
2 years ago
chrislu
8cb42c39ad
Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs "
This reverts commit 2e5aa06026
, reversing
changes made to 4d414f54a2
.
2 years ago
dependabot[bot]
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
2 years ago
Konstantin Lebedev
5ee04d20fa
Healthz check for deadlocks ( #4558 )
2 years ago