chrislu
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
2 days ago
dsd
72af97162f
[shell] feat:stop vacuum immediately once volume.vacuum.disable was executed ( #6375 )
stop vacuum immediately once volume.vacuum.disable was executed
Co-authored-by: dsd <dsd2019@foxmail.com>
4 days ago
Konstantin Lebedev
e2e97db917
[master] avoid timeout when assigning for main request with filter by DC or rack ( #6291 )
* avoid timeout when assigning for main request with filter by DC or rack
https://github.com/seaweedfs/seaweedfs/issues/6290
* use constant NoWritableVolumes
4 weeks ago
Konstantin Lebedev
8836fa19b6
use ShouldGrowVolumesByDcAndRack ( #6280 )
4 weeks ago
chrislu
ccf1795e6f
wait a bit before getting the next volume id if the leader is recently elected
4 weeks ago
Konstantin Lebedev
a49d9e020c
[master] avoid crowded more writable for auto grow ( #6214 )
avoid crowded more writable
https://github.com/seaweedfs/seaweedfs/issues/6121
1 month ago
chrislu
6e388e29c9
correcting free volume count, factor it during ec encoding to ensure enough disk space available
fix https://github.com/seaweedfs/seaweedfs/issues/6163
2 months ago
chrislu
ae5bd0667a
rename proto field from DestroyTime to expire_at_sec
For TTL volume converted into EC volume, this change may leave the volumes staying.
2 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
2 months ago
chrislu
35fd1e1c9a
optimize memory usage for large number of volumes
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
2 months ago
dsd
3b840c20e3
change math/rand => math/rand/v2 in volume_layout.go where is a perfo… ( #6006 )
3 months ago
Konstantin Lebedev
34bbaa2cdd
[master] process grow request with must grow ( #5999 )
process grow request with must grow
3 months ago
chrislu
ff3d46637d
better logging for volume growth
4 months ago
chrislu
accba3070a
refactor
4 months ago
Konstantin Lebedev
67a252ee8a
[master] refactor func ShouldGrowVolumes ( #5884 )
4 months ago
chrislu
3c0854e986
unnecessary skipping
4 months ago
chrislu
654b8210f7
parameter name
4 months ago
chrislu
8679870008
fix typo
4 months ago
chrislu
a4b25a642d
math/rand => math/rand/v2
4 months ago
chrislu
ded5e084ea
ensure none zero lastGrowCount
4 months ago
chrislu
4463296811
add parallel vacuuming
4 months ago
chrislu
b3696024d1
add warning for not enough copies when skipping vacuuming volumes
fix https://github.com/seaweedfs/seaweedfs/issues/5906
4 months ago
Riccardo Bertossa
6fe8639504
add http endpoint to get the size of a collection ( #5910 )
4 months ago
augustazz
0b00706454
EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )
* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
4 months ago
wusong
6f58ab7e8b
[master] fix master panic ( #5893 )
4 months ago
Konstantin Lebedev
b2ffcdaab2
[master] do sync grow request only if absolutely necessary ( #5821 )
* do sync grow request only if absolutely necessary
https://github.com/seaweedfs/seaweedfs/pull/5819
* remove check VolumeGrowStrategy Threshold on PickForWrite
* fix fmt.Errorf
5 months ago
wyang
4b1f539ab8
fix allocate reduplicated volumeId to different volume ( #5811 )
* fix allocate reduplicated volumeId to different volume
* only check barrier when read
---------
Co-authored-by: Yang Wang <yangwang@weride.ai>
5 months ago
chrislu
9265be43c0
avoid nil
5 months ago
vadimartynov
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
5 months ago
Konstantin Lebedev
67edf1d014
[master] Do Automatic Volume Grow in background ( #5781 )
* Do Automatic Volume Grow in backgound
* pass lastGrowCount to master
* fix build
* fix count to uint64
5 months ago
Konstantin Lebedev
a53e406c99
[master] refactor HasGrowRequest to atomic bool ( #5782 )
refactor HasGrowRequest to atomit bool
5 months ago
Konstantin Lebedev
33964fa292
metrics stats of volume layout depends on the data center ( #5775 )
stats volume layout depends on the data center
5 months ago
Konstantin Lebedev
04f4b10884
fix: avoid timeout if datacenter does not exist in topology ( #5772 )
* fix: avoid timeout if datacenter does not exist in topology
* fix: error msg
* fix: rm dublicate check
* fix: compare
* revert minor change
5 months ago
小羽
e8537d7172
Different disk labels should not use the same DiskUsages instance while master received volume heatbeat ( #5770 )
5 months ago
Numblgw
73baf82f05
bugfix: unregister ec shards when volume server disconnected ( #5697 )
bugfix unregister ec shards when volume server disconnected
Co-authored-by: liguowei <liguowei@xinye.com>
6 months ago
chrislu
3e7a92061b
pass along volume server grpc port
fix https://github.com/seaweedfs/seaweedfs/issues/5617
7 months ago
chrislu
d218fe54fa
go fmt
7 months ago
chrislu
55976ae04a
avoid repeated calls to heavy-weighted viper
8 months ago
chrislu
31f1f96038
improve perf a bit
8 months ago
Konstantin Lebedev
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk ( #5458 )
9 months ago
Konstantin Lebedev
d5d8b8e2ae
fix panic at isAllWritable ( #5457 )
fix panic
https://github.com/seaweedfs/seaweedfs/issues/5456
9 months ago
Konstantin Lebedev
9c1e0f5811
[master] grow volumes if no writable volumes in current dataCenter ( #5434 )
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886
* fix tests with volume grow
* automatic volume grow one volume
* add ErrorChunkAssign metrics
9 months ago
Konstantin Lebedev
df40908e57
fix panic 5435 ( #5436 )
9 months ago
Konstantin Lebedev
dc9568fc0d
[master] add test for PickForWrite add metrics for volume layout ( #5413 )
9 months ago
Konstantin Lebedev
0f8e76bbd6
fix: clean metric MasterReplicaPlacementMismatch for unregister volume ( #5239 )
11 months ago
chrislu
025f8eb37b
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
11 months ago
chrislu
d4e66cc140
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
11 months ago
chrislu
49fcb48e04
same logic as grpc assign
fix https://github.com/seaweedfs/seaweedfs/issues/5213
11 months ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
12 months ago
chrislu
bebbc9fe44
create volume grow request if the selected volume is close to full
1 year ago