b2ffcdaab2
[master] do sync grow request only if absolutely necessary ( #5821 )
* do sync grow request only if absolutely necessary
https://github.com/seaweedfs/seaweedfs/pull/5819
* remove check VolumeGrowStrategy Threshold on PickForWrite
* fix fmt.Errorf
5 months ago
4b1f539ab8
fix allocate reduplicated volumeId to different volume ( #5811 )
* fix allocate reduplicated volumeId to different volume
* only check barrier when read
---------
Co-authored-by: Yang Wang <yangwang@weride.ai>
5 months ago
9265be43c0
avoid nil
5 months ago
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
5 months ago
67edf1d014
[master] Do Automatic Volume Grow in background ( #5781 )
* Do Automatic Volume Grow in backgound
* pass lastGrowCount to master
* fix build
* fix count to uint64
5 months ago
a53e406c99
[master] refactor HasGrowRequest to atomic bool ( #5782 )
refactor HasGrowRequest to atomit bool
5 months ago
33964fa292
metrics stats of volume layout depends on the data center ( #5775 )
stats volume layout depends on the data center
5 months ago
04f4b10884
fix: avoid timeout if datacenter does not exist in topology ( #5772 )
* fix: avoid timeout if datacenter does not exist in topology
* fix: error msg
* fix: rm dublicate check
* fix: compare
* revert minor change
5 months ago
e8537d7172
Different disk labels should not use the same DiskUsages instance while master received volume heatbeat ( #5770 )
5 months ago
73baf82f05
bugfix: unregister ec shards when volume server disconnected ( #5697 )
bugfix unregister ec shards when volume server disconnected
Co-authored-by: liguowei <liguowei@xinye.com>
6 months ago
3e7a92061b
pass along volume server grpc port
fix https://github.com/seaweedfs/seaweedfs/issues/5617
7 months ago
d218fe54fa
go fmt
7 months ago
55976ae04a
avoid repeated calls to heavy-weighted viper
8 months ago
31f1f96038
improve perf a bit
8 months ago
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk ( #5458 )
9 months ago
d5d8b8e2ae
fix panic at isAllWritable ( #5457 )
fix panic
https://github.com/seaweedfs/seaweedfs/issues/5456
9 months ago
9c1e0f5811
[master] grow volumes if no writable volumes in current dataCenter ( #5434 )
* grow volumes if no writable volumes in current dataCenter
https://github.com/seaweedfs/seaweedfs/issues/3886
* fix tests with volume grow
* automatic volume grow one volume
* add ErrorChunkAssign metrics
9 months ago
df40908e57
fix panic 5435 ( #5436 )
9 months ago
dc9568fc0d
[master] add test for PickForWrite add metrics for volume layout ( #5413 )
9 months ago
0f8e76bbd6
fix: clean metric MasterReplicaPlacementMismatch for unregister volume ( #5239 )
11 months ago
025f8eb37b
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
11 months ago
d4e66cc140
return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
11 months ago
49fcb48e04
same logic as grpc assign
fix https://github.com/seaweedfs/seaweedfs/issues/5213
11 months ago
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
12 months ago
bebbc9fe44
create volume grow request if the selected volume is close to full
1 year ago
c6b1dc7058
remove unused code
1 year ago
b62066d38f
adding DiskType to /dir/status output
1 year ago
645ae8c57b
Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs ""
This reverts commit 8cb42c39
1 year ago
8cb42c39ad
Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs "
This reverts commit 2e5aa060264d414f54a2
1 year ago
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 year ago
5ee04d20fa
Healthz check for deadlocks ( #4558 )
2 years ago
5caff2c0f0
fix: deletes newly created volumes ( #4551 )
https://github.com/seaweedfs/seaweedfs/issues/4531
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
9bdbf9c880
revert #4491 ( #4550 )
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
26f15d0079
Fix no more writable volumes by delay judgment ( #4548 )
* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
ca7cc61319
reduce the window size between unregistering a volume server and creating volumes on that server
fix https://github.com/seaweedfs/seaweedfs/issues/4467
2 years ago
8fffe3e822
fix no more writables volumes while disk free space is sufficient ( #4491 )
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
2e240704ab
Writables inconsistency ( #4417 )
fix: inconsistent read and write permissions between master and volume server
Signed-off-by: Wusong Wang <wangwusong@virtaitech.com>
Co-authored-by: Wusong Wang <wangwusong@virtaitech.com>
2 years ago
784daea1fa
fix volume not found if marked as read only
fix https://github.com/seaweedfs/seaweedfs/issues/4088
2 years ago
264be0d2d4
Retry until a leader is selected. ( #4318 )
Fixes regression introduced in
https://github.com/seaweedfs/seaweedfs/pull/4313
Related to #4307
2 years ago
57ab1f8516
Use exponential backoff to query leader. ( #4313 )
`topology.Leader()` was using a backoff that typically
resulted in at least a 5s delay when initially starting
a master and raft server. This changes the backoff
algorithm to use exponential backoff starting with 100ms
and waiting up to 20s for leader selection.
Related to #4307
2 years ago
bd70683871
fix(weed/topology/node.go): typo in error message ( #4292 )
2 years ago
0bf56298d5
fix chunk.ModifiedTsNs ( #4264 )
* fix
* fix mtime s > ns
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2 years ago
d8cfa1552b
support enable/disable vacuum ( #4087 )
* stop vacuum
* suspend/resume vacuum
* remove unused code
* rename
* rename param
2 years ago
409c9328de
[master] avoid vacuum if not enough replica copies ( #3924 )
avoid vacuum if not enough replica copies
2 years ago
1e0d64c048
master: delete partially created replicated volumes during volume growth
fix https://github.com/seaweedfs/seaweedfs/discussions/3792#discussioncomment-3973120
2 years ago
25471d579a
add md5 header when UploadData to replication in ReplicatedWrite ( #3881 )
2 years ago
a635973847
docs(topology): readability improvements ( #3688 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
f8ef25099c
Removing chunks on failed to write to replicas ( #3591 )
* Removing chunks on failed to write to replicas
https://github.com/seaweedfs/seaweedfs/issues/3578
* put with in the util.Retry
* just purge on any errors
2 years ago
721c6197f9
skip deltaBeat if dn is zero ( #3630 )
* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix
2 years ago
6690236754
rename variables
2 years ago
Konstantin Lebedev
wyang
chrislu
vadimartynov
小羽
Numblgw
dependabot[bot]
wusong
Stewart Miles
Thomas Anderson
zemul
Guo Lei
liubaojiang
Ryan Russell