chrislu
bc888226fc
erasure coding: tracking encoded/decoded volumes
If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here.
3 years ago
chrislu
ae558fa073
log reasons volumes became unwritable
3 years ago
chrislu
57c6eddd22
avoid possible deadlock if volume layout is used in some logs
3 years ago
Konstantin Lebedev
9ea09cc41c
healthz check to avoid drain pod with last replicas
3 years ago
Konstantin Lebedev
0ed76a0556
clearly
3 years ago
Konstantin Lebedev
36013f63ed
https://github.com/chrislusf/seaweedfs/issues/2648
3 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
3 years ago
Konstantin Lebedev
3f4e17aa24
error metrics for filer and store
3 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
banjiaojuhao
dda6b90d25
assign fileId according to DataNode with empty DataCenter and Rack
3 years ago
chrislu
5eacff9d4f
log message adds server name
address https://github.com/chrislusf/seaweedfs/issues/2514#issuecomment-995925733
3 years ago
Chris Lu
3be3c17f59
volume vacuum: avoid timeout with streaming progress report
fix https://github.com/chrislusf/seaweedfs/issues/2396
3 years ago
Chris Lu
e4830bd93d
go fmt
3 years ago
Chris Lu
332d49432d
reduce concurrent volume grow requests
3 years ago
Chris Lu
96119eab00
refactor
3 years ago
Chris Lu
8a66306064
calculate disk usage in case of race condition
related to https://github.com/chrislusf/seaweedfs/issues/2357
3 years ago
Chris Lu
a067deaabc
avoid possible modified location list
fix issue 1 of https://github.com/chrislusf/seaweedfs/issues/2345
3 years ago
Chris Lu
2789d10342
go fmt
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
574485ec69
better IP v6 support
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
e93d4935e3
add other replica locations when assigning volumes
3 years ago
Chris Lu
7a13816e94
refactor
3 years ago
Chris Lu
65af3cf4df
master: disconnect only the phantom volume server
fix https://github.com/chrislusf/seaweedfs/issues/2311
3 years ago
Chris Lu
78e8ddf910
Only when tailing volume, the zero-ed cookie should skip checking.
This only happens when checkCookie == false and fsync == false.
3 years ago
Chris Lu
d1d1fc772c
move some volume lookup operations to grpc
jwt related lookup will come in next commit
3 years ago
Chris Lu
01336d71eb
minor
3 years ago
Chris Lu
4370a4db63
use int64 for volume count in case of negative overflow
3 years ago
Chris Lu
cb1dbd3135
refactor
3 years ago
Chris Lu
b624090398
go fmt
4 years ago
Chris Lu
d474ce6fe3
master: avoid repeated leader redirection
fix https://github.com/chrislusf/seaweedfs/issues/2146
4 years ago
Chris Lu
87a32bfef4
avoid possible nil when node is disconnected from its parent
fix https://github.com/chrislusf/seaweedfs/issues/2073
4 years ago
Chris Lu
d2d36a3f9d
master: avoid creating too many volumes
fix https://github.com/chrislusf/seaweedfs/issues/2062
4 years ago
Chris Lu
9a6aa00e9d
avoid nil locations
fix https://github.com/chrislusf/seaweedfs/issues/2059
4 years ago
qieqieplus
c4d32f6937
ahead of time volume assignment
4 years ago
Patrick Schmidt
7413d59750
Fix EC shard count logic
This fixes the calculation of the amount of EC shards a node holds.
Previously a global counter was increased, but also used inside the
loop to apply disk usage deltas. This led to wrong absolute numbers.
The fix is to apply only deltas of single EC shards per iteration.
4 years ago
Patrick Schmidt
5f7b024891
Show the real disk usage in stats calls
Currently the file size of only one volume location is taken into
account in the stats. This commit multiplies the disk usages by the
amount of nodes holding a replica of the volume.
This will yield the expected amount of disk usage and matches the
total size calculations from before.
4 years ago
Chris Lu
2270737344
volume: avoid fixed vacuum timeout for large volumes
1GB for 3 minutes, about 5.7MB/s
4 years ago
Chris Lu
565f7a6e72
Update data_node.go
4 years ago
Chris Lu
a37473ae60
add back volume ids
address https://github.com/chrislusf/seaweedfs/issues/1792#issuecomment-782339576
4 years ago
Chris Lu
c576ad04ac
fix volume server display for volumes
4 years ago
Chris Lu
73958e357d
add descriptive error if no free volumes
4 years ago
Chris Lu
3575d41009
go fmt
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
68775d29e3
fix tests
4 years ago
Chris Lu
b314d78e97
fix print
4 years ago
Chris Lu
53ca7e66ef
avoid dead lock
4 years ago
Chris Lu
3097b9a9b7
fix existence checking
4 years ago
Chris Lu
cb9cc29518
volume.list display; fix updating maxVolumeCount for disk
4 years ago
Chris Lu
3fe628f04e
use hdd instead of empty string
4 years ago