chrislu
31922b2bf2
s3 to watch specific directories
2 years ago
chrislu
b90d92fca9
grpc: watch metadata changes by directory
2 years ago
chrislu
21c0587900
go fmt
2 years ago
chrislu
c8645fd232
master: implement grpc VolumeMarkWritable
fix https://github.com/seaweedfs/seaweedfs/issues/3657
2 years ago
Ryan Russell
12914af4d8
Character readability ( #3678 )
* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
a8d7615eec
refactor(filer_client): `EachEntryFunciton` -> `EachEntryFunction` ( #3671 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Konstantin Lebedev
721c6197f9
skip deltaBeat if dn is zero ( #3630 )
* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix
2 years ago
chrislu
b9112747b5
volume server: synchronously report volume readonly status to master
fix https://github.com/seaweedfs/seaweedfs/issues/3628
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
qzh
74b53729e1
feat(weed.move): add a speed limit parameter of moving files ( #3478 )
* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
chrislu
4573c99ae3
fix tests
2 years ago
chrislu
2b580a7566
also migrate jsonpb
2 years ago
chrislu
eaeb141b09
move proto package
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
Konstantin Lebedev
fc65122766
rename to LoadAvg_1M
2 years ago
Konstantin Lebedev
5209ebbeef
remove percent
2 years ago
Konstantin Lebedev
634bc97840
fix conflicts
2 years ago
chrislu
afef014832
scaffold
2 years ago
chrislu
13b9a52f80
fix deprecated functions
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
Konstantin Lebedev
2f0dda384d
vacuum show LA
2 years ago
chrislu
de3afd4199
fix rebasing
2 years ago
chrislu
06cd491abc
add message batch
2 years ago
chrislu
7576c244c4
add flatbuffer serde for message
2 years ago
chrislu
aa4a22ad47
segment serde
2 years ago
chrislu
9f479aab98
allocate brokers to serve segments
2 years ago
chrislu
94b8c42b2c
clean up
2 years ago
chrislu
8060fdcac5
remove old code
2 years ago
chrislu
f25e273e32
display data center and rack in cluster.ps
3 years ago
chrislu
68065128b8
add dc and rack
3 years ago
chrislu
21b6b07dd8
renaming
3 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
chrislu
f72f696109
add message batch
2 years ago
chrislu
7f672b37e1
add flatbuffer serde for message
2 years ago
chrislu
113a4546fd
segment serde
2 years ago
chrislu
1112dab4f3
allocate brokers to serve segments
2 years ago
chrislu
ef93869009
clean up
2 years ago
chrislu
7db6666b97
remove old code
2 years ago
chrislu
3254f18343
display data center and rack in cluster.ps
3 years ago
chrislu
9f20d3ebd1
add dc and rack
3 years ago
chrislu
5536ed85e5
renaming
3 years ago
chrislu
449ecc8890
remove max connection age
related to https://github.com/chrislusf/seaweedfs/pull/3226
3 years ago
chrislu
530da0cc89
remove unused code
3 years ago
chrislu
41dfe27102
Revert "remove max connection age"
This reverts commit b9b684194f
.
3 years ago
chrislu
1d0c53ea56
remote storage: stop supporting hdfs as a remote storage
3 years ago
石昌林
3dd60529c5
some code optimizations
3 years ago
石昌林
78b3728169
add s3 circuit breaker support for 'simultaneous request count' and 'simultaneous request bytes' limitations
configure s3 circuit breaker by 'command_s3_circuitbreaker.go':
usage eg:
# Configure the number of simultaneous global (current s3api node) requests
s3.circuit.breaker -global -type count -actions Write -values 1000 -apply
# Configure the number of simultaneous requests for bucket x read and write
s3.circuit.breaker -buckets -type count -actions Read,Write -values 1000 -apply
# Configure the total bytes of simultaneous requests for bucket write
s3.circuit.breaker -buckets -type bytes -actions Write -values 100MiB -apply
# Disable circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -enable false -apply
# Delete circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -delete -apply
3 years ago
chrislu
d12f431d98
collect volume server status
3 years ago
Konstantin Lebedev
c07820178f
fix s3 tests
bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter
3 years ago