chrislu
bece20d608
volume: add -id flag for stable volume server identity
Add -id command line flag to volume server that allows specifying a stable
identifier independent of the IP address. This is useful for Kubernetes
deployments with hostPath volumes where pods can be rescheduled to different
nodes while the persisted data remains on the original node.
Usage: weed volume -id=node-1 -ip=10.0.0.1 ...
If -id is not specified, it defaults to ip:port for backward compatibility.
Fixes https://github.com/seaweedfs/seaweedfs/issues/7487
3 days ago
Lisandro Pin
f466ff1412
Nit: use `time.Duration`s instead of constants in seconds. ( #7438 )
Nit: use `time.Durations` instead of constants in seconds. Makes for slightly more readable code.
1 month ago
Konstantin Lebedev
d019848018
fix: pass inflightDownloadDataTimeout to volumeServer ( #7206 )
3 months ago
Konstantin Lebedev
93007c1842
[volume] refactor and add metrics for flight upload and download data limit condition ( #6920 )
* refactor concurrentDownloadLimit
* fix loop
* fix cmdServer
* fix: resolve conversation pr 6920
* Changes logging function (#6919 )
* updated logging methods for stores
* updated logging methods for stores
* updated logging methods for filer
* updated logging methods for uploader and http_util
* updated logging methods for weed server
---------
Co-authored-by: akosov <a.kosov@kryptonite.ru>
* Improve lock ring (#6921 )
* fix flaky lock ring test
* add more tests
* fix: build
* fix: rm import util/version
* fix: serverOptions
* refactoring
---------
Co-authored-by: Aleksey Kosov <rusyak777@list.ru>
Co-authored-by: akosov <a.kosov@kryptonite.ru>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
5 months ago
Aleksey Kosov
5182d46e22
Added middleware for processing request_id grpc and http requests ( #6805 )
7 months ago
Konstantin Lebedev
b65eb2ec45
[security] reload whiteList on http seerver ( #6302 )
* reload whiteList
* white_list add to scaffold
1 year ago
Guo Lei
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 years ago
Konstantin Lebedev
301b678147
[volume] Add new volumes to HUP(reload) signal ( #3755 )
Add new volumes to HUP(reload) signal
3 years ago
chrislu
10d5b4b32b
volume server: rename readBufferSize to readBufferSizeMB
3 years ago
famosss
d949a238b8
volume: add "readBufSize" option to customize read optimization ( #3702 )
* simplify a bit
* feat: volume: add "readBufSize" option to customize read optimization
* refactor : redbufSIze -> readBufferSize
* simplify a bit
* simplify a bit
3 years ago
chrislu
896a85d6e4
volume: add "hasSlowRead" option to customize read optimization
3 years ago
chrislu
3f3a1341d8
make CodeQL happy
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
liubaojiang
076e48a676
add inflight upload data wait timeout
4 years ago
liubaojiang
1a41691b4c
exclude replication from the concurrentUploadLimitMB
4 years ago
guol-fnst
076595fbdd
just exit in case of duplicated volume directories were loaded
4 years ago
guol-fnst
de6aa9cce8
avoid duplicated volume directory
4 years ago
chrislu
9b04f17555
remove dead code
4 years ago
chrislu
0562fceb99
volume: fail fast if too many concurrent requests, to avoid dead lock due to replication.
fix https://github.com/chrislusf/seaweedfs/issues/2755
4 years ago
Konstantin Lebedev
9ea09cc41c
healthz check to avoid drain pod with last replicas
4 years ago
chrislu
b70cb3e0b2
upgrade protoc to 3.17.3
$brew install protobuf
$ protoc --version
libprotoc 3.17.3
$ go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.26
$ go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@v1.1
4 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
4 years ago
Chris Lu
0128239c0f
handle ipv6 addresses
4 years ago
Chris Lu
734c980040
volume: support concurrent download data size limit
4 years ago
Chris Lu
96ce85f5ae
rename
4 years ago
Chris Lu
49c66e88a0
volume: change all writes to fsync during graceful stopping
fix https://github.com/chrislusf/seaweedfs/issues/2193
4 years ago
Chris Lu
8fe75692ee
volume: address "unaligned 64-bit atomic operation"
fix https://github.com/chrislusf/seaweedfs/issues/2177
4 years ago
Chris Lu
b624090398
go fmt
4 years ago
zhangsong
7566782c2e
add proxy mode to read non-local volumes
4 years ago
bingoohuang
cf552417a7
minFreeSpace refactored
5 years ago
bingoohuang
31f1cdeac2
minFreeSpace argument allows size like 10GiB
5 years ago
Chris Lu
ac875976c0
filer, volume: add concurrent upload size limit to avoid OOM
add some back pressure when writes are slow
5 years ago
Chris Lu
f8446b42ab
this can compile now!!!
5 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
5 years ago
Chris Lu
f6a419c26c
disk type configurable for each folder
5 years ago
Chris Lu
7c52a35942
refactor
5 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
5 years ago
Chris Lu
d156c74ec0
volume server set volume type and heartbeat to the master
5 years ago
Chris Lu
b11449f955
pass in dir.idx parameter to DiskLocation
5 years ago
Chris Lu
4856bce0ee
adjust for metrics port
5 years ago
Konstantin Lebedev
324e44d4b3
add start metrics server
5 years ago
Chris Lu
d013d09a9b
adjust logging
5 years ago
Chris Lu
2c21eb1971
volume: get metrics configuration from master
fix https://github.com/chrislusf/seaweedfs/issues/1354
5 years ago
Chris Lu
e861a6a3ab
simplify metrics configuration logic
5 years ago
Chris Lu
913a16268d
volume: load configuration from master at the start
fix https://github.com/chrislusf/seaweedfs/issues/1469
5 years ago
Chris Lu
5d6753fb98
shell: add volumeServer.leave command
5 years ago
Konstantin Lebedev
464d4c82ec
stop send heartbeat before stop volume server
5 years ago
Chris Lu
1901f15cd2
volume server: remove whitelist for status checking
Volume liveness/readiness not work if jwt enabled, I try use param
-whiteList
but jwt breaks
5 years ago
李远军
6608cb5f43
Revert "remove fixJpgOrientation"
This reverts commit de5ca9b2
5 years ago
Chris Lu
4d1484628a
refactoring
6 years ago