Browse Source
fix: add missing backslash for volume extraArgs in helm chart (#7676 )
Fixes #7467
The -mserver argument line in volume-statefulset.yaml was missing a
trailing backslash, which prevented extraArgs from being passed to
the weed volume process.
Also:
- Extracted master server list generation logic into shared helper
templates in _helpers.tpl for better maintainability
- Updated all occurrences of deprecated -mserver flag to -master
across docker-compose files, test files, and documentation
pull/7685/head
Chris Lu
2 days ago
committed by
GitHub
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
44 changed files with
83 additions and
58 deletions
README.md
docker/admin_integration/docker-compose-ec-test.yml
docker/compose/e2e-mount.yml
docker/compose/local-brokers-compose.yml
docker/compose/local-cluster-compose.yml
docker/compose/local-dev-compose.yml
docker/compose/local-hashicorp-raft-compose.yml
docker/compose/local-k8s-compose.yml
docker/compose/local-minio-gateway-compose.yml
docker/compose/local-mount-compose.yml
docker/compose/local-mount-profile-compose.yml
docker/compose/local-nextcloud-compose.yml
docker/compose/local-registry-compose.yml
docker/compose/local-replicate-compose.yml
docker/compose/local-s3tests-compose.yml
docker/compose/swarm-etcd.yml
docker/compose/test-etcd-filer.yml
docker/seaweedfs-compose.yml
docker/seaweedfs-dev-compose.yml
k8s/charts/seaweedfs/templates/filer/filer-statefulset.yaml
k8s/charts/seaweedfs/templates/master/master-statefulset.yaml
k8s/charts/seaweedfs/templates/shared/_helpers.tpl
k8s/charts/seaweedfs/templates/volume/volume-statefulset.yaml
other/java/hdfs3/README.md
seaweedfs-rdma-sidecar/docker-compose.mount-rdma.yml
seaweedfs-rdma-sidecar/docker-compose.rdma-sim.yml
seaweedfs-rdma-sidecar/docker-compose.yml
seaweedfs-rdma-sidecar/scripts/demo-mount-rdma.sh
test/erasure_coding/ec_integration_test.go
test/fuse_integration/framework.go
test/java/spark/docker-compose.yml
test/kafka/docker-compose.yml
test/kafka/kafka-client-loadtest/docker-compose.yml
test/kms/docker-compose.yml
test/mq/README.md
test/s3/copying/Makefile
test/s3/iam/Makefile
test/s3/iam/docker-compose.test.yml
test/s3/iam/docker-compose.yml
test/s3/parquet/Makefile
test/s3/sse/Makefile
test/s3/sse/docker-compose.yml
test/sftp/framework.go
weed/storage/volume_vacuum_test.go
@ -87,7 +87,7 @@ Table of Contents
* `export AWS_ACCESS_KEY_ID=admin ; export AWS_SECRET_ACCESS_KEY=key` as the admin credentials to access the object store.
* Run `weed server -dir=/some/data/dir -s3` to start one master, one volume server, one filer, and one S3 gateway.
Also, to increase capacity, just add more volume servers by running `weed volume -dir="/some/data/dir2" -mserv er="<master_host>:9333" -port=8081` locally, or on a different machine, or on thousands of machines. That is it!
Also, to increase capacity, just add more volume servers by running `weed volume -dir="/some/data/dir2" -mast er="<master_host>:9333" -port=8081` locally, or on a different machine, or on thousands of machines. That is it!
## Quick Start SeaweedFS S3 on AWS ##
* Setup fast production-ready [SeaweedFS S3 on AWS with cloudformation ](https://aws.amazon.com/marketplace/pp/prodview-nzelz5gprlrjc )
@ -206,8 +206,8 @@ SeaweedFS uses HTTP REST operations to read, write, and delete. The responses ar
### Start Volume Servers ###
```
> weed volume -dir="/tmp/data1" -max=5 -mserv er="localhost:9333" -port=8080 &
> weed volume -dir="/tmp/data2" -max=10 -mserv er="localhost:9333" -port=8081 &
> weed volume -dir="/tmp/data1" -max=5 -mast er="localhost:9333" -port=8080 &
> weed volume -dir="/tmp/data2" -max=10 -mast er="localhost:9333" -port=8081 &
```
### Write File ###
@ -25,7 +25,7 @@ services:
ports:
- "8080:8080"
- "18080:18080"
command : "volume -mserv er=master:9333 -ip=volume1 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume1 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -38,7 +38,7 @@ services:
ports:
- "8081:8080"
- "18081:18080"
command : "volume -mserv er=master:9333 -ip=volume2 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume2 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -51,7 +51,7 @@ services:
ports:
- "8082:8080"
- "18082:18080"
command : "volume -mserv er=master:9333 -ip=volume3 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume3 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -64,7 +64,7 @@ services:
ports:
- "8083:8080"
- "18083:18080"
command : "volume -mserv er=master:9333 -ip=volume4 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume4 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -77,7 +77,7 @@ services:
ports:
- "8084:8080"
- "18084:18080"
command : "volume -mserv er=master:9333 -ip=volume5 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume5 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -90,7 +90,7 @@ services:
ports:
- "8085:8080"
- "18085:18080"
command : "volume -mserv er=master:9333 -ip=volume6 -dir=/data -max=10"
command : "volume -mast er=master:9333 -ip=volume6 -dir=/data -max=10"
depends_on:
- master
volumes:
@ -13,7 +13,7 @@ services:
volume:
image : chrislusf/seaweedfs:e2e
command : "-v=4 volume -mserv er=master:9333 -ip=volume -ip.bind=0.0.0.0 -preStopSeconds=1"
command : "-v=4 volume -mast er=master:9333 -ip=volume -ip.bind=0.0.0.0 -preStopSeconds=1"
healthcheck:
test : [ "CMD" , "curl" , "--fail" , "-I" , "http://localhost:8080/healthz" ]
interval : 2s
@ -36,7 +36,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : 'volume -dataCenter=dc1 -rack=v1 -mserv er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
command : 'volume -dataCenter=dc1 -rack=v1 -mast er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -46,7 +46,7 @@ services:
ports:
- 8082 : 8082
- 18082 : 18082
command : 'volume -dataCenter=dc2 -rack=v2 -mserv er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
command : 'volume -dataCenter=dc2 -rack=v2 -mast er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -56,7 +56,7 @@ services:
ports:
- 8083 : 8083
- 18083 : 18083
command : 'volume -dataCenter=dc3 -rack=v3 -mserv er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
command : 'volume -dataCenter=dc3 -rack=v3 -mast er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -36,7 +36,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : 'volume -dataCenter=dc1 -rack=v1 -mserv er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
command : 'volume -dataCenter=dc1 -rack=v1 -mast er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -46,7 +46,7 @@ services:
ports:
- 8082 : 8082
- 18082 : 18082
command : 'volume -dataCenter=dc2 -rack=v2 -mserv er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
command : 'volume -dataCenter=dc2 -rack=v2 -mast er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -56,7 +56,7 @@ services:
ports:
- 8083 : 8083
- 18083 : 18083
command : 'volume -dataCenter=dc3 -rack=v3 -mserv er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
command : 'volume -dataCenter=dc3 -rack=v3 -mast er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -16,7 +16,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "-v=1 volume -mserv er=master:9333 -port=8080 -ip=volume -preStopSeconds=1 -max=10000"
command : "-v=1 volume -mast er=master:9333 -port=8080 -ip=volume -preStopSeconds=1 -max=10000"
depends_on:
- master
volumes:
@ -42,7 +42,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : 'volume -dataCenter=dc1 -rack=v1 -mserv er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
command : 'volume -dataCenter=dc1 -rack=v1 -mast er="master0:9333,master1:9334,master2:9335" -port=8080 -ip=volume1 -publicUrl=localhost:8080 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -51,7 +51,7 @@ services:
ports:
- 8082 : 8082
- 18082 : 18082
command : 'volume -dataCenter=dc2 -rack=v2 -mserv er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
command : 'volume -dataCenter=dc2 -rack=v2 -mast er="master0:9333,master1:9334,master2:9335" -port=8082 -ip=volume2 -publicUrl=localhost:8082 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -60,7 +60,7 @@ services:
ports:
- 8083 : 8083
- 18083 : 18083
command : 'volume -dataCenter=dc3 -rack=v3 -mserv er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
command : 'volume -dataCenter=dc3 -rack=v3 -mast er="master0:9333,master1:9334,master2:9335" -port=8083 -ip=volume3 -publicUrl=localhost:8083 -preStopSeconds=1'
depends_on:
- master0
- master1
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume"
command : "volume -mast er=master:9333 -port=8080 -ip=volume"
depends_on:
- master
mysql:
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
command : "volume -mast er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
depends_on:
- master
s3:
@ -12,7 +12,7 @@ services:
ports:
- 7455 : 8080
- 9325 : 9325
command : 'volume -mserv er="master:9333" -port=8080 -metricsPort=9325 -preStopSeconds=1 -publicUrl=localhost:7455'
command : 'volume -mast er="master:9333" -port=8080 -metricsPort=9325 -preStopSeconds=1 -publicUrl=localhost:7455'
depends_on:
- master
filer:
@ -14,7 +14,7 @@ services:
- 9325 : 9325
volumes:
- /Volumes/mobile_disk/99:/data
command : 'volume -mserv er="master:9333" -port=8080 -metricsPort=9325 -preStopSeconds=1 -publicUrl=localhost:7455'
command : 'volume -mast er="master:9333" -port=8080 -metricsPort=9325 -preStopSeconds=1 -publicUrl=localhost:7455'
depends_on:
- master
filer:
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume"
command : "volume -mast er=master:9333 -port=8080 -ip=volume"
depends_on:
- master
s3:
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
command : "volume -mast er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
depends_on:
- master
s3:
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume -preStopSeconds=1"
command : "volume -mast er=master:9333 -port=8080 -ip=volume -preStopSeconds=1"
depends_on:
- master
filer:
@ -15,7 +15,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume -preStopSeconds=1"
command : "volume -mast er=master:9333 -port=8080 -ip=volume -preStopSeconds=1"
depends_on:
- master
s3:
@ -71,7 +71,7 @@ services:
- net
command:
- 'volume'
- '-mserv er=master:9333'
- '-mast er=master:9333'
- '-port=8080'
deploy:
mode : global
@ -17,7 +17,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : "volume -mserv er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
command : "volume -mast er=master:9333 -port=8080 -ip=volume -max=0 -preStopSeconds=1"
depends_on:
- master
s3:
@ -14,7 +14,7 @@ services:
- 8080 : 8080
- 18080 : 18080
- 9325 : 9325
command : 'volume -ip=volume -mserv er="master:9333" -ip.bind=0.0.0.0 -port=8080 -metricsPort=9325'
command : 'volume -ip=volume -mast er="master:9333" -ip.bind=0.0.0.0 -port=8080 -metricsPort=9325'
depends_on:
- master
filer:
@ -12,7 +12,7 @@ services:
ports:
- 8080 : 8080
- 18080 : 18080
command : 'volume -ip=volume -mserv er="master:9333" -ip.bind=0.0.0.0 -port=8080'
command : 'volume -ip=volume -mast er="master:9333" -ip.bind=0.0.0.0 -port=8080'
depends_on:
- master
filer:
@ -220,7 +220,7 @@ spec:
-s3.auditLogConfig=/etc/sw/filer_s3_auditLogConfig.json \
{{- end }}
{{- end }}
-master={{ if .Values.global.masterServer }}{{.Values.global.masterServer}}{{ else }}{{ range $index := until (.Values.master.replicas | int) }}${SEAWEEDFS_FULLNAME}-master-{{ $index }}.${SEAWEEDFS_FULLNAME}-master.{{ $.Release.Namespace }}:{{ $.Values.master.port }}{{ if lt $index (sub ($.Values.master.replicas | int) 1) }},{{ end }}{{ end }}{{ end }} \
-master={{ include "seaweedfs.masterServerArg" . }} \
{{- range .Values.filer.extraArgs }}
{{ . }} \
{{- end }}
@ -184,7 +184,7 @@ spec:
-garbageThreshold={{ .Values.master.garbageThreshold }} \
{{- end }}
-ip=${POD_NAME}.${SEAWEEDFS_FULLNAME}-master.{{ .Release.Namespace }} \
-peers={{ range $index := until (.Values.master.replicas | int) }}${SEAWEEDFS_FULLNAME}-master-{{ $index }}.${SEAWEEDFS_FULLNAME}-master.{{ $.Release.Namespace }}:{{ $.Values.master.port }}{{ if lt $index (sub ($.Values.master.replicas | int) 1) }},{{ end }}{{ end }} \
-peers={{ include "seaweedfs.masterServers" . }} \
{{- range .Values.master.extraArgs }}
{{ . }} \
{{- end }}
@ -246,3 +246,28 @@ If allInOne is enabled, point to the all-in-one service; otherwise, point to the
{ { - end - } }
{ { - printf "%s%s.%s:%d" ( include "seaweedfs.name" . ) $serviceNameSuffix . Release . Namespace ( int . Values . filer . port ) - } }
{ { - end - } }
{ { / *
Generate comma-separated list of master server addresses.
Usage: { { include "seaweedfs.masterServers" . } }
Output example: $ { SEAWEEDFS_FULLNAME } -master-0.$ { SEAWEEDFS_FULLNAME } -master.namespace:9333,$ { SEAWEEDFS_FULLNAME } -master-1...
*/}}
{ { - define "seaweedfs.masterServers" - } }
{ { - $fullname : = include "seaweedfs.name" . - } }
{ { - range $index : = until ( . Values . master . replicas | int ) - } }
{ { - if $index } } , { { end - } }
$ { SEAWEEDFS_FULLNAME } -master- { { $index } } .$ { SEAWEEDFS_FULLNAME } -master. { { $ . Release . Namespace } } : { { $ . Values . master . port } }
{ { - end - } }
{ { - end - } }
{ { / *
Generate master server argument value, using global.masterServer if set, otherwise the generated list.
Usage: { { include "seaweedfs.masterServerArg" . } }
*/}}
{ { - define "seaweedfs.masterServerArg" - } }
{ { - if . Values . global . masterServer - } }
{ { - . Values . global . masterServer - } }
{ { - else - } }
{ { - include "seaweedfs.masterServers" . - } }
{ { - end - } }
{ { - end - } }
@ -196,7 +196,7 @@ spec:
-minFreeSpacePercent={{ $volume.minFreeSpacePercent }} \
-ip=${POD_NAME}.${SEAWEEDFS_FULLNAME}-{{ $volumeName }}.{{ $.Release.Namespace }} \
-compactionMBps={{ $volume.compactionMBps }} \
-mserver={{ if $.Values.global.masterServer }}{{ $.Values.global.masterServer}}{{ else }}{{ range $index := until ($.Values.master.replicas | int) }}${SEAWEEDFS_FULLNAME}-master-{{ $index }}.${SEAWEEDFS_FULLNAME}-master.{{ $.Release.Namespace }}:{{ $.Values.master.port }}{{ if lt $index (sub ($.Values.master.replicas | int) 1) }},{{ end }}{{ end }}{{ end }}
-master={{ include "seaweedfs.masterServerArg" $ }} \
{{- range $volume.extraArgs }}
{{ . }} \
{{- end }}
@ -32,7 +32,7 @@ These tests verify actual FileSystem operations against a running SeaweedFS inst
weed master
# Terminal 2: Start volume server
weed volume -mserv er=localhost:9333
weed volume -mast er=localhost:9333
# Terminal 3: Start filer
weed filer -master=localhost:9333
@ -32,7 +32,7 @@ services:
- "18080:18080"
command : >
volume
-mserv er=seaweedfs-master:9333
-mast er=seaweedfs-master:9333
-port=8080
-dir=/data
-max=100
@ -21,7 +21,7 @@ services:
seaweedfs-volume:
image : chrislusf/seaweedfs:latest
container_name : seaweedfs-volume
command : volume -mserv er=seaweedfs-master:9333 -ip=seaweedfs-volume -port=8080 -dir=/data
command : volume -mast er=seaweedfs-master:9333 -ip=seaweedfs-volume -port=8080 -dir=/data
ports:
- "8080:8080"
volumes:
@ -21,7 +21,7 @@ services:
seaweedfs-volume:
image : chrislusf/seaweedfs:latest
container_name : seaweedfs-volume
command : volume -mserv er=seaweedfs-master:9333 -ip=seaweedfs-volume -port=8080 -dir=/data
command : volume -mast er=seaweedfs-master:9333 -ip=seaweedfs-volume -port=8080 -dir=/data
ports:
- "8080:8080"
volumes:
@ -107,7 +107,7 @@ wait_for_service "Master" "http://localhost:9333/cluster/status"
# Start SeaweedFS Volume Server
echo -e " ${ BLUE } 💾 Starting SeaweedFS Volume Server... ${ NC } "
./weed volume -mserv er= localhost:9333 -port= 8080 -dir= /tmp/seaweedfs-volume &
./weed volume -mast er= localhost:9333 -port= 8080 -dir= /tmp/seaweedfs-volume &
VOLUME_PID = $!
wait_for_service "Volume Server" "http://localhost:8080/status"
@ -431,7 +431,7 @@ func startSeaweedFSCluster(ctx context.Context, dataDir string) (*TestCluster, e
"-port" , port ,
"-dir" , volumeDir ,
"-max" , "10" ,
"-mserv er" , "127.0.0.1:9333" ,
"-mast er" , "127.0.0.1:9333" ,
"-ip" , "127.0.0.1" ,
"-dataCenter" , "dc1" ,
"-rack" , rack ,
@ -956,7 +956,7 @@ func startMultiDiskCluster(ctx context.Context, dataDir string) (*MultiDiskClust
"-port" , port ,
"-dir" , strings . Join ( diskDirs , "," ) ,
"-max" , strings . Join ( maxVolumes , "," ) ,
"-mserv er" , "127.0.0.1:9334" ,
"-mast er" , "127.0.0.1:9334" ,
"-ip" , "127.0.0.1" ,
"-dataCenter" , "dc1" ,
"-rack" , rack ,
@ -194,7 +194,7 @@ func (f *FuseTestFramework) startMaster(config *TestConfig) error {
func ( f * FuseTestFramework ) startVolumeServers ( config * TestConfig ) error {
args := [ ] string {
"volume" ,
"-mserv er=" + f . masterAddr ,
"-mast er=" + f . masterAddr ,
"-ip=127.0.0.1" ,
"-port=18080" ,
"-dir=" + filepath . Join ( f . dataDir , "volume" ) ,
@ -27,7 +27,7 @@ services:
ports:
- "8080:8080"
- "18080:18080"
command : "volume -mserv er=seaweedfs-master:9333 -ip=seaweedfs-volume -ip.bind=0.0.0.0 -port=8080 -port.grpc=18080 -publicUrl=seaweedfs-volume:8080 -max=100 -dir=/data -preStopSeconds=1"
command : "volume -mast er=seaweedfs-master:9333 -ip=seaweedfs-volume -ip.bind=0.0.0.0 -port=8080 -port.grpc=18080 -publicUrl=seaweedfs-volume:8080 -max=100 -dir=/data -preStopSeconds=1"
volumes:
- seaweedfs-volume-data:/data
depends_on:
@ -111,7 +111,7 @@ services:
- "18080:18080" # gRPC port
command:
- volume
- -mserv er=seaweedfs-master:9333
- -mast er=seaweedfs-master:9333
- -ip=seaweedfs-volume
- -port=8080
- -port.grpc=18080
@ -113,7 +113,7 @@ services:
- "18080:18080"
command:
- volume
- -mserv er=seaweedfs-master:9333
- -mast er=seaweedfs-master:9333
- -ip=seaweedfs-volume
- -port=8080
- -port.grpc=18080
@ -64,7 +64,7 @@ services:
- "8080:8080"
command:
- volume
- -mserv er=seaweedfs-master:9333
- -mast er=seaweedfs-master:9333
- -ip=seaweedfs-volume
- -publicUrl=seaweedfs-volume:8080
depends_on:
@ -17,7 +17,7 @@ weed server -mq.broker -mq.agent -filer -volume -master.peers=none
# Or start components separately
weed master -peers=none
weed volume -mserv er=localhost:9333
weed volume -mast er=localhost:9333
weed filer -master=localhost:9333
weed mq.broker -filer=localhost:8888
weed mq.agent -brokers=localhost:17777
@ -74,7 +74,7 @@ start-seaweedfs: check-binary
@sleep 3
# Start volume server
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mserv er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-copying-volume -ip= 127.0.0.1 > /tmp/seaweedfs-volume.log 2>& 1 &
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mast er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-copying-volume -ip= 127.0.0.1 > /tmp/seaweedfs-volume.log 2>& 1 &
@sleep 3
# Start filer server (using standard SeaweedFS gRPC port convention: HTTP port + 10000)
@ -75,7 +75,7 @@ start-services: ## Start SeaweedFS services for testing
-dataCenter= dc1 -rack= rack1 \
-dir= test-volume-data \
-max= 100 \
-mserv er= localhost:$( MASTER_PORT) > weed-volume.log 2>& 1 & \
-mast er= localhost:$( MASTER_PORT) > weed-volume.log 2>& 1 & \
echo $$ ! > $( VOLUME_PID_FILE)
@echo "Waiting for volume server to be ready..."
@ -21,7 +21,7 @@ services:
seaweedfs-volume:
image : chrislusf/seaweedfs:latest
container_name : seaweedfs-volume-test
command : volume -dir=/data -port=8083 -mserv er=seaweedfs-master:9333
command : volume -dir=/data -port=8083 -mast er=seaweedfs-master:9333
ports:
- "8083:8083"
volumes:
@ -51,7 +51,7 @@ services:
ports:
- "8083:8083"
- "18083:18083"
command : "volume -ip=weed-volume -port=8083 -dir=/data -mserv er=weed-master:9333 -dataCenter=dc1 -rack=rack1"
command : "volume -ip=weed-volume -port=8083 -dir=/data -mast er=weed-master:9333 -dataCenter=dc1 -rack=rack1"
volumes:
- volume-data:/data
networks:
@ -134,7 +134,7 @@ start-seaweedfs-ci: check-binary
# Start volume server with master HTTP port and increased capacity
@echo "Starting volume server..."
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mserv er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-parquet-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 -preStopSeconds= 1 > /tmp/seaweedfs-parquet-volume.log 2>& 1 &
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mast er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-parquet-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 -preStopSeconds= 1 > /tmp/seaweedfs-parquet-volume.log 2>& 1 &
@sleep 5
# Start filer server with embedded S3
@ -102,7 +102,7 @@ start-seaweedfs: check-binary
@sleep 3
# Start volume server with master HTTP port and increased capacity
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mserv er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-sse-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 > /tmp/seaweedfs-sse-volume.log 2>& 1 &
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mast er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-sse-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 > /tmp/seaweedfs-sse-volume.log 2>& 1 &
@sleep 5
# Start filer server (using standard SeaweedFS gRPC port convention: HTTP port + 10000)
@ -359,7 +359,7 @@ start-seaweedfs-ci: check-binary
# Start volume server with master HTTP port and increased capacity
@echo "Starting volume server..."
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mserv er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-sse-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 > /tmp/seaweedfs-sse-volume.log 2>& 1 &
@nohup $( SEAWEEDFS_BINARY) volume -port= $( VOLUME_PORT) -mast er= 127.0.0.1:$( MASTER_PORT) -dir= /tmp/seaweedfs-test-sse-volume -max= $( VOLUME_MAX_COUNT) -ip= 127.0.0.1 > /tmp/seaweedfs-sse-volume.log 2>& 1 &
@sleep 5
# Create S3 JSON configuration with KMS (Local provider) and basic identity for embedded S3
@ -50,7 +50,7 @@ services:
- "8080:8080"
command:
- volume
- -mserv er=seaweedfs-master:9333
- -mast er=seaweedfs-master:9333
- -port=8080
- -ip=seaweedfs-volume
- -publicUrl=seaweedfs-volume:8080
@ -268,7 +268,7 @@ func (f *SftpTestFramework) startMaster(config *TestConfig) error {
func ( f * SftpTestFramework ) startVolumeServer ( config * TestConfig ) error {
args := [ ] string {
"volume" ,
"-mserv er=" + f . masterAddr ,
"-mast er=" + f . masterAddr ,
"-ip=127.0.0.1" ,
"-port=18080" ,
"-dir=" + filepath . Join ( f . dataDir , "volume" ) ,
@ -17,7 +17,7 @@ makediff test steps
"garbageThreshold" for master and option "max" for volume should be set with specific value which would let
preparing test prerequisite easier )
a ) . / weed master - garbageThreshold = 0.99 - mdir = . / m
b ) . / weed volume - dir = . / data - max = 1 - mserv er = localhost : 9333 - port = 8080
b ) . / weed volume - dir = . / data - max = 1 - mast er = localhost : 9333 - port = 8080
2. upload 4 different files , you could call dir / assign to get 4 different fids
a ) upload file A with fid a
b ) upload file B with fid b