chrislu
|
ea2637734a
|
refactor filer proto chunk variable from mtime to modified_ts_ns
|
2 years ago |
Eric Yang
|
51d462f204
|
ADHOC: volume fsck using append at ns (#3906)
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
|
2 years ago |
Konstantin Lebedev
|
e20f0dbd2d
|
avoid data race of TraverseBfs (#3856)
* avoid data race of TraverseBfs
* close is enough
avoid panic
I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255
I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c]
goroutine 287 [running]:
github.com/seaweedfs/seaweedfs/weed/storage.(*SortedFileNeedleMap).Close(0x0)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load.func1()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c
github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes.func2()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9
created by github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150
|
2 years ago |
chrislu
|
b90d92fca9
|
grpc: watch metadata changes by directory
|
2 years ago |
chrislu
|
21c0587900
|
go fmt
|
2 years ago |
Ryan Russell
|
a8d7615eec
|
refactor(filer_client): `EachEntryFunciton` -> `EachEntryFunction` (#3671)
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
|
2 years ago |
Eric Yang
|
b324a6536c
|
ADHOC: add read needle meta grpc (#3581)
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
|
2 years ago |
chrislu
|
eaeb141b09
|
move proto package
|
2 years ago |
Konstantin Lebedev
|
4d08393b7c
|
filer prefer volume server in same data center (#3405)
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
|
2 years ago |
chrislu
|
afef014832
|
scaffold
|
2 years ago |
chrislu
|
26dbc6c905
|
move to https://github.com/seaweedfs/seaweedfs
|
2 years ago |
Konstantin Lebedev
|
2f0dda384d
|
vacuum show LA
|
2 years ago |
chrislu
|
de3afd4199
|
fix rebasing
|
2 years ago |
chrislu
|
8060fdcac5
|
remove old code
|
2 years ago |
chrislu
|
64f3d6fb6e
|
metadata subscription uses client epoch
|
2 years ago |
chrislu
|
7db6666b97
|
remove old code
|
2 years ago |
chrislu
|
530da0cc89
|
remove unused code
|
3 years ago |
Konstantin Lebedev
|
c07820178f
|
fix s3 tests
bucket_list_delimiter_prefix
bucket_list_delimiter_prefix_underscore
bucket_list_delimiter_prefix_ends_with_delimiter
|
3 years ago |
chrislu
|
4fd5f96598
|
filer: remove replication, collection, disk_type info from entry metadata
these metadata can change and are not used
|
3 years ago |
chrislu
|
a2b101a737
|
subscribe metadata between a range
|
3 years ago |
chrislu
|
ca16fbf0ef
|
shell: cluster.ps display filer group
|
3 years ago |
guol-fnst
|
8e2426a879
|
revert changes of pb file
orignal protoc-gen-go-grpc verion is 1.1.0
|
3 years ago |
guol-fnst
|
de6aa9cce8
|
avoid duplicated volume directory
|
3 years ago |
chrislu
|
94635e9b5c
|
filer: add filer group
|
3 years ago |
Konstantin Lebedev
|
1e35b4929f
|
shell vacuum volume by collection and volume id
|
3 years ago |
chrislu
|
b4be56bb3b
|
add timing info during ping operation
|
3 years ago |
Konstantin Lebedev
|
357aa818fe
|
add raft shell cmds
|
3 years ago |
chrislu
|
743ad690b6
|
filer supports grpc ping
|
3 years ago |
chrislu
|
4042fdf3bb
|
rename to skipCheckParentDir
related to https://github.com/chrislusf/seaweedfs/pull/2761
It's better to default to false.
|
3 years ago |
chrislu
|
202a29d014
|
refactoring
|
3 years ago |
chrislu
|
91d6785cf3
|
define metadata action types
|
3 years ago |
chrislu
|
be3fc77391
|
mount2: use consistent inode
|
3 years ago |
chrislu
|
ceaf993a27
|
mount2: add rdev
|
3 years ago |
chrislu
|
b1063162b6
|
display bucket quota
|
3 years ago |
chrislu
|
fec8428fd8
|
POSIX: different inode for same named different file types
|
3 years ago |
chrislu
|
5c87fcc6d2
|
add client id for all metadata listening clients
|
3 years ago |
chrislu
|
9f9ef1340c
|
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
|
3 years ago |
banjiaojuhao
|
083bf3a137
|
filer server: add "datacenter, rack and datanode" for path specific configuration
|
3 years ago |
banjiaojuhao
|
08336be92e
|
filer server: allow upload file to specific dataNode
|
3 years ago |
chrislu
|
b70cb3e0b2
|
upgrade protoc to 3.17.3
$brew install protobuf
$ protoc --version
libprotoc 3.17.3
$ go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.26
$ go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@v1.1
|
3 years ago |
Chris Lu
|
5ea86ef1da
|
Revert "master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()"
This reverts commit af71ae11aa .
|
3 years ago |
Chris Lu
|
af71ae11aa
|
master: rename grpc function KeepConnected() to SubscribeVolumeLocationUpdates()
|
3 years ago |
Chris Lu
|
24858507cc
|
rename API to avoid confusion
|
3 years ago |
Chris Lu
|
cca62fdb30
|
mount: streaming renaming folders
|
3 years ago |
Chris Lu
|
0a856241fe
|
avoid int bigger than math.MaxInt32
fix https://github.com/chrislusf/seaweedfs/issues/2363
|
3 years ago |
Chris Lu
|
e5fc35ed0c
|
change server address from string to a type
|
3 years ago |
Chris Lu
|
0cda61d539
|
return error if not found
|
3 years ago |
Chris Lu
|
43fd11278e
|
support follow additional path prefixes
|
3 years ago |
Chris Lu
|
05f32376eb
|
add cluster id in filer configuration response
|
3 years ago |
Chris Lu
|
05a648bb96
|
refactor: separating out remote.proto
|
3 years ago |