4827425146
balancer works
1 year ago
436d99443b
receive broker stats
1 year ago
2492a45499
ack interval
1 year ago
ba67e6ca29
api for sub
1 year ago
cb470d44df
can pub and sub
1 year ago
504ae8383a
protoc version
1 year ago
dbcba75271
rename to lookup
1 year ago
4d6c18d86f
pub sub initial tests
1 year ago
1990456670
sub
1 year ago
905911853d
adjust proto
1 year ago
796b7508f3
Implement SRV lookups for filer ( #4767 )
1 year ago
010c5e91e3
add stream assign proto
1 year ago
01d70c21f3
Squashed commit of the following:
commit 32f4b1a130e77ad33b7cf431f30cc74e9dcb1829
1 year ago
f8aa5ea844
adjust filer.proto
2 years ago
5149b3d07b
filer can proxy to peer filer holding the lock
2 years ago
464a71a373
add distributed lock manager
2 years ago
3fd659df2a
add distributed lock manager
2 years ago
8ec1bc2c99
remove unused cluster node leader
2 years ago
25535e9c36
Delete volume is empty ( #4561 )
* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
26f15d0079
Fix no more writable volumes by delay judgment ( #4548 )
* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
1ebb549f77
support swift ( #4480 )
2 years ago
d75a7b7f62
allow deleting only older empty dir without recursion ( #4430 )
2 years ago
5db9fcccd4
refactoring
2 years ago
9bd422d2c9
adding support for B2 region ( #4177 )
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2 years ago
81fdf3651b
grpc connection to filer add sw-client-id header
2 years ago
d8cfa1552b
support enable/disable vacuum ( #4087 )
* stop vacuum
* suspend/resume vacuum
* remove unused code
* rename
* rename param
2 years ago
e1ca6308cb
add chunk etag when downloading from remote storage
fix https://github.com/seaweedfs/seaweedfs/issues/3987
2 years ago
81624de27b
Include name/mime in ReadAllNeedles ( #4005 )
2 years ago
4c85da7844
Include meta in ReadAllNeedles ( #3991 )
This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice.
2 years ago
70a4c98b00
refactor filer_pb.Entry and filer.Entry to use GetChunks()
for later locking on reading chunks
2 years ago
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
de286fe662
shell: volume.move handles volume moved to cloud tier
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2 years ago
e20f0dbd2d
avoid data race of TraverseBfs ( #3856 )
* avoid data race of TraverseBfs
* close is enough
avoid panic
I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255
I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c]
goroutine 287 [running]:
github.com/seaweedfs/seaweedfs/weed/storage.(*SortedFileNeedleMap).Close(0x0)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load.func1()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e
github.com/seaweedfs/seaweedfs/weed/storage.(*Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c
github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1)
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da
github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes.func2()
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9
created by github.com/seaweedfs/seaweedfs/weed/storage.(*DiskLocation).concurrentLoadingVolumes
/Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150
2 years ago
f476cf3403
fix volume_server.proto conflict ( #3858 )
fix conflict
https://github.com/seaweedfs/seaweedfs/pull/3841
2 years ago
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
dcd0743a35
remove unused ReadNeedleBlobRequest.needle_id
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2 years ago
36daa7709d
show raft leader via shell ( #3796 )
2 years ago
e00a12b099
associate `Account` and `Identity` by accountId ( #3754 )
2 years ago
31922b2bf2
s3 to watch specific directories
2 years ago
b90d92fca9
grpc: watch metadata changes by directory
2 years ago
21c0587900
go fmt
2 years ago
c8645fd232
master: implement grpc VolumeMarkWritable
fix https://github.com/seaweedfs/seaweedfs/issues/3657
2 years ago
12914af4d8
Character readability ( #3678 )
* refactor(pb): `quote_charactoer` -> `quote_character`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(volume_server): `quoteCharactoer` -> `quoteCharacter`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
a8d7615eec
refactor(filer_client): `EachEntryFunciton` -> `EachEntryFunction` ( #3671 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
721c6197f9
skip deltaBeat if dn is zero ( #3630 )
* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix
2 years ago
b9112747b5
volume server: synchronously report volume readonly status to master
fix https://github.com/seaweedfs/seaweedfs/issues/3628
2 years ago
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
74b53729e1
feat(weed.move): add a speed limit parameter of moving files ( #3478 )
* feat(weed.move): add a speed limit parameter of moving files
* fix(weed.move): set the default value of ioBytePerSecond to vs.compactionBytePerSecond
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2 years ago
chrislu
Nico D'Cotta
Konstantin Lebedev
wusong
mervynzhang
Muhammad Hallaj bin Subery
Guo Lei
James Hartig
Eric Yang
LHHDZ
Ryan Russell
askeipx
qzh