Chris Lu
2336a397dc
use pipeline to save some time
3 years ago
Chris Lu
371fead8a5
redis3 using redis native sorted set
3 years ago
Chris Lu
8668d49c9d
test with real redis
cpu: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz
BenchmarkNameList-12 1789 760599 ns/op
BenchmarkRedis-12 17539 64122 ns/op
PASS
3 years ago
Chris Lu
6b31f3c97a
add benchmark test
3 years ago
Chris Lu
893f0587b1
redis3 adds distributed locking
3 years ago
Chris Lu
f0d1e7bd05
skip ec volumes when loading normal volumes
3 years ago
Chris Lu
332d49432d
reduce concurrent volume grow requests
3 years ago
Chris Lu
96119eab00
refactor
3 years ago
Chris Lu
8a66306064
calculate disk usage in case of race condition
related to https://github.com/chrislusf/seaweedfs/issues/2357
3 years ago
Chris Lu
4ed2994555
use tsMemory to determine whether read from disk or memory
remove lastFlushTime
3 years ago
Chris Lu
6a030547a2
server: remove peer check if not starting master
more fix https://github.com/chrislusf/seaweedfs/issues/2352
3 years ago
Chris Lu
62c2732fd1
add back logic to check master peers
fix https://github.com/chrislusf/seaweedfs/issues/2352
3 years ago
Chris Lu
947add39e6
clean up *SkipListElementReference loaded from Redis
3 years ago
Chris Lu
513fed323a
SkipListElementReference can be an empty object
3 years ago
Chris Lu
280ab7f95c
add test
3 years ago
Chris Lu
04662126bb
add redis3
3 years ago
Chris Lu
2b9aab3442
use 1000 per batch
3 years ago
Chris Lu
366f522a2d
add redis3
3 years ago
Chris Lu
ba7fbac07f
rename
3 years ago
Chris Lu
e6196cdc50
add name list
3 years ago
Chris Lu
a481c4a45e
return previous element if visited
3 years ago
Chris Lu
22d8684e88
refactor out listStore
3 years ago
Chris Lu
d343b0db57
update value
3 years ago
Chris Lu
4f50f8c2ca
insert key and value
3 years ago
Chris Lu
69b84bb771
TestFindGreaterOrEqual
3 years ago
Chris Lu
57e2fd3f9b
remove bptree
3 years ago
Chris Lu
4c1741fdbb
working skiplist
3 years ago
Chris Lu
b297849147
typo
3 years ago
Chris Lu
af207bbaf0
retry both assign volume and uploading data
fix https://github.com/chrislusf/seaweedfs/issues/2351
3 years ago
Chris Lu
1e3fdf366f
go fmt
3 years ago
Chris Lu
e862b2529a
refactor
3 years ago
Konstantin Lebedev
5e64b22b45
check that the topology has been updated
3 years ago
Chris Lu
f58ea6a2ee
add source name to error message
3 years ago
chrislusf
3ffbaaa071
use github.com/linxGnu/grocksdb
3 years ago
Konstantin Lebedev
2cecde89c3
rename opt volumesPerStep
3 years ago
Konstantin Lebedev
fc51ffce2b
https://github.com/chrislusf/seaweedfs/issues/1846
3 years ago
Chris Lu
a067deaabc
avoid possible modified location list
fix issue 1 of https://github.com/chrislusf/seaweedfs/issues/2345
3 years ago
Chris Lu
040443e2d1
fix possible error case
3 years ago
Chris Lu
2e9372dcf7
volume stream read skips deleted content
3 years ago
Chris Lu
225b019fe0
stream read multiple volumes in a volume server
3 years ago
Chris Lu
1904448d4e
adjust starting offset
3 years ago
Chris Lu
5956a8b05a
adjust comment
3 years ago
Chris Lu
aa64f2ac4c
send needle data instead of raw needle body
3 years ago
Chris Lu
c4d7ee6c5c
volume server: read all files in a volume
3 years ago
Chris Lu
4a1d4d7462
s3: default to allow empty folder for better performance
3 years ago
Chris Lu
cee4d20bc1
2.70
3 years ago
Chris Lu
603ea2db73
avoid looping forever if there are no more metadata updates
3 years ago
Chris Lu
9887610b54
log tsNs should be processing time
3 years ago
Chris Lu
2baed2e1e9
avoid possible metadata subscription data loss
Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.
3 years ago
Chris Lu
a814f3f0a8
adjust metadata tail output
3 years ago