Chris Lu
|
289fd7eb39
|
count number of volumes and ec shards
|
6 years ago |
Chris Lu
|
57092d69ac
|
go fmt
|
6 years ago |
Chris Lu
|
d344e0a035
|
fix ec related bugs
|
6 years ago |
Chris Lu
|
450f4733ce
|
report empty volume or ec shards
|
6 years ago |
Chris Lu
|
ca8a2bb534
|
go fmt
|
6 years ago |
Chris Lu
|
2215e81be7
|
ui add ec shard statuses
|
6 years ago |
Chris Lu
|
0e52862586
|
avoid the test that depends on ordering in a different folder
|
6 years ago |
Chris Lu
|
2f7710a75d
|
debug sporadic test error on travis
|
6 years ago |
Chris Lu
|
11cffb3168
|
fix ec.rebuild bugs
|
6 years ago |
Chris Lu
|
7e80b2b882
|
fix multiple bugs
|
6 years ago |
Chris Lu
|
133b772fb5
|
destroy ec volume if it is empty
|
6 years ago |
Chris Lu
|
ba18314aab
|
ec shard delete also check ec volumes, in addition to volumes
|
6 years ago |
Chris Lu
|
f919d0235c
|
ec encode volumes quiet for a period of time
|
6 years ago |
Chris Lu
|
de1a35acdd
|
conditionally fresh the shard locations
|
6 years ago |
Chris Lu
|
47f1901843
|
ask for the ec volume version
|
6 years ago |
Chris Lu
|
689930f092
|
forget shards that are broken
|
6 years ago |
Chris Lu
|
aaab2c25f5
|
resolve concurrent modification problem
n and err can be modified concurrently
|
6 years ago |
Chris Lu
|
40ca2f2903
|
add collection.delete
|
6 years ago |
Chris Lu
|
5c6c757619
|
clean up test files
|
6 years ago |
Chris Lu
|
5dd67f9acf
|
reading by recover from other shards
|
6 years ago |
Chris Lu
|
3f9ecee40f
|
working with reading remote intervals
|
6 years ago |
Chris Lu
|
302d9fbc6d
|
adjust error message for file not found
|
6 years ago |
Chris Lu
|
4f76342cbc
|
WIP
no errors, but not returning file content
* the interval needs to use actual file zie
* need to read the actual version instead of the current version
|
6 years ago |
Chris Lu
|
2858a954b3
|
read ec volume shards locations from master
|
6 years ago |
Chris Lu
|
713596e781
|
caching ec shard locations
|
6 years ago |
Chris Lu
|
3a8c1055a2
|
refactoring ecx to ecVolume
|
6 years ago |
Chris Lu
|
217cde0a3b
|
refactoring
|
6 years ago |
Chris Lu
|
03b9291e5d
|
volum server passes grpc option and master location to store
|
6 years ago |
Chris Lu
|
b4b407e403
|
add grpc ec shard read
|
6 years ago |
Chris Lu
|
a4f3d82c57
|
convert needle id to ec intervals to read from
|
6 years ago |
Chris Lu
|
a463759edf
|
adjust error message
|
6 years ago |
Chris Lu
|
af67d99ca4
|
incrementally update master ec shards state
|
6 years ago |
Chris Lu
|
db94a41f9e
|
mount/unmount ec shards
|
6 years ago |
Chris Lu
|
f0e6574d5e
|
allocate ec shards to volume servers
|
6 years ago |
Chris Lu
|
6f4b09b6a4
|
pb shard info uses ShardBits instead one message for one shard
|
6 years ago |
Chris Lu
|
228850d588
|
shard id starts from zero
|
6 years ago |
Chris Lu
|
8a96445f40
|
register ec shards to each data node
|
6 years ago |
Chris Lu
|
4659d80035
|
prepare to register ec shard info in master
|
6 years ago |
Chris Lu
|
7180520889
|
ec shard info can be queried via VolumeList()
|
6 years ago |
Chris Lu
|
17ac1290c0
|
volume: load ec shards during heartbeats to master
|
6 years ago |
Chris Lu
|
fbbc74abb4
|
adds VolumeEcGenerateSlices, VolumeEcCopy
|
6 years ago |
Chris Lu
|
693d6c0f1b
|
clean up tests
|
6 years ago |
Chris Lu
|
6386a3174b
|
able to validate by randomly selected ec files
|
6 years ago |
Chris Lu
|
7c2c60c376
|
add locating data inside the ec files
|
6 years ago |
Chris Lu
|
87f63b9c08
|
generate ec01~ec14, generate ecx file with sorted needle values
|
6 years ago |
Chris Lu
|
76cf57a0e1
|
volume: optimzation for leveldb
|
6 years ago |
Chris Lu
|
8156958ee9
|
move function to make travis happy
|
6 years ago |
Chris Lu
|
0a36f628c6
|
testing RS coding
|
6 years ago |
Chris Lu
|
cf58fc0e63
|
refactor: extract out the write throttler
|
6 years ago |
Chris Lu
|
46a675ecc2
|
align memory to avoid nil with atomic operations
|
6 years ago |