Commit Graph

  • d344e0a035 fix ec related bugs Chris Lu 2019-06-05 23:20:26 -0700
  • 450f4733ce report empty volume or ec shards Chris Lu 2019-06-05 13:32:33 -0700
  • 7f6fb9ffd0 every 17 minutes instead of seconds Chris Lu 2019-06-05 13:32:08 -0700
  • 6b08db65b0 fix shard count reporting Chris Lu 2019-06-05 01:58:37 -0700
  • 784141c5e6 adjust script parameter Chris Lu 2019-06-05 01:48:03 -0700
  • ede876cfdb periodic scripts exeuction from leader master Chris Lu 2019-06-05 01:30:24 -0700
  • b9e138713c ec.encode: add -fullPercent option Chris Lu 2019-06-05 00:13:13 -0700
  • 0e49add2bc adjust help message Chris Lu 2019-06-05 00:11:37 -0700
  • eaa76f11b7 free volume slots factor in ec shard counts Chris Lu 2019-06-04 23:41:56 -0700
  • ca8a2bb534 go fmt Chris Lu 2019-06-04 22:04:10 -0700
  • 2215e81be7 ui add ec shard statuses Chris Lu 2019-06-04 21:52:37 -0700
  • 0e52862586 avoid the test that depends on ordering in a different folder Chris Lu 2019-06-04 02:22:32 -0700
  • 2f7710a75d debug sporadic test error on travis Chris Lu 2019-06-04 02:09:06 -0700
  • 06133ae98f correct count for free ec slots, avoid removing generated shards Chris Lu 2019-06-04 01:49:51 -0700
  • 6cea23d091 purge duplicated ec shards Chris Lu 2019-06-04 01:32:36 -0700
  • b05456fe07 able to purge extra ec shard copies Chris Lu 2019-06-03 20:25:02 -0700
  • 11cffb3168 fix ec.rebuild bugs Chris Lu 2019-06-03 11:50:54 -0700
  • d85b41b904 fix ec.encode not finding the local ec shards Chris Lu 2019-06-03 10:38:21 -0700
  • 7e80b2b882 fix multiple bugs Chris Lu 2019-06-03 02:26:31 -0700
  • 55be09996d fix volume balance bug Chris Lu 2019-06-03 00:13:31 -0700
  • 9ce6b949bf adjust help message Chris Lu 2019-06-01 10:37:08 -0700
  • d6e2c877fa ec.balance: use specific collection names Chris Lu 2019-06-01 02:00:18 -0700
  • 133b772fb5 destroy ec volume if it is empty Chris Lu 2019-06-01 01:51:28 -0700
  • ba18314aab ec shard delete also check ec volumes, in addition to volumes Chris Lu 2019-06-01 01:41:22 -0700
  • f919d0235c ec encode volumes quiet for a period of time Chris Lu 2019-05-31 23:41:17 -0700
  • a72cef3c42 encode by collection Chris Lu 2019-05-31 15:48:40 -0700
  • de1a35acdd conditionally fresh the shard locations Chris Lu 2019-05-31 02:22:12 -0700
  • 47f1901843 ask for the ec volume version Chris Lu 2019-05-31 00:58:51 -0700
  • 689930f092 forget shards that are broken Chris Lu 2019-05-31 00:19:13 -0700
  • aaab2c25f5 resolve concurrent modification problem Chris Lu 2019-05-30 13:59:07 -0700
  • f53024d79d delete ec collection Chris Lu 2019-05-30 10:40:22 -0700
  • 40ca2f2903 add collection.delete Chris Lu 2019-05-30 09:47:54 -0700
  • 1d111d6ce8 collection list normal and ec volumes Chris Lu 2019-05-30 09:27:23 -0700
  • e941d0c2f4 list ec collections also Chris Lu 2019-05-30 09:17:58 -0700
  • 866197eee3 print out the ec balancing plan Chris Lu 2019-05-30 01:38:59 -0700
  • 5c6c757619 clean up test files Chris Lu 2019-05-29 00:34:30 -0700
  • 5dd67f9acf reading by recover from other shards Chris Lu 2019-05-28 23:48:39 -0700
  • 3f9ecee40f working with reading remote intervals Chris Lu 2019-05-28 21:29:07 -0700
  • 302d9fbc6d adjust error message for file not found Chris Lu 2019-05-28 14:27:21 -0700
  • 4f76342cbc WIP Chris Lu 2019-05-28 00:51:01 -0700
  • 2858a954b3 read ec volume shards locations from master Chris Lu 2019-05-28 00:13:13 -0700
  • 713596e781 caching ec shard locations Chris Lu 2019-05-27 22:54:58 -0700
  • 3a8c1055a2 refactoring ecx to ecVolume Chris Lu 2019-05-27 22:00:36 -0700
  • 217cde0a3b refactoring Chris Lu 2019-05-27 21:40:51 -0700
  • 03b9291e5d volum server passes grpc option and master location to store Chris Lu 2019-05-27 21:22:23 -0700
  • ac1ba3b667 remove comments Chris Lu 2019-05-27 21:21:52 -0700
  • b4b407e403 add grpc ec shard read Chris Lu 2019-05-27 11:59:03 -0700
  • a4f3d82c57 convert needle id to ec intervals to read from Chris Lu 2019-05-27 01:29:46 -0700
  • a463759edf adjust error message Chris Lu 2019-05-26 01:14:42 -0700
  • 92f9c7b1aa adjust ec shard status on disconnect Chris Lu 2019-05-26 01:05:08 -0700
  • ac14cd5ad0 wdclient need to have ec shard info on initial dump Chris Lu 2019-05-26 01:01:04 -0700
  • b58e25e588 broadcast vid->location map to master clients for ec chards Chris Lu 2019-05-26 00:49:15 -0700
  • af67d99ca4 incrementally update master ec shards state Chris Lu 2019-05-26 00:21:17 -0700
  • db94a41f9e mount/unmount ec shards Chris Lu 2019-05-25 23:23:19 -0700
  • 41e8ae61f8 generate, balance, delete copied shards, delete old volume Chris Lu 2019-05-25 14:02:06 -0700
  • f0e6574d5e allocate ec shards to volume servers Chris Lu 2019-05-25 02:02:44 -0700
  • 6f4b09b6a4 pb shard info uses ShardBits instead one message for one shard Chris Lu 2019-05-24 13:28:44 -0700
  • 228850d588 shard id starts from zero Chris Lu 2019-05-24 11:52:23 -0700
  • 24b8ad9a14 push the ec shard info to master Chris Lu 2019-05-23 23:47:49 -0700
  • 8838176d82 register ec shards to topology Chris Lu 2019-05-23 23:34:29 -0700
  • 8a96445f40 register ec shards to each data node Chris Lu 2019-05-23 22:51:18 -0700
  • 4659d80035 prepare to register ec shard info in master Chris Lu 2019-05-23 00:42:28 -0700
  • e913ee380a add comments Chris Lu 2019-05-23 00:04:24 -0700
  • 7180520889 ec shard info can be queried via VolumeList() Chris Lu 2019-05-22 22:44:28 -0700
  • 17ac1290c0 volume: load ec shards during heartbeats to master Chris Lu 2019-05-21 22:41:20 -0700
  • 54b835e1ae filer: redis cluster add option for password Chris Lu 2019-05-20 09:00:30 -0700
  • fbbc74abb4 adds VolumeEcGenerateSlices, VolumeEcCopy Chris Lu 2019-05-20 00:53:17 -0700
  • ae499fd5aa Merge branch 'master' into erasure_coding Chris Lu 2019-05-19 21:38:18 -0700
  • 698dea779c refactoring Chris Lu 2019-05-19 21:37:49 -0700
  • 693d6c0f1b clean up tests Chris Lu 2019-05-19 21:16:01 -0700
  • 0094ca3f8a mark the webdav as unstable Chris Lu 2019-05-19 21:08:26 -0700
  • 6386a3174b able to validate by randomly selected ec files Chris Lu 2019-05-19 14:24:33 -0700
  • 7c2c60c376 add locating data inside the ec files Chris Lu 2019-05-19 03:01:58 -0700
  • 87f63b9c08 generate ec01~ec14, generate ecx file with sorted needle values Chris Lu 2019-05-18 22:46:24 -0700
  • 12dc6608f0 Merge branch 'master' into erasure_coding Chris Lu 2019-05-18 11:16:07 -0700
  • f2c4c888f6 1.34 1.34 Chris Lu 2019-05-17 22:53:30 -0700
  • 8123a488cd filer: optimize leveldb parameters Chris Lu 2019-05-17 18:14:25 -0700
  • 76cf57a0e1 volume: optimzation for leveldb Chris Lu 2019-05-17 17:34:03 -0700
  • 0fe286a6ca filer: optimization for leveldb, add leveldb2 Chris Lu 2019-05-17 17:33:49 -0700
  • 7e0c3bb732 filer: adjust recommended mysql meta data type to LONGBLOB Chris Lu 2019-05-17 09:11:08 -0700
  • bf9d490538 fix for tests Chris Lu 2019-05-17 02:28:20 -0700
  • 82b0759493 filer: migrating filer store from persisting shorter structured file id instead of a string Chris Lu 2019-05-17 02:03:23 -0700
  • 939de1e832
    Update README.md Chris Lu 2019-05-15 23:25:59 -0700
  • 8156958ee9 move function to make travis happy Chris Lu 2019-05-15 10:02:44 -0700
  • 0a36f628c6 testing RS coding Chris Lu 2019-05-15 01:02:00 -0700
  • ab22407763 filer ip only use bind ip Chris Lu 2019-05-14 23:43:40 -0700
  • dd4ef58d99 skip setting ip address for filer Chris Lu 2019-05-14 23:35:39 -0700
  • 017d0957c3 avoid switching master node if same ip and host name Chris Lu 2019-05-11 18:42:46 -0700
  • 4dfcd2169e weedfuse: adapt to fstab command line pattern Chris Lu 2019-05-11 01:17:55 -0700
  • 9a4fb14ea0 weedfuse: daemonize Chris Lu 2019-05-10 17:08:15 -0700
  • 1ca1ec906a add weedfuse Chris Lu 2019-05-10 15:03:31 -0700
  • 69b7dd398d adjust help message Chris Lu 2019-05-07 14:02:01 -0700
  • d01807ba05 shell: volume.balance add option for all_collections, each_collection Chris Lu 2019-05-06 14:12:19 -0700
  • 8ffdd5dcdb writel throttling moving volumes Chris Lu 2019-05-06 13:58:42 -0700
  • cf58fc0e63 refactor: extract out the write throttler Chris Lu 2019-05-06 13:56:08 -0700
  • 4e42e7b5e7 shell: volume.balance add dataCenter filter Chris Lu 2019-05-06 13:30:12 -0700
  • 2dae50a18c
    Update README.md Chris Lu 2019-05-06 13:05:35 -0700
  • c7c75a2fe8
    Update README.md Chris Lu 2019-05-06 13:03:55 -0700
  • 4c392ca762 use ip.bind to listen for grpc calls Chris Lu 2019-05-06 08:10:18 -0700
  • 8656102127 shell: volume.balance runs for each collection, and for ALL at the end Chris Lu 2019-05-05 22:28:14 -0700