Enabling debug mode...
Setting history weight to 0.3...
Setting reinforcement at the end of unsuccessful path to 1000... [needs -reward=lastaction]
Setting reinforcement along unsuccessful path to 1... [needs -reward=lastaction]
Setting reinforcement at the end of successful path to 10000... [needs -reward=lastaction]
Setting reinforcement along successful path to 10000... [needs -reward=lastaction]
Setting path reward to Last Action(10000,10000,0,1000)...
Setting policy update to complete count method...
Enabling last action identification for checkpoint formulae...
Setting hypothesis testing probability to 0.99...
Starting threads... 0.03s
Learning...
 Block[#]{# satisfying traces, # falsifying traces}
 Block[0]{1, 4999} 123
 Block[1]{94, 4906} 123
 Block[2]{542, 4458} 123
 Block[3]{1815, 3185} 123
 Block[4]{2891, 2109} 123
 Block[5]{3419, 1581} 123
 Block[6]{3674, 1326} 123
 Block[7]{3869, 1131} 123
 Block[8]{4009, 991} 123
 Block[9]{4158, 842} 123
 Block[10]{4245, 755} 123
 Block[11]{4311, 689} 123
 Block[12]{4443, 557} 123
 Block[13]{4524, 476} 123
 Block[14]{4553, 447} 123
 Block[15]{4607, 393} 123
 Block[16]{4635, 365} 123
 Block[17]{4655, 345} 123
 Block[18]{4656, 344} 123
 Block[19]{4697, 303} 123
 Block[20]{4706, 294} 123
 Block[21]{4717, 283} 123
 Block[22]{4717, 283} 123
 Block[23]{4774, 226} 123
 Block[24]{4777, 223} 123
 Block[25]{4783, 217} 123
 Block[26]{4749, 251} 123
 Block[27]{4813, 187} 123
 Block[28]{4801, 199} 123
 Block[29]{4814, 186} 123
 Block[30]{4811, 189} 123
 Block[31]{4811, 189} 123
 Block[32]{4800, 200} 123
 Block[33]{4833, 167} 123
 Block[34]{4811, 189} 123
 Block[35]{4822, 178} 123
 Block[36]{4813, 187} 123
 Block[37]{4837, 163} 123
 Block[38]{4827, 173} 123
 Block[39]{4800, 200} 123
 Block[40]{4828, 172} 123
 Block[41]{4814, 186} 123
 Block[42]{4837, 163} 123
 Block[43]{4841, 159} 123
 Block[44]{4862, 138} 123
 Block[45]{4844, 156} 123
 Block[46]{4852, 148} 123
 Block[47]{4834, 166} 123
 Block[48]{4835, 165} 123
 Block[49]{4808, 192} 123
 Block[50]{4832, 168} 123
 Block[51]{4830, 170} 123
 Block[52]{4821, 179} 123
 Block[53]{4858, 142} 123
 Block[54]{4846, 154} 123
 Block[55]{4832, 168} 123
 Block[56]{4845, 155} 123
 Block[57]{4859, 141} 123
 Block[58]{4847, 153} 123
 Block[59]{4872, 128} 123
 Block[60]{4835, 165} 123
 Block[61]{4852, 148} 123
 Block[62]{4861, 139} 123
 Block[63]{4881, 119} 123
 Block[64]{4844, 156} 123
 Block[65]{4849, 151} 123
 Block[66]{4860, 140} 123
 Block[67]{4859, 141} 123
 Block[68]{4871, 129} 123
 Block[69]{4855, 145} 123
 Block[70]{4850, 150} 123
 Block[71]{4860, 140} 123
 Block[72]{4856, 144} 123
 Block[73]{4879, 121} 123
 Block[74]{4865, 135} 123
 Block[75]{4858, 142} 123
 Block[76]{4859, 141} 123
 Block[77]{4868, 132} 123
 Block[78]{4855, 145} 123
 Block[79]{4862, 138} 123
 Block[80]{4863, 137} 123
 Block[81]{4877, 123} 123
 Block[82]{4866, 134} 123
 Block[83]{4864, 136} 123
 Block[84]{4883, 117} 123
 Block[85]{4880, 120} 123
 Block[86]{4874, 126} 123
 Block[87]{4887, 113} 123
 Block[88]{4875, 125} 123
 Block[89]{4887, 113} 123
 Block[90]{4885, 115} 123
 Block[91]{4867, 133} 123
 Block[92]{4874, 126} 123
 Block[93]{4879, 121} 123
 Block[94]{4889, 111} 123
 Block[95]{4870, 130} 123
 Block[96]{4876, 124} 123
 Block[97]{4865, 135} 123
 Block[98]{4876, 124} 123
 Block[99]{4891, 109} 123
 Block[100]{4862, 138} 123
 Block[101]{4897, 103} 123
 Block[102]{4889, 111} 123
 Block[103]{4869, 131} 123
 Block[104]{4877, 123} 123
 Block[105]{4883, 117} 123
 Block[106]{4875, 125} 123
 Block[107]{4880, 120} 123
 Block[108]{4879, 121} 123
 Block[109]{4869, 131} 123
 Block[110]{4882, 118} 123
 Block[111]{4896, 104} 123
 Block[112]{4891, 109} 123
 Block[113]{4892, 108} 123
 Block[114]{4904, 96} 123
 Block[115]{4885, 115} 123
 Block[116]{4882, 118} 123
 Block[117]{4879, 121} 123
 Block[118]{4878, 122} 123
 Block[119]{4899, 101} 123
 Block[120]{4894, 106} 123
 Block[121]{4906, 94} 123
 Block[122]{4905, 95} 123
 Block[123]{4902, 98} 123
 Block[124]{4884, 116} 123
 Block[125]{4900, 100} 123
 Block[126]{4899, 101} 123
 Block[127]{4892, 108} 123
 Block[128]{4888, 112} 123
 Block[129]{4911, 89} 123
 Block[130]{4865, 135} 123
 Block[131]{4903, 97} 123
 Block[132]{4904, 96} 123
 Block[133]{4892, 108} 123
 Block[134]{4899, 101} 123
 Block[135]{4898, 102} 123
 Block[136]{4900, 100} 123
 Block[137]{4899, 101} 123
 Block[138]{4907, 93} 123
 Block[139]{4898, 102} 123
 Block[140]{4889, 111} 123
 Block[141]{4909, 91} 123
 Block[142]{4888, 112} 123
 Block[143]{4911, 89} 123
 Block[144]{4886, 114} 123
 Block[145]{4904, 96} 123
 Block[146]{4900, 100} 123
 Block[147]{4910, 90} 123
 Block[148]{4904, 96} 123
 Block[149]{4905, 95} 123
 Block[150]{4923, 77} 123
 Block[151]{4912, 88} 123
 Block[152]{4920, 80} 123
 Block[153]{4904, 96} 123
 Block[154]{4916, 84} 123
 Block[155]{4897, 103} 123
 Block[156]{4912, 88} 123
 Block[157]{4891, 109} 123
 Block[158]{4896, 104} 123
 Block[159]{4901, 99} 123
 Block[160]{4908, 92} 123
 Block[161]{4888, 112} 123
 Block[162]{4901, 99} 123
 Block[163]{4926, 74} 123
 Block[164]{4916, 84} 123
 Block[165]{4914, 86} 123
 Block[166]{4888, 112} 123
 Block[167]{4902, 98} 123
 Block[168]{4896, 104} 123
 Block[169]{4897, 103} 123
 Block[170]{4891, 109} 123
 Block[171]{4925, 75} 123
 Block[172]{4921, 79} 123
 Block[173]{4901, 99} 123
 Block[174]{4909, 91} 123
 Block[175]{4931, 69} 123
 Block[176]{4904, 96} 123
 Block[177]{4915, 85} 123
 Block[178]{4895, 105} 123
 Block[179]{4919, 81} 123
 Block[180]{4913, 87} 123
 Block[181]{4885, 115} 123
 Block[182]{4898, 102} 123
 Block[183]{4899, 101} 123
 Block[184]{4900, 100} 123
 Block[185]{4901, 99} 123
 Block[186]{4914, 86} 123
 Block[187]{4899, 101} 123
 Block[188]{4916, 84} 123
 Block[189]{4895, 105} 123
 Block[190]{4909, 91} 123
 Block[191]{4919, 81} 123
 Block[192]{4911, 89} 123
 Block[193]{4902, 98} 123
 Block[194]{4931, 69} 123
 Block[195]{4917, 83} 123
 Block[196]{4909, 91} 123
 Block[197]{4919, 81} 123
 Block[198]{4915, 85} 123
 Block[199]{4917, 83} 123
 Block[200]{4916, 84} 123
 Block[201]{4907, 93} 123
 Block[202]{4930, 70} 123
 Block[203]{4914, 86} 123
 Block[204]{4935, 65} 123
 Block[205]{4919, 81} 123
 Block[206]{4916, 84} 123
 Block[207]{4913, 87} 123
 Block[208]{4912, 88} 123
 Block[209]{4914, 86} 123
 Block[210]{4904, 96} 123
 Block[211]{4922, 78} 123
 Block[212]{4909, 91} 123
 Block[213]{4925, 75} 123
 Block[214]{4904, 96} 123
 Block[215]{4905, 95} 123
 Block[216]{4931, 69} 123
 Block[217]{4916, 84} 123
 Block[218]{4908, 92} 123
 Block[219]{4916, 84} 123
 Block[220]{4920, 80} 123
 Block[221]{4922, 78} 123
 Block[222]{4917, 83} 123
 Block[223]{4933, 67} 123
 Block[224]{4914, 86} 123
 Block[225]{4923, 77} 123
 Block[226]{4892, 108} 123
 Block[227]{4936, 64} 123
 Block[228]{4913, 87} 123
 Block[229]{4911, 89} 123
 Block[230]{4926, 74} 123
 Block[231]{4931, 69} 123
 Block[232]{4930, 70} 123
 Block[233]{4920, 80} 123
 Block[234]{4915, 85} 123
 Block[235]{4925, 75} 123
 Block[236]{4925, 75} 123
 Block[237]{4905, 95} 123
 Block[238]{4927, 73} 123
 Block[239]{4919, 81} 123
 Block[240]{4915, 85} 123
 Block[241]{4921, 79} 123
 Block[242]{4911, 89} 123
 Block[243]{4909, 91} 123
 Block[244]{4921, 79} 123
 Block[245]{4916, 84} 123
 Block[246]{4924, 76} 123
 Block[247]{4921, 79} 123
 Block[248]{4917, 83} 123
 Block[249]{4931, 69} 123
 Block[250]{4914, 86} 123
 Block[251]{4917, 83} 123
 Block[252]{4910, 90} 123
 Block[253]{4921, 79} 123
 Block[254]{4909, 91} 123
 Block[255]{4916, 84} 123
 Block[256]{4923, 77} 123
 Block[257]{4928, 72} 123
 Block[258]{4931, 69} 123
 Block[259]{4936, 64} 123
 Block[260]{4941, 59} 123
 Block[261]{4918, 82} 123
 Block[262]{4912, 88} 123
 Block[263]{4925, 75} 123
 Block[264]{4923, 77} 123
 Block[265]{4944, 56} 123
 Block[266]{4921, 79} 123
 Block[267]{4938, 62} 123
 Block[268]{4918, 82} 123
 Block[269]{4933, 67} 123
 Block[270]{4926, 74} 123
 Block[271]{4919, 81} 123
 Block[272]{4926, 74} 123
 Block[273]{4914, 86} 123
 Block[274]{4912, 88} 123
 Block[275]{4925, 75} 123
 Block[276]{4925, 75} 123
 Block[277]{4927, 73} 123
 Block[278]{4919, 81} 123
 Block[279]{4923, 77} 123
 Block[280]{4927, 73} 123
 Block[281]{4942, 58} 123
 Block[282]{4909, 91} 123
 Block[283]{4928, 72} 123
 Block[284]{4942, 58} 123
 Block[285]{4936, 64} 123
 Block[286]{4928, 72} 123
 Block[287]{4926, 74} 123
 Block[288]{4942, 58} 123
 Block[289]{4924, 76} 123
 Block[290]{4939, 61} 123
 Block[291]{4939, 61} 123
 Block[292]{4928, 72} 123
 Block[293]{4944, 56} 123
 Block[294]{4933, 67} 123
 Block[295]{4927, 73} 123
 Block[296]{4914, 86} 123
 Block[297]{4939, 61} 123
 Block[298]{4932, 68} 123
 Block[299]{4920, 80} 123
 Block[300]{4914, 86} 123
 Block[301]{4921, 79} 123
 Block[302]{4930, 70} 123
 Block[303]{4936, 64} 123
 Block[304]{4931, 69} 123
 Block[305]{4938, 62} 123
 Block[306]{4932, 68} 123
 Block[307]{4922, 78} 123
 Block[308]{4947, 53} 123
 Block[309]{4942, 58} 123
 Block[310]{4918, 82} 123
 Block[311]{4923, 77} 123
 Block[312]{4913, 87} 123
 Block[313]{4919, 81} 123
 Block[314]{4924, 76} 123
 Block[315]{4926, 74} 123
 Block[316]{4916, 84} 123
 Block[317]{4929, 71} 123
 Block[318]{4945, 55} 123
 Block[319]{4929, 71} 123
 Block[320]{4936, 64} 123
 Block[321]{4939, 61} 123
 Block[322]{4920, 80} 123
 Block[323]{4936, 64} 123
 Block[324]{4923, 77} 123
 Block[325]{4943, 57} 123
 Block[326]{4934, 66} 123
 Block[327]{4934, 66} 123
 Block[328]{4927, 73} 123
 Block[329]{4945, 55} 123
 Block[330]{4944, 56} 123
 Block[331]{4932, 68} 123
 Block[332]{4918, 82} 123
 Block[333]{4935, 65} 123
 Block[334]{4928, 72} 123
 Block[335]{4930, 70} 123
 Block[336]{4933, 67} 123
 Block[337]{4923, 77} 123
 Block[338]{4936, 64} 123
 Block[339]{4940, 60} 123
 Block[340]{4924, 76} 123
 Block[341]{4929, 71} 123
 Block[342]{4922, 78} 123
 Block[343]{4936, 64} 123
 Block[344]{4912, 88} 123
 Block[345]{4932, 68} 123
 Block[346]{4942, 58} 123
 Block[347]{4933, 67} 123
 Block[348]{4936, 64} 123
 Block[349]{4931, 69} 123
 Block[350]{4953, 47} 123
 Block[351]{4931, 69} 123
 Block[352]{4943, 57} 123
 Block[353]{4928, 72} 123
 Block[354]{4949, 51} 123
 Block[355]{4926, 74} 123
 Block[356]{4929, 71} 123
 Block[357]{4927, 73} 123
 Block[358]{4945, 55} 123
 Block[359]{4938, 62} 123
 Block[360]{4936, 64} 123
 Block[361]{4949, 51} 123
 Block[362]{4945, 55} 123
 Block[363]{4937, 63} 123
 Block[364]{4926, 74} 123
 Block[365]{4930, 70} 123
 Block[366]{4928, 72} 123
 Block[367]{4935, 65} 123
 Block[368]{4940, 60} 123
 Block[369]{4932, 68} 123
 Block[370]{4950, 50} 123
 Block[371]{4921, 79} 123
 Block[372]{4933, 67} 123
 Block[373]{4923, 77} 123
 Block[374]{4928, 72} 123
 Block[375]{4941, 59} 123
 Block[376]{4921, 79} 123
 Block[377]{4931, 69} 123
 Block[378]{4935, 65} 123
 Block[379]{4937, 63} 123
 Block[380]{4931, 69} 123
 Block[381]{4956, 44} 123
 Block[382]{4944, 56} 123
 Block[383]{4932, 68} 123
 Block[384]{4923, 77} 123
 Block[385]{4942, 58} 123
 Block[386]{4925, 75} 123
 Block[387]{4930, 70} 123
 Block[388]{4930, 70} 123
 Block[389]{4933, 67} 123
 Block[390]{4932, 68} 123
 Block[391]{4932, 68} 123
 Block[392]{4948, 52} 123
 Block[393]{4950, 50} 123
 Block[394]{4931, 69} 123
 Block[395]{4935, 65} 123
 Block[396]{4942, 58} 123
 Block[397]{4948, 52} 123
 Block[398]{4942, 58} 123
 Block[399]{4931, 69} 123
 Block[400]{4936, 64} 123
 Block[401]{4941, 59} 123
 Block[402]{4943, 57} 123
 Block[403]{4942, 58} 123
 Block[404]{4921, 79} 123
 Block[405]{4936, 64} 123
 Block[406]{4941, 59} 123
 Block[407]{4943, 57} 123
 Block[408]{4938, 62} 123
 Block[409]{4941, 59} 123
 Block[410]{4937, 63} 123
 Block[411]{4949, 51} 123
 Block[412]{4939, 61} 123
 Block[413]{4944, 56} 123
 Block[414]{4951, 49} 123
 Block[415]{4932, 68} 123
 Block[416]{4945, 55} 123
 Block[417]{4938, 62} 123
 Block[418]{4951, 49} 123
 Block[419]{4953, 47} 123
 Block[420]{4939, 61} 123
 Block[421]{4939, 61} 123
 Block[422]{4941, 59} 123
 Block[423]{4945, 55} 123
 Block[424]{4940, 60} 123
 Block[425]{4938, 62} 123
 Block[426]{4948, 52} 123
 Block[427]{4929, 71} 123
 Block[428]{4956, 44} 123
 Block[429]{4948, 52} 123
 Block[430]{4940, 60} 123
 Block[431]{4941, 59} 123
 Block[432]{4948, 52} 123
 Block[433]{4937, 63} 123
 Block[434]{4933, 67} 123
 Block[435]{4941, 59} 123
 Block[436]{4935, 65} 123
 Block[437]{4938, 62} 123
 Block[438]{4939, 61} 123
 Block[439]{4957, 43} 123
 Block[440]{4933, 67} 123
 Block[441]{4956, 44} 123
 Block[442]{4938, 62} 123
 Block[443]{4950, 50} 123
 Block[444]{4939, 61} 123
 Block[445]{4945, 55} 123
 Block[446]{4952, 48} 123
 Block[447]{4936, 64} 123
 Block[448]{4946, 54} 123
 Block[449]{4943, 57} 123
 Block[450]{4943, 57} 123
 Block[451]{4948, 52} 123
 Block[452]{4937, 63} 123
 Block[453]{4939, 61} 123
 Block[454]{4946, 54} 123
 Block[455]{4947, 53} 123
 Block[456]{4944, 56} 123
 Block[457]{4949, 51} 123
 Block[458]{4952, 48} 123
 Block[459]{4954, 46} 123
 Block[460]{4955, 45} 123
 Block[461]{4944, 56} 123
 Block[462]{4956, 44} 123
 Block[463]{4948, 52} 123
 Block[464]{4946, 54} 123
 Block[465]{4936, 64} 123
 Block[466]{4934, 66} 123
 Block[467]{4944, 56} 123
 Block[468]{4953, 47} 123
 Block[469]{4952, 48} 123
 Block[470]{4944, 56} 123
 Block[471]{4940, 60} 123
 Block[472]{4941, 59} 123
 Block[473]{4948, 52} 123
 Block[474]{4944, 56} 123
 Block[475]{4946, 54} 123
 Block[476]{4949, 51} 123
 Block[477]{4942, 58} 123
 Block[478]{4941, 59} 123
 Block[479]{4950, 50} 123
 Block[480]{4946, 54} 123
 Block[481]{4950, 50} 123
 Block[482]{4950, 50} 123
 Block[483]{4949, 51} 123
 Block[484]{4939, 61} 123
 Block[485]{4952, 48} 123
 Block[486]{4932, 68} 123
 Block[487]{4948, 52} 123
 Block[488]{4945, 55} 123
 Block[489]{4942, 58} 123
 Block[490]{4955, 45} 123
 Block[491]{4928, 72} 123
 Block[492]{4958, 42} 123
 Block[493]{4939, 61} 123
 Block[494]{4931, 69} 123
 Block[495]{4939, 61} 123
 Block[496]{4944, 56} 123
 Block[497]{4958, 42} 123
 Block[498]{4946, 54} 123
 Block[499]{4955, 45} 123

Learning: 249.191s, Policy update: 1.797s
Calculating deterministic policy... 0.862s
Starting SMC... 1.996s
Thread profiling information
 - Thread[#]{generating, checking, rewarding}
 - Thread[0]{210.218s, 3.902s, 2.727s}
 - Thread[1]{199.893s, 3.605s, 2.792s}
 - Thread[2]{198.099s, 3.85s, 2.485s}
 - Thread[3]{185.866s, 3.836s, 2.465s}
 - Thread[4]{206.351s, 3.952s, 2.59s}
 - Thread[5]{197.576s, 3.565s, 2.416s}
 - Thread[6]{194.342s, 3.712s, 2.353s}
 - Thread[7]{204.72s, 3.644s, 2.443s}
 - Thread[8]{199.481s, 3.87s, 2.41s}
 - Thread[9]{215.94s, 3.885s, 2.65s}
 - Thread[10]{180.286s, 3.718s, 2.463s}
 - Thread[11]{190.622s, 3.731s, 2.31s}
 - Thread[12]{200.584s, 3.67s, 2.499s}
 - Thread[13]{220.286s, 3.976s, 2.642s}
 - Thread[14]{216.738s, 3.918s, 2.542s}
 - Thread[15]{200.941s, 3.717s, 2.778s}
 - Thread[16]{198.992s, 3.793s, 2.638s}
 - Thread[17]{188.53s, 3.598s, 2.393s}
 - Thread[18]{192.125s, 3.748s, 2.537s}
 - Thread[19]{214.499s, 3.986s, 2.49s}
Stopping threads...
*** Hypothesis Testing Results ***
 - Accepted: ALTERNATIVE hypothesis
 - Bayes Factor of: 1000.4073914239439
 - Number of satisfied traces/total number of traces: 4697/4730
 - Policy has 753492 states
 - Total run time: 252.083s
