Enabling debug mode...
Setting history weight to 0.3...
Setting reinforcement at the end of unsuccessful path to 1000... [needs -reward=lastaction]
Setting reinforcement along unsuccessful path to 1... [needs -reward=lastaction]
Setting reinforcement at the end of successful path to 10000... [needs -reward=lastaction]
Setting reinforcement along successful path to 10000... [needs -reward=lastaction]
Setting path reward to Last Action(10000,10000,0,1000)...
Setting policy update to complete count method...
Enabling last action identification for checkpoint formulae...
Setting hypothesis testing probability to 0.99...
Starting threads... 0.025s
Learning...
 Block[#]{# satisfying traces, # falsifying traces}
 Block[0]{4, 4996} 123
 Block[1]{156, 4844} 123
 Block[2]{985, 4015} 123
 Block[3]{2304, 2696} 123
 Block[4]{3172, 1828} 123
 Block[5]{3546, 1454} 123
 Block[6]{3885, 1115} 123
 Block[7]{4002, 998} 123
 Block[8]{4131, 869} 123
 Block[9]{4219, 781} 123
 Block[10]{4325, 675} 123
 Block[11]{4410, 590} 123
 Block[12]{4494, 506} 123
 Block[13]{4601, 399} 123
 Block[14]{4613, 387} 123
 Block[15]{4589, 411} 123
 Block[16]{4653, 347} 123
 Block[17]{4645, 355} 123
 Block[18]{4660, 340} 123
 Block[19]{4743, 257} 123
 Block[20]{4735, 265} 123
 Block[21]{4732, 268} 123
 Block[22]{4715, 285} 123
 Block[23]{4746, 254} 123
 Block[24]{4756, 244} 123
 Block[25]{4766, 234} 123
 Block[26]{4760, 240} 123
 Block[27]{4784, 216} 123
 Block[28]{4771, 229} 123
 Block[29]{4798, 202} 123
 Block[30]{4795, 205} 123
 Block[31]{4797, 203} 123
 Block[32]{4786, 214} 123
 Block[33]{4800, 200} 123
 Block[34]{4798, 202} 123
 Block[35]{4809, 191} 123
 Block[36]{4816, 184} 123
 Block[37]{4831, 169} 123
 Block[38]{4812, 188} 123
 Block[39]{4820, 180} 123
 Block[40]{4818, 182} 123
 Block[41]{4792, 208} 123
 Block[42]{4827, 173} 123
 Block[43]{4825, 175} 123
 Block[44]{4832, 168} 123
 Block[45]{4828, 172} 123
 Block[46]{4819, 181} 123
 Block[47]{4817, 183} 123
 Block[48]{4830, 170} 123
 Block[49]{4801, 199} 123
 Block[50]{4857, 143} 123
 Block[51]{4813, 187} 123
 Block[52]{4823, 177} 123
 Block[53]{4831, 169} 123
 Block[54]{4833, 167} 123
 Block[55]{4811, 189} 123
 Block[56]{4853, 147} 123
 Block[57]{4850, 150} 123
 Block[58]{4856, 144} 123
 Block[59]{4850, 150} 123
 Block[60]{4837, 163} 123
 Block[61]{4813, 187} 123
 Block[62]{4829, 171} 123
 Block[63]{4845, 155} 123
 Block[64]{4845, 155} 123
 Block[65]{4846, 154} 123
 Block[66]{4849, 151} 123
 Block[67]{4844, 156} 123
 Block[68]{4859, 141} 123
 Block[69]{4851, 149} 123
 Block[70]{4845, 155} 123
 Block[71]{4882, 118} 123
 Block[72]{4852, 148} 123
 Block[73]{4878, 122} 123
 Block[74]{4857, 143} 123
 Block[75]{4864, 136} 123
 Block[76]{4854, 146} 123
 Block[77]{4846, 154} 123
 Block[78]{4876, 124} 123
 Block[79]{4861, 139} 123
 Block[80]{4861, 139} 123
 Block[81]{4870, 130} 123
 Block[82]{4879, 121} 123
 Block[83]{4869, 131} 123
 Block[84]{4843, 157} 123
 Block[85]{4867, 133} 123
 Block[86]{4878, 122} 123
 Block[87]{4859, 141} 123
 Block[88]{4857, 143} 123
 Block[89]{4876, 124} 123
 Block[90]{4869, 131} 123
 Block[91]{4864, 136} 123
 Block[92]{4894, 106} 123
 Block[93]{4851, 149} 123
 Block[94]{4871, 129} 123
 Block[95]{4865, 135} 123
 Block[96]{4867, 133} 123
 Block[97]{4872, 128} 123
 Block[98]{4863, 137} 123
 Block[99]{4871, 129} 123
 Block[100]{4856, 144} 123
 Block[101]{4850, 150} 123
 Block[102]{4868, 132} 123
 Block[103]{4877, 123} 123
 Block[104]{4884, 116} 123
 Block[105]{4875, 125} 123
 Block[106]{4883, 117} 123
 Block[107]{4885, 115} 123
 Block[108]{4890, 110} 123
 Block[109]{4878, 122} 123
 Block[110]{4861, 139} 123
 Block[111]{4878, 122} 123
 Block[112]{4874, 126} 123
 Block[113]{4892, 108} 123
 Block[114]{4863, 137} 123
 Block[115]{4864, 136} 123
 Block[116]{4875, 125} 123
 Block[117]{4879, 121} 123
 Block[118]{4883, 117} 123
 Block[119]{4868, 132} 123
 Block[120]{4883, 117} 123
 Block[121]{4874, 126} 123
 Block[122]{4870, 130} 123
 Block[123]{4865, 135} 123
 Block[124]{4896, 104} 123
 Block[125]{4873, 127} 123
 Block[126]{4875, 125} 123
 Block[127]{4867, 133} 123
 Block[128]{4890, 110} 123
 Block[129]{4854, 146} 123
 Block[130]{4883, 117} 123
 Block[131]{4881, 119} 123
 Block[132]{4896, 104} 123
 Block[133]{4877, 123} 123
 Block[134]{4882, 118} 123
 Block[135]{4895, 105} 123
 Block[136]{4891, 109} 123
 Block[137]{4895, 105} 123
 Block[138]{4892, 108} 123
 Block[139]{4883, 117} 123
 Block[140]{4891, 109} 123
 Block[141]{4886, 114} 123
 Block[142]{4891, 109} 123
 Block[143]{4872, 128} 123
 Block[144]{4884, 116} 123
 Block[145]{4881, 119} 123
 Block[146]{4888, 112} 123
 Block[147]{4882, 118} 123
 Block[148]{4875, 125} 123
 Block[149]{4889, 111} 123
 Block[150]{4881, 119} 123
 Block[151]{4894, 106} 123
 Block[152]{4869, 131} 123
 Block[153]{4886, 114} 123
 Block[154]{4867, 133} 123
 Block[155]{4899, 101} 123
 Block[156]{4888, 112} 123
 Block[157]{4882, 118} 123
 Block[158]{4885, 115} 123
 Block[159]{4887, 113} 123
 Block[160]{4895, 105} 123
 Block[161]{4888, 112} 123
 Block[162]{4869, 131} 123
 Block[163]{4890, 110} 123
 Block[164]{4877, 123} 123
 Block[165]{4872, 128} 123
 Block[166]{4887, 113} 123
 Block[167]{4880, 120} 123
 Block[168]{4900, 100} 123
 Block[169]{4888, 112} 123
 Block[170]{4892, 108} 123
 Block[171]{4867, 133} 123
 Block[172]{4869, 131} 123
 Block[173]{4884, 116} 123
 Block[174]{4897, 103} 123
 Block[175]{4895, 105} 123
 Block[176]{4902, 98} 123
 Block[177]{4890, 110} 123
 Block[178]{4886, 114} 123
 Block[179]{4892, 108} 123
 Block[180]{4878, 122} 123
 Block[181]{4888, 112} 123
 Block[182]{4889, 111} 123
 Block[183]{4906, 94} 123
 Block[184]{4911, 89} 123
 Block[185]{4896, 104} 123
 Block[186]{4901, 99} 123
 Block[187]{4916, 84} 123
 Block[188]{4913, 87} 123
 Block[189]{4903, 97} 123
 Block[190]{4911, 89} 123
 Block[191]{4886, 114} 123
 Block[192]{4888, 112} 123
 Block[193]{4910, 90} 123
 Block[194]{4873, 127} 123
 Block[195]{4903, 97} 123
 Block[196]{4899, 101} 123
 Block[197]{4881, 119} 123
 Block[198]{4898, 102} 123
 Block[199]{4911, 89} 123
 Block[200]{4904, 96} 123
 Block[201]{4906, 94} 123
 Block[202]{4897, 103} 123
 Block[203]{4899, 101} 123
 Block[204]{4910, 90} 123
 Block[205]{4891, 109} 123
 Block[206]{4902, 98} 123
 Block[207]{4903, 97} 123
 Block[208]{4888, 112} 123
 Block[209]{4907, 93} 123
 Block[210]{4885, 115} 123
 Block[211]{4900, 100} 123
 Block[212]{4906, 94} 123
 Block[213]{4897, 103} 123
 Block[214]{4909, 91} 123
 Block[215]{4892, 108} 123
 Block[216]{4899, 101} 123
 Block[217]{4918, 82} 123
 Block[218]{4895, 105} 123
 Block[219]{4900, 100} 123
 Block[220]{4897, 103} 123
 Block[221]{4913, 87} 123
 Block[222]{4899, 101} 123
 Block[223]{4905, 95} 123
 Block[224]{4909, 91} 123
 Block[225]{4896, 104} 123
 Block[226]{4918, 82} 123
 Block[227]{4916, 84} 123
 Block[228]{4908, 92} 123
 Block[229]{4890, 110} 123
 Block[230]{4914, 86} 123
 Block[231]{4890, 110} 123
 Block[232]{4878, 122} 123
 Block[233]{4897, 103} 123
 Block[234]{4908, 92} 123
 Block[235]{4886, 114} 123
 Block[236]{4905, 95} 123
 Block[237]{4913, 87} 123
 Block[238]{4910, 90} 123
 Block[239]{4888, 112} 123
 Block[240]{4927, 73} 123
 Block[241]{4906, 94} 123
 Block[242]{4916, 84} 123
 Block[243]{4922, 78} 123
 Block[244]{4907, 93} 123
 Block[245]{4908, 92} 123
 Block[246]{4901, 99} 123
 Block[247]{4911, 89} 123
 Block[248]{4918, 82} 123
 Block[249]{4901, 99} 123
 Block[250]{4919, 81} 123
 Block[251]{4901, 99} 123
 Block[252]{4909, 91} 123
 Block[253]{4905, 95} 123
 Block[254]{4913, 87} 123
 Block[255]{4923, 77} 123
 Block[256]{4913, 87} 123
 Block[257]{4913, 87} 123
 Block[258]{4905, 95} 123
 Block[259]{4912, 88} 123
 Block[260]{4919, 81} 123
 Block[261]{4906, 94} 123
 Block[262]{4898, 102} 123
 Block[263]{4900, 100} 123
 Block[264]{4927, 73} 123
 Block[265]{4914, 86} 123
 Block[266]{4905, 95} 123
 Block[267]{4913, 87} 123
 Block[268]{4892, 108} 123
 Block[269]{4903, 97} 123
 Block[270]{4923, 77} 123
 Block[271]{4908, 92} 123
 Block[272]{4898, 102} 123
 Block[273]{4900, 100} 123
 Block[274]{4907, 93} 123
 Block[275]{4910, 90} 123
 Block[276]{4897, 103} 123
 Block[277]{4929, 71} 123
 Block[278]{4904, 96} 123
 Block[279]{4909, 91} 123
 Block[280]{4919, 81} 123
 Block[281]{4898, 102} 123
 Block[282]{4911, 89} 123
 Block[283]{4907, 93} 123
 Block[284]{4913, 87} 123
 Block[285]{4911, 89} 123
 Block[286]{4919, 81} 123
 Block[287]{4903, 97} 123
 Block[288]{4923, 77} 123
 Block[289]{4901, 99} 123
 Block[290]{4911, 89} 123
 Block[291]{4913, 87} 123
 Block[292]{4917, 83} 123
 Block[293]{4922, 78} 123
 Block[294]{4917, 83} 123
 Block[295]{4901, 99} 123
 Block[296]{4904, 96} 123
 Block[297]{4914, 86} 123
 Block[298]{4925, 75} 123
 Block[299]{4931, 69} 123
 Block[300]{4930, 70} 123
 Block[301]{4911, 89} 123
 Block[302]{4896, 104} 123
 Block[303]{4913, 87} 123
 Block[304]{4900, 100} 123
 Block[305]{4908, 92} 123
 Block[306]{4920, 80} 123
 Block[307]{4933, 67} 123
 Block[308]{4924, 76} 123
 Block[309]{4908, 92} 123
 Block[310]{4911, 89} 123
 Block[311]{4926, 74} 123
 Block[312]{4923, 77} 123
 Block[313]{4909, 91} 123
 Block[314]{4924, 76} 123
 Block[315]{4912, 88} 123
 Block[316]{4927, 73} 123
 Block[317]{4919, 81} 123
 Block[318]{4914, 86} 123
 Block[319]{4905, 95} 123
 Block[320]{4927, 73} 123
 Block[321]{4910, 90} 123
 Block[322]{4914, 86} 123
 Block[323]{4918, 82} 123
 Block[324]{4907, 93} 123
 Block[325]{4906, 94} 123
 Block[326]{4913, 87} 123
 Block[327]{4925, 75} 123
 Block[328]{4916, 84} 123
 Block[329]{4910, 90} 123
 Block[330]{4925, 75} 123
 Block[331]{4944, 56} 123
 Block[332]{4931, 69} 123
 Block[333]{4916, 84} 123
 Block[334]{4920, 80} 123
 Block[335]{4925, 75} 123
 Block[336]{4925, 75} 123
 Block[337]{4914, 86} 123
 Block[338]{4933, 67} 123
 Block[339]{4921, 79} 123
 Block[340]{4929, 71} 123
 Block[341]{4912, 88} 123
 Block[342]{4914, 86} 123
 Block[343]{4919, 81} 123
 Block[344]{4934, 66} 123
 Block[345]{4923, 77} 123
 Block[346]{4937, 63} 123
 Block[347]{4920, 80} 123
 Block[348]{4918, 82} 123
 Block[349]{4933, 67} 123
 Block[350]{4937, 63} 123
 Block[351]{4921, 79} 123
 Block[352]{4928, 72} 123
 Block[353]{4926, 74} 123
 Block[354]{4922, 78} 123
 Block[355]{4925, 75} 123
 Block[356]{4925, 75} 123
 Block[357]{4929, 71} 123
 Block[358]{4931, 69} 123
 Block[359]{4919, 81} 123
 Block[360]{4908, 92} 123
 Block[361]{4940, 60} 123
 Block[362]{4918, 82} 123
 Block[363]{4925, 75} 123
 Block[364]{4918, 82} 123
 Block[365]{4931, 69} 123
 Block[366]{4915, 85} 123
 Block[367]{4928, 72} 123
 Block[368]{4914, 86} 123
 Block[369]{4914, 86} 123
 Block[370]{4933, 67} 123
 Block[371]{4924, 76} 123
 Block[372]{4916, 84} 123
 Block[373]{4929, 71} 123
 Block[374]{4927, 73} 123
 Block[375]{4938, 62} 123
 Block[376]{4912, 88} 123
 Block[377]{4923, 77} 123
 Block[378]{4923, 77} 123
 Block[379]{4936, 64} 123
 Block[380]{4930, 70} 123
 Block[381]{4933, 67} 123
 Block[382]{4924, 76} 123
 Block[383]{4939, 61} 123
 Block[384]{4938, 62} 123
 Block[385]{4937, 63} 123
 Block[386]{4925, 75} 123
 Block[387]{4918, 82} 123
 Block[388]{4918, 82} 123
 Block[389]{4930, 70} 123
 Block[390]{4927, 73} 123
 Block[391]{4942, 58} 123
 Block[392]{4932, 68} 123
 Block[393]{4944, 56} 123
 Block[394]{4926, 74} 123
 Block[395]{4934, 66} 123
 Block[396]{4913, 87} 123
 Block[397]{4930, 70} 123
 Block[398]{4923, 77} 123
 Block[399]{4945, 55} 123
 Block[400]{4923, 77} 123
 Block[401]{4923, 77} 123
 Block[402]{4941, 59} 123
 Block[403]{4930, 70} 123
 Block[404]{4920, 80} 123
 Block[405]{4925, 75} 123
 Block[406]{4925, 75} 123
 Block[407]{4932, 68} 123
 Block[408]{4930, 70} 123
 Block[409]{4920, 80} 123
 Block[410]{4930, 70} 123
 Block[411]{4931, 69} 123
 Block[412]{4916, 84} 123
 Block[413]{4929, 71} 123
 Block[414]{4929, 71} 123
 Block[415]{4924, 76} 123
 Block[416]{4934, 66} 123
 Block[417]{4947, 53} 123
 Block[418]{4911, 89} 123
 Block[419]{4937, 63} 123
 Block[420]{4938, 62} 123
 Block[421]{4936, 64} 123
 Block[422]{4923, 77} 123
 Block[423]{4934, 66} 123
 Block[424]{4934, 66} 123
 Block[425]{4935, 65} 123
 Block[426]{4931, 69} 123
 Block[427]{4937, 63} 123
 Block[428]{4913, 87} 123
 Block[429]{4938, 62} 123
 Block[430]{4934, 66} 123
 Block[431]{4926, 74} 123
 Block[432]{4925, 75} 123
 Block[433]{4926, 74} 123
 Block[434]{4927, 73} 123
 Block[435]{4933, 67} 123
 Block[436]{4932, 68} 123
 Block[437]{4930, 70} 123
 Block[438]{4916, 84} 123
 Block[439]{4934, 66} 123
 Block[440]{4938, 62} 123
 Block[441]{4936, 64} 123
 Block[442]{4934, 66} 123
 Block[443]{4932, 68} 123
 Block[444]{4921, 79} 123
 Block[445]{4916, 84} 123
 Block[446]{4925, 75} 123
 Block[447]{4941, 59} 123
 Block[448]{4936, 64} 123
 Block[449]{4933, 67} 123
 Block[450]{4935, 65} 123
 Block[451]{4947, 53} 123
 Block[452]{4918, 82} 123
 Block[453]{4943, 57} 123
 Block[454]{4921, 79} 123
 Block[455]{4937, 63} 123
 Block[456]{4940, 60} 123
 Block[457]{4928, 72} 123
 Block[458]{4933, 67} 123
 Block[459]{4937, 63} 123
 Block[460]{4922, 78} 123
 Block[461]{4930, 70} 123
 Block[462]{4936, 64} 123
 Block[463]{4945, 55} 123
 Block[464]{4939, 61} 123
 Block[465]{4946, 54} 123
 Block[466]{4945, 55} 123
 Block[467]{4942, 58} 123
 Block[468]{4928, 72} 123
 Block[469]{4941, 59} 123
 Block[470]{4948, 52} 123
 Block[471]{4925, 75} 123
 Block[472]{4932, 68} 123
 Block[473]{4921, 79} 123
 Block[474]{4938, 62} 123
 Block[475]{4946, 54} 123
 Block[476]{4936, 64} 123
 Block[477]{4938, 62} 123
 Block[478]{4939, 61} 123
 Block[479]{4943, 57} 123
 Block[480]{4950, 50} 123
 Block[481]{4952, 48} 123
 Block[482]{4936, 64} 123
 Block[483]{4937, 63} 123
 Block[484]{4929, 71} 123
 Block[485]{4923, 77} 123
 Block[486]{4939, 61} 123
 Block[487]{4925, 75} 123
 Block[488]{4931, 69} 123
 Block[489]{4936, 64} 123
 Block[490]{4947, 53} 123
 Block[491]{4939, 61} 123
 Block[492]{4938, 62} 123
 Block[493]{4946, 54} 123
 Block[494]{4943, 57} 123
 Block[495]{4938, 62} 123
 Block[496]{4940, 60} 123
 Block[497]{4945, 55} 123
 Block[498]{4952, 48} 123
 Block[499]{4938, 62} 123

Learning: 239.357s, Policy update: 1.888s
Calculating deterministic policy... 0.947s
Starting SMC... 38.722s
Thread profiling information
 - Thread[#]{generating, checking, rewarding}
 - Thread[0]{178.913s, 3.606s, 2.294s}
 - Thread[1]{175.324s, 3.561s, 2.36s}
 - Thread[2]{175.786s, 3.535s, 2.268s}
 - Thread[3]{184.665s, 3.698s, 2.226s}
 - Thread[4]{188.036s, 3.728s, 2.298s}
 - Thread[5]{209.677s, 3.746s, 2.749s}
 - Thread[6]{210.183s, 3.824s, 2.687s}
 - Thread[7]{167.33s, 3.45s, 2.4s}
 - Thread[8]{174.721s, 3.344s, 2.227s}
 - Thread[9]{195.876s, 3.652s, 2.532s}
 - Thread[10]{215.583s, 3.868s, 2.592s}
 - Thread[11]{173.787s, 3.601s, 2.303s}
 - Thread[12]{208.545s, 3.828s, 2.636s}
 - Thread[13]{165.765s, 3.308s, 2.313s}
 - Thread[14]{209.334s, 3.862s, 2.694s}
 - Thread[15]{218.688s, 3.881s, 2.481s}
 - Thread[16]{213.837s, 3.827s, 2.644s}
 - Thread[17]{183.153s, 3.67s, 2.253s}
 - Thread[18]{172.114s, 3.526s, 2.194s}
 - Thread[19]{171.801s, 3.448s, 2.302s}
Stopping threads...
*** Hypothesis Testing Results ***
 - Accepted: NULL hypothesis
 - Bayes Factor of: 0.28037394359751294
 - Number of satisfied traces/total number of traces: 98934/100000
 - Policy has 768688 states
 - Total run time: 279.054s
