深度学习框架tensorflow实战（构建完整Cifar分类模型）

提前了解~~

tensorflow中的LRN函数详解：https://blog.csdn.net/banana1006034246/article/details/75204013

基于前面的分析，可以比较深刻地掌握了神经网络的含义了，现在我们构建一个完整的Cifar分类模型，前提是得用前面那份博客把我们获得的RGB图像转化为灰度图像并且将其缩小到24乘以24

设置参数

x = tf.placeholder(tf.float32, [None, 24 * 24]) y = tf.placeholder(tf.float32, [None, len(names)]) W1 = tf.Variable(tf.random_normal([5, 5, 1, 64])) #设置第一层卷积层参数，卷积核大小 b1 = tf.Variable(tf.random_normal([64])) W2 = tf.Variable(tf.random_normal([5, 5, 64, 64])) #设置第一层卷积层参数，卷积核大小 b2 = tf.Variable(tf.random_normal([64])) W3 = tf.Variable(tf.random_normal([6*6*64, 1024])) #接下来两个全连接层 b3 = tf.Variable(tf.random_normal([1024])) W_out = tf.Variable(tf.random_normal([1024, len(names)])) b_out = tf.Variable(tf.random_normal([len(names)]))

卷积函数和池化函数

def conv_layer(x, W, b): conv = tf.nn.conv2d(x, W, strides=[1, 1, 1, 1], padding='SAME') conv_with_b = tf.nn.bias_add(conv, b) conv_out = tf.nn.relu(conv_with_b) return conv_out def maxpool_layer(conv, k=2): return tf.nn.max_pool(conv, ksize=[1, k, k, 1], strides=[1, k, k, 1], padding='SAME')

把上面的参数和函数集合到该模型当中

def model(): x_reshaped = tf.reshape(x, shape=[-1, 24, 24, 1]) #把x转换一下 conv_out1 = conv_layer(x_reshaped, W1, b1) maxpool_out1 = maxpool_layer(conv_out1) #提出了LRN层，对局部神经元的活动创建竞争机制，使得其中响应比较大的值变得相对更大，并抑制其他反馈较小的神经元，增强了模型的泛化能力。 #推荐阅读http://blog.csdn.net/banana1006034246/article/details/75204013 norm1 = tf.nn.lrn(maxpool_out1, 4, bias=1.0, alpha=0.001 / 9.0, beta=0.75) conv_out2 = conv_layer(norm1, W2, b2) norm2 = tf.nn.lrn(conv_out2, 4, bias=1.0, alpha=0.001 / 9.0, beta=0.75) maxpool_out2 = maxpool_layer(norm2) maxpool_reshaped = tf.reshape(maxpool_out2, [-1, W3.get_shape().as_list()[0]]) local = tf.add(tf.matmul(maxpool_reshaped, W3), b3) local_out = tf.nn.relu(local) out = tf.add(tf.matmul(local_out, W_out), b_out) return out

计算最少损失

learning_rate = 0.001 model_op = model() cost = tf.reduce_mean( tf.nn.softmax_cross_entropy_with_logits(logits=model_op, labels=y) ) train_op = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost) correct_pred = tf.equal(tf.argmax(model_op, 1), tf.argmax(y, 1)) accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32))

执行

有个地方需要注意，因为minst数据集获取标签时就用了one_hot编码，但Cifar不是，所以我们得调用one_hot函数

with tf.Session() as sess: sess.run(tf.global_variables_initializer()) onehot_labels = tf.one_hot(labels, len(names), axis=-1) olearning_rate = 0.001 model_op = model() cost = tf.reduce_mean( tf.nn.softmax_cross_entropy_with_logits(logits=model_op, labels=y) ) train_op = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost) correct_pred = tf.equal(tf.argmax(model_op, 1), tf.argmax(y, 1)) accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32))nehot_vals = sess.run(onehot_labels) batch_size = 64 print('batch size', batch_size) for j in range(0, 1000): avg_accuracy_val = 0. batch_count = 0. for i in range(0, len(data), batch_size): batch_data = data[i:i+batch_size, :] batch_onehot_vals = onehot_vals[i:i+batch_size, :] _, accuracy_val = sess.run([train_op, accuracy], feed_dict={x: batch_data, y: batch_onehot_vals}) avg_accuracy_val += accuracy_val batch_count += 1. avg_accuracy_val /= batch_count print('Epoch {}. Avg accuracy {}'.format(j, avg_accuracy_val))

输出~~~~

建议没有GPU的不用轻易尝试，我用的是学校的阿里云服务器特斯拉的都跑了差不多1个多小时~~~~

batch size 64 Epoch 0. Avg accuracy 0.22490409207161124 Epoch 1. Avg accuracy 0.27775335677749363 Epoch 2. Avg accuracy 0.2989530051150895 Epoch 3. Avg accuracy 0.31140105498721227 Epoch 4. Avg accuracy 0.32366927749360613 Epoch 5. Avg accuracy 0.33122202685422 Epoch 6. Avg accuracy 0.3412523976982097 Epoch 7. Avg accuracy 0.3487052429667519 Epoch 8. Avg accuracy 0.3607336956521739 Epoch 9. Avg accuracy 0.36429028132992325 Epoch 10. Avg accuracy 0.36850623401534527 Epoch 11. Avg accuracy 0.3734015345268542 Epoch 12. Avg accuracy 0.38141384271099743 Epoch 13. Avg accuracy 0.38726822250639387 Epoch 14. Avg accuracy 0.39022538363171355 Epoch 15. Avg accuracy 0.39570012787723785 Epoch 16. Avg accuracy 0.40017583120204603 Epoch 17. Avg accuracy 0.39981617647058826 Epoch 18. Avg accuracy 0.40513107416879796 Epoch 19. Avg accuracy 0.4108855498721228 Epoch 20. Avg accuracy 0.4133232097186701 Epoch 21. Avg accuracy 0.4110453964194373 Epoch 22. Avg accuracy 0.4207960358056266 Epoch 23. Avg accuracy 0.4186580882352941 Epoch 24. Avg accuracy 0.42225463554987214 Epoch 25. Avg accuracy 0.4290281329923274 Epoch 26. Avg accuracy 0.43548193734015345 Epoch 27. Avg accuracy 0.44027733375959077 Epoch 28. Avg accuracy 0.42764945652173914 Epoch 29. Avg accuracy 0.4374800191815857 Epoch 30. Avg accuracy 0.4466512148337596 Epoch 31. Avg accuracy 0.434522858056266 Epoch 32. Avg accuracy 0.4510669757033248 Epoch 33. Avg accuracy 0.45674152813299235 Epoch 34. Avg accuracy 0.45522298593350385 Epoch 35. Avg accuracy 0.46537324168797956 Epoch 36. Avg accuracy 0.4524656329923274 Epoch 37. Avg accuracy 0.4618566176470588 Epoch 38. Avg accuracy 0.46351502557544755 Epoch 39. Avg accuracy 0.46525335677749363 Epoch 40. Avg accuracy 0.47306585677749363 Epoch 41. Avg accuracy 0.4679108056265985 Epoch 42. Avg accuracy 0.4765824808184143 Epoch 43. Avg accuracy 0.47991927749360613 Epoch 44. Avg accuracy 0.4804587595907928 Epoch 45. Avg accuracy 0.47346547314578 Epoch 46. Avg accuracy 0.48137787723785164 Epoch 47. Avg accuracy 0.48399536445012786 Epoch 48. Avg accuracy 0.4804787404092072 Epoch 49. Avg accuracy 0.49116847826086957 Epoch 50. Avg accuracy 0.4843350383631714 Epoch 51. Avg accuracy 0.48235693734015345 Epoch 52. Avg accuracy 0.4981218030690537 Epoch 53. Avg accuracy 0.4986413043478261 Epoch 54. Avg accuracy 0.4774016943734015 Epoch 55. Avg accuracy 0.4991008631713555 Epoch 56. Avg accuracy 0.5031369884910486 Epoch 57. Avg accuracy 0.500619405370844 Epoch 58. Avg accuracy 0.5092511189258312 Epoch 59. Avg accuracy 0.49896099744245526 Epoch 60. Avg accuracy 0.5146259590792839 Epoch 61. Avg accuracy 0.5047354539641944 Epoch 62. Avg accuracy 0.515744884910486 Epoch 63. Avg accuracy 0.5180027173913043 Epoch 64. Avg accuracy 0.5110893542199488 Epoch 65. Avg accuracy 0.5235174232736572 Epoch 66. Avg accuracy 0.5140864769820972 Epoch 67. Avg accuracy 0.5028172953964194 Epoch 68. Avg accuracy 0.5198809143222506 Epoch 69. Avg accuracy 0.5236373081841432 Epoch 70. Avg accuracy 0.5264945652173914 Epoch 71. Avg accuracy 0.5260150255754475 Epoch 72. Avg accuracy 0.5228980179028133 Epoch 73. Avg accuracy 0.5283128196930946 Epoch 74. Avg accuracy 0.5162044437340153 Epoch 75. Avg accuracy 0.5286125319693095 Epoch 76. Avg accuracy 0.5278932225063938 Epoch 77. Avg accuracy 0.5375439578005116 Epoch 78. Avg accuracy 0.5293118606138107 Epoch 79. Avg accuracy 0.5470348465473146 Epoch 80. Avg accuracy 0.5332680626598465 Epoch 81. Avg accuracy 0.5315696930946292 Epoch 82. Avg accuracy 0.5439977621483376 Epoch 83. Avg accuracy 0.5269341432225064 Epoch 84. Avg accuracy 0.5242167519181585 Epoch 85. Avg accuracy 0.541979699488491 Epoch 86. Avg accuracy 0.5350663363171355 Epoch 87. Avg accuracy 0.5439977621483376 Epoch 88. Avg accuracy 0.5310102301790282 Epoch 89. Avg accuracy 0.550411604859335 Epoch 90. Avg accuracy 0.5494725063938619 Epoch 91. Avg accuracy 0.5461357097186701 Epoch 92. Avg accuracy 0.5410805626598465 Epoch 93. Avg accuracy 0.5503117007672634 Epoch 94. Avg accuracy 0.5590233375959079 Epoch 95. Avg accuracy 0.5428588554987213 Epoch 96. Avg accuracy 0.5467351342710998 Epoch 97. Avg accuracy 0.5483935421994884 Epoch 98. Avg accuracy 0.5535485933503836 Epoch 99. Avg accuracy 0.5514506074168798 Epoch 100. Avg accuracy 0.5509311061381074 Epoch 101. Avg accuracy 0.5517902813299232 Epoch 102. Avg accuracy 0.5665561061381074 Epoch 103. Avg accuracy 0.5545076726342711 Epoch 104. Avg accuracy 0.5601622442455243 Epoch 105. Avg accuracy 0.5585437979539642 Epoch 106. Avg accuracy 0.5573249680306905 Epoch 107. Avg accuracy 0.560082320971867 Epoch 108. Avg accuracy 0.5726702365728901 Epoch 109. Avg accuracy 0.5640784846547314 Epoch 110. Avg accuracy 0.5710717710997443 Epoch 111. Avg accuracy 0.5713515025575447 Epoch 112. Avg accuracy 0.5562859654731458 Epoch 113. Avg accuracy 0.5795835997442456 Epoch 114. Avg accuracy 0.5875759271099744 Epoch 115. Avg accuracy 0.5723105818414322 Epoch 116. Avg accuracy 0.5725303708439897 Epoch 117. Avg accuracy 0.5573849104859335 Epoch 118. Avg accuracy 0.5637787723785166 Epoch 119. Avg accuracy 0.5639386189258312 Epoch 120. Avg accuracy 0.5670955882352942 Epoch 121. Avg accuracy 0.5741088554987213 Epoch 122. Avg accuracy 0.5622202685421995 Epoch 123. Avg accuracy 0.5602821291560103 Epoch 124. Avg accuracy 0.5689937659846548 Epoch 125. Avg accuracy 0.5869565217391305 Epoch 126. Avg accuracy 0.590832800511509 Epoch 127. Avg accuracy 0.5965473145780051 Epoch 128. Avg accuracy 0.609315057544757 Epoch 129. Avg accuracy 0.59375 Epoch 130. Avg accuracy 0.5974264705882353 Epoch 131. Avg accuracy 0.598405530690537 Epoch 132. Avg accuracy 0.5826007033248082 Epoch 133. Avg accuracy 0.5710717710997443 Epoch 134. Avg accuracy 0.5843989769820972 Epoch 135. Avg accuracy 0.5838794757033248 Epoch 136. Avg accuracy 0.5835797634271099 Epoch 137. Avg accuracy 0.5700927109974424 Epoch 138. Avg accuracy 0.5718909846547314 Epoch 139. Avg accuracy 0.5796835038363172 Epoch 140. Avg accuracy 0.5815816815856778 Epoch 141. Avg accuracy 0.5768462276214834 Epoch 142. Avg accuracy 0.585378037084399 Epoch 143. Avg accuracy 0.5873161764705882 Epoch 144. Avg accuracy 0.5828604539641944 Epoch 145. Avg accuracy 0.5869365409207161 Epoch 146. Avg accuracy 0.6005634590792839 Epoch 147. Avg accuracy 0.5995244565217391 Epoch 148. Avg accuracy 0.5994245524296675 Epoch 149. Avg accuracy 0.6058184143222506 Epoch 150. Avg accuracy 0.6165880754475703 Epoch 151. Avg accuracy 0.6157688618925832 Epoch 152. Avg accuracy 0.6254395780051151 Epoch 153. Avg accuracy 0.6240009590792839 Epoch 154. Avg accuracy 0.617247442455243 Epoch 155. Avg accuracy 0.6137707800511509 Epoch 156. Avg accuracy 0.6088954603580563 Epoch 157. Avg accuracy 0.6104339833759591 Epoch 158. Avg accuracy 0.6035206202046036 Epoch 159. Avg accuracy 0.5892543158567775 Epoch 160. Avg accuracy 0.595488331202046 Epoch 161. Avg accuracy 0.5950287723785166 Epoch 162. Avg accuracy 0.6003436700767263 Epoch 163. Avg accuracy 0.5961277173913043 Epoch 164. Avg accuracy 0.5968070652173914 Epoch 165. Avg accuracy 0.5902533567774936 Epoch 166. Avg accuracy 0.6015425191815856 Epoch 167. Avg accuracy 0.6011628836317136 Epoch 168. Avg accuracy 0.6020820012787724 Epoch 169. Avg accuracy 0.6065776854219949 Epoch 170. Avg accuracy 0.609375 Epoch 171. Avg accuracy 0.6276774296675192 Epoch 172. Avg accuracy 0.6270580242966752 Epoch 173. Avg accuracy 0.6336916560102301 Epoch 174. Avg accuracy 0.6470987851662404 Epoch 175. Avg accuracy 0.6355698529411765 Epoch 176. Avg accuracy 0.6402054028132992 Epoch 177. Avg accuracy 0.6507952365728901 Epoch 178. Avg accuracy 0.6439617966751918 Epoch 179. Avg accuracy 0.6319733056265985 Epoch 180. Avg accuracy 0.618546195652174 Epoch 181. Avg accuracy 0.6065976662404092 Epoch 182. Avg accuracy 0.6071371483375959 Epoch 183. Avg accuracy 0.6005434782608695 Epoch 184. Avg accuracy 0.6104140025575447 Epoch 185. Avg accuracy 0.6104339833759591 Epoch 186. Avg accuracy 0.611173273657289 Epoch 187. Avg accuracy 0.6142503196930946 Epoch 188. Avg accuracy 0.6138906649616368 Epoch 189. Avg accuracy 0.632193094629156 Epoch 190. Avg accuracy 0.6287164322250639 Epoch 191. Avg accuracy 0.6320132672634271 Epoch 192. Avg accuracy 0.6311740728900256 Epoch 193. Avg accuracy 0.6349704283887468 Epoch 194. Avg accuracy 0.6411445012787724 Epoch 195. Avg accuracy 0.6335118286445013 Epoch 196. Avg accuracy 0.6340712915601023 Epoch 197. Avg accuracy 0.6138107416879796 Epoch 198. Avg accuracy 0.6123121803069054 Epoch 199. Avg accuracy 0.617806905370844 Epoch 200. Avg accuracy 0.6156689578005116 Epoch 201. Avg accuracy 0.6269181585677749 Epoch 202. Avg accuracy 0.6240409207161125 Epoch 203. Avg accuracy 0.631573689258312 Epoch 204. Avg accuracy 0.6351302749360613 Epoch 205. Avg accuracy 0.645280530690537 Epoch 206. Avg accuracy 0.6442015664961637 Epoch 207. Avg accuracy 0.6371283567774936 Epoch 208. Avg accuracy 0.620344469309463 Epoch 209. Avg accuracy 0.6240808823529411 Epoch 210. Avg accuracy 0.6264785805626598 Epoch 211. Avg accuracy 0.6209039322250639 Epoch 212. Avg accuracy 0.6339314258312021 Epoch 213. Avg accuracy 0.631633631713555 Epoch 214. Avg accuracy 0.6295356457800512 Epoch 215. Avg accuracy 0.6275375639386189 Epoch 216. Avg accuracy 0.6333120204603581 Epoch 217. Avg accuracy 0.6401054987212276 Epoch 218. Avg accuracy 0.6479179987212276 Epoch 219. Avg accuracy 0.6596467391304348 Epoch 220. Avg accuracy 0.6792878836317136 Epoch 221. Avg accuracy 0.6762907608695652 Epoch 222. Avg accuracy 0.6833240089514067 Epoch 223. Avg accuracy 0.6756114130434783 Epoch 224. Avg accuracy 0.6782488810741688 Epoch 225. Avg accuracy 0.674292679028133 Epoch 226. Avg accuracy 0.6714554028132992 Epoch 227. Avg accuracy 0.677949168797954 Epoch 228. Avg accuracy 0.665800831202046 Epoch 229. Avg accuracy 0.6647018861892583 Epoch 230. Avg accuracy 0.666480179028133 Epoch 231. Avg accuracy 0.6563499040920716 Epoch 232. Avg accuracy 0.6477381713554987 Epoch 233. Avg accuracy 0.6436820652173914 Epoch 234. Avg accuracy 0.6435222186700768 Epoch 235. Avg accuracy 0.6439617966751918 Epoch 236. Avg accuracy 0.649676310741688 Epoch 237. Avg accuracy 0.637088395140665 Epoch 238. Avg accuracy 0.6429028132992327 Epoch 239. Avg accuracy 0.6560901534526854 Epoch 240. Avg accuracy 0.6591871803069054 Epoch 241. Avg accuracy 0.670196611253197 Epoch 242. Avg accuracy 0.6769101662404092 Epoch 243. Avg accuracy 0.6869205562659847 Epoch 244. Avg accuracy 0.691775895140665 Epoch 245. Avg accuracy 0.700207800511509 Epoch 246. Avg accuracy 0.7060821611253197 Epoch 247. Avg accuracy 0.6986093350383632 Epoch 248. Avg accuracy 0.6889186381074168 Epoch 249. Avg accuracy 0.6982696611253197 Epoch 250. Avg accuracy 0.6936141304347826 Epoch 251. Avg accuracy 0.6832440856777494 Epoch 252. Avg accuracy 0.6726542519181585 Epoch 253. Avg accuracy 0.6722546355498721 Epoch 254. Avg accuracy 0.6681985294117647 Epoch 255. Avg accuracy 0.6565497122762148 Epoch 256. Avg accuracy 0.6546515345268542 Epoch 257. Avg accuracy 0.6467790920716112 Epoch 258. Avg accuracy 0.6450207800511509 Epoch 259. Avg accuracy 0.6571091751918159 Epoch 260. Avg accuracy 0.6633232097186701 Epoch 261. Avg accuracy 0.6742527173913043 Epoch 262. Avg accuracy 0.6753716432225064 Epoch 263. Avg accuracy 0.6800471547314578 Epoch 264. Avg accuracy 0.6872202685421995 Epoch 265. Avg accuracy 0.691656010230179 Epoch 266. Avg accuracy 0.6975503516624041 Epoch 267. Avg accuracy 0.6962715792838875 Epoch 268. Avg accuracy 0.6977101982097187 Epoch 269. Avg accuracy 0.7089993606138107 Epoch 270. Avg accuracy 0.7098984974424553 Epoch 271. Avg accuracy 0.715712915601023 Epoch 272. Avg accuracy 0.7183703644501279 Epoch 273. Avg accuracy 0.7098185741687979 Epoch 274. Avg accuracy 0.6996882992327366 Epoch 275. Avg accuracy 0.6863011508951407 Epoch 276. Avg accuracy 0.66244405370844 Epoch 277. Avg accuracy 0.6550911125319693 Epoch 278. Avg accuracy 0.6620644181585678 Epoch 279. Avg accuracy 0.6663602941176471 Epoch 280. Avg accuracy 0.6712955562659847 Epoch 281. Avg accuracy 0.6801670396419437 Epoch 282. Avg accuracy 0.6920556265984654 Epoch 283. Avg accuracy 0.6983895460358056 Epoch 284. Avg accuracy 0.6994085677749361 Epoch 285. Avg accuracy 0.7051230818414322 Epoch 286. Avg accuracy 0.7120164641943734 Epoch 287. Avg accuracy 0.7140545076726342 Epoch 288. Avg accuracy 0.7159127237851662 Epoch 289. Avg accuracy 0.7167319373401535 Epoch 290. Avg accuracy 0.7190297314578005 Epoch 291. Avg accuracy 0.7094789002557544 Epoch 292. Avg accuracy 0.6844828964194374 Epoch 293. Avg accuracy 0.6711756713554987 Epoch 294. Avg accuracy 0.682604699488491 Epoch 295. Avg accuracy 0.6855818414322251 Epoch 296. Avg accuracy 0.6830842391304348 Epoch 297. Avg accuracy 0.6844429347826086 Epoch 298. Avg accuracy 0.6925151854219949 Epoch 299. Avg accuracy 0.6999280690537084 Epoch 300. Avg accuracy 0.7113171355498721 Epoch 301. Avg accuracy 0.7233256074168798 Epoch 302. Avg accuracy 0.7321771099744245 Epoch 303. Avg accuracy 0.7401094948849105 Epoch 304. Avg accuracy 0.747582320971867 Epoch 305. Avg accuracy 0.7549152813299232 Epoch 306. Avg accuracy 0.7593909846547314 Epoch 307. Avg accuracy 0.7607097186700768 Epoch 308. Avg accuracy 0.7633272058823529 Epoch 309. Avg accuracy 0.7617886828644501 Epoch 310. Avg accuracy 0.7538363171355499 Epoch 311. Avg accuracy 0.7382912404092071 Epoch 312. Avg accuracy 0.7168318414322251 Epoch 313. Avg accuracy 0.7009670716112532 Epoch 314. Avg accuracy 0.6968710038363172 Epoch 315. Avg accuracy 0.6885589833759591 Epoch 316. Avg accuracy 0.6873401534526854 Epoch 317. Avg accuracy 0.6937939578005116 Epoch 318. Avg accuracy 0.6941536125319693 Epoch 319. Avg accuracy 0.6962915601023018 Epoch 320. Avg accuracy 0.6955322890025576 Epoch 321. Avg accuracy 0.6977101982097187 Epoch 322. Avg accuracy 0.6972506393861893 Epoch 323. Avg accuracy 0.6985294117647058 Epoch 324. Avg accuracy 0.70474344629156 Epoch 325. Avg accuracy 0.7081601662404092 Epoch 326. Avg accuracy 0.7126558503836317 Epoch 327. Avg accuracy 0.7182504795396419 Epoch 328. Avg accuracy 0.7227861253196931 Epoch 329. Avg accuracy 0.7270020780051151 Epoch 330. Avg accuracy 0.7311181265984654 Epoch 331. Avg accuracy 0.7350143861892583 Epoch 332. Avg accuracy 0.7369325447570333 Epoch 333. Avg accuracy 0.7423473465473146 Epoch 334. Avg accuracy 0.7475623401534527 Epoch 335. Avg accuracy 0.7529971227621484 Epoch 336. Avg accuracy 0.7601502557544757 Epoch 337. Avg accuracy 0.7650255754475703 Epoch 338. Avg accuracy 0.767303388746803 Epoch 339. Avg accuracy 0.7684422953964194 Epoch 340. Avg accuracy 0.7668238491048593 Epoch 341. Avg accuracy 0.7522178708439897 Epoch 342. Avg accuracy 0.7360134271099744 Epoch 343. Avg accuracy 0.7420875959079284 Epoch 344. Avg accuracy 0.7448649296675192 Epoch 345. Avg accuracy 0.7402493606138107 Epoch 346. Avg accuracy 0.733016304347826 Epoch 347. Avg accuracy 0.733076246803069 Epoch 348. Avg accuracy 0.7351742327365729 Epoch 349. Avg accuracy 0.7383112212276215 Epoch 350. Avg accuracy 0.7430266943734015 Epoch 351. Avg accuracy 0.7461237212276215 Epoch 352. Avg accuracy 0.7491008631713555 Epoch 353. Avg accuracy 0.7523177749360613 Epoch 354. Avg accuracy 0.7538363171355499 Epoch 355. Avg accuracy 0.7568734015345269 Epoch 356. Avg accuracy 0.75943094629156 Epoch 357. Avg accuracy 0.7633072250639387 Epoch 358. Avg accuracy 0.7668837915601023 Epoch 359. Avg accuracy 0.7703804347826086 Epoch 360. Avg accuracy 0.771639226342711 Epoch 361. Avg accuracy 0.7735973465473146 Epoch 362. Avg accuracy 0.7765744884910486 Epoch 363. Avg accuracy 0.7793118606138107 Epoch 364. Avg accuracy 0.7799912084398977 Epoch 365. Avg accuracy 0.7802109974424553 Epoch 366. Avg accuracy 0.7792718989769821 Epoch 367. Avg accuracy 0.7771339514066496 Epoch 368. Avg accuracy 0.7727581521739131 Epoch 369. Avg accuracy 0.767303388746803 Epoch 370. Avg accuracy 0.7685621803069054 Epoch 371. Avg accuracy 0.7719988810741688 Epoch 372. Avg accuracy 0.7768742007672634 Epoch 373. Avg accuracy 0.7824088874680307 Epoch 374. Avg accuracy 0.7850063938618926 Epoch 375. Avg accuracy 0.7899616368286445 Epoch 376. Avg accuracy 0.7906010230179028 Epoch 377. Avg accuracy 0.7920796035805626 Epoch 378. Avg accuracy 0.792659047314578 Epoch 379. Avg accuracy 0.7940177429667519 Epoch 380. Avg accuracy 0.7922394501278772 Epoch 381. Avg accuracy 0.7907209079283888 Epoch 382. Avg accuracy 0.7894421355498721 Epoch 383. Avg accuracy 0.7881034207161125 Epoch 384. Avg accuracy 0.7883431905370843 Epoch 385. Avg accuracy 0.7909606777493606 Epoch 386. Avg accuracy 0.7937579923273658 Epoch 387. Avg accuracy 0.7964753836317136 Epoch 388. Avg accuracy 0.7973745204603581 Epoch 389. Avg accuracy 0.7994725063938619 Epoch 390. Avg accuracy 0.800531489769821 Epoch 391. Avg accuracy 0.8016104539641944 Epoch 392. Avg accuracy 0.8006313938618926 Epoch 393. Avg accuracy 0.8017503196930946 Epoch 394. Avg accuracy 0.7999520460358056 Epoch 395. Avg accuracy 0.7994525255754475 Epoch 396. Avg accuracy 0.8010110294117647 Epoch 397. Avg accuracy 0.8045875959079284 Epoch 398. Avg accuracy 0.8075247762148338 Epoch 399. Avg accuracy 0.8101222826086957 Epoch 400. Avg accuracy 0.811321131713555 Epoch 401. Avg accuracy 0.8125199808184144 Epoch 402. Avg accuracy 0.8127797314578005 Epoch 403. Avg accuracy 0.8145180626598465 Epoch 404. Avg accuracy 0.8164961636828645 Epoch 405. Avg accuracy 0.8187340153452686 Epoch 406. Avg accuracy 0.8202725383631714 Epoch 407. Avg accuracy 0.8218110613810742 Epoch 408. Avg accuracy 0.8247482416879796 Epoch 409. Avg accuracy 0.8279052109974424 Epoch 410. Avg accuracy 0.8295236572890026 Epoch 411. Avg accuracy 0.8305826406649617 Epoch 412. Avg accuracy 0.8332001278772379 Epoch 413. Avg accuracy 0.8340193414322251 Epoch 414. Avg accuracy 0.8371962915601023 Epoch 415. Avg accuracy 0.8373960997442456 Epoch 416. Avg accuracy 0.8382952365728901 Epoch 417. Avg accuracy 0.8402333759590793 Epoch 418. Avg accuracy 0.8379355818414322 Epoch 419. Avg accuracy 0.8388946611253197 Epoch 420. Avg accuracy 0.8399536445012787 Epoch 421. Avg accuracy 0.840093510230179 Epoch 422. Avg accuracy 0.8409926470588235 Epoch 423. Avg accuracy 0.8389346227621484 Epoch 424. Avg accuracy 0.839593989769821 Epoch 425. Avg accuracy 0.8421914961636828 Epoch 426. Avg accuracy 0.8410925511508951 Epoch 427. Avg accuracy 0.8467671035805626 Epoch 428. Avg accuracy 0.8478660485933504 Epoch 429. Avg accuracy 0.8505035166240409 Epoch 430. Avg accuracy 0.8526214833759591 Epoch 431. Avg accuracy 0.8542199488491049 Epoch 432. Avg accuracy 0.8576166879795396 Epoch 433. Avg accuracy 0.8584159207161125 Epoch 434. Avg accuracy 0.8542599104859335 Epoch 435. Avg accuracy 0.8529411764705882 Epoch 436. Avg accuracy 0.853360773657289 Epoch 437. Avg accuracy 0.8541999680306905 Epoch 438. Avg accuracy 0.8596747122762148 Epoch 439. Avg accuracy 0.8641703964194374 Epoch 440. Avg accuracy 0.8663882672634271 Epoch 441. Avg accuracy 0.8687260230179028 Epoch 442. Avg accuracy 0.8676070971867008 Epoch 443. Avg accuracy 0.867307384910486 Epoch 444. Avg accuracy 0.8603740409207161 Epoch 445. Avg accuracy 0.8589753836317136 Epoch 446. Avg accuracy 0.8613730818414322 Epoch 447. Avg accuracy 0.8643502237851662 Epoch 448. Avg accuracy 0.8672874040920716 Epoch 449. Avg accuracy 0.8716232416879796 Epoch 450. Avg accuracy 0.8742806905370843 Epoch 451. Avg accuracy 0.8763187340153452 Epoch 452. Avg accuracy 0.8796355498721228 Epoch 453. Avg accuracy 0.8802749360613811 Epoch 454. Avg accuracy 0.8806146099744245 Epoch 455. Avg accuracy 0.879835358056266 Epoch 456. Avg accuracy 0.88119405370844 Epoch 457. Avg accuracy 0.8758791560102301 Epoch 458. Avg accuracy 0.8758991368286445 Epoch 459. Avg accuracy 0.8773577365728901 Epoch 460. Avg accuracy 0.8793558184143222 Epoch 461. Avg accuracy 0.8817335358056266 Epoch 462. Avg accuracy 0.883431905370844 Epoch 463. Avg accuracy 0.8813139386189258 Epoch 464. Avg accuracy 0.8863690856777494 Epoch 465. Avg accuracy 0.8931026214833759 Epoch 466. Avg accuracy 0.8942415281329923 Epoch 467. Avg accuracy 0.8958599744245525 Epoch 468. Avg accuracy 0.8963994565217391 Epoch 469. Avg accuracy 0.8979379795396419 Epoch 470. Avg accuracy 0.8974384590792839 Epoch 471. Avg accuracy 0.8957600703324808 Epoch 472. Avg accuracy 0.8938419117647058 Epoch 473. Avg accuracy 0.893542199488491 Epoch 474. Avg accuracy 0.8944613171355499 Epoch 475. Avg accuracy 0.8918438299232737 Epoch 476. Avg accuracy 0.8895660166240409 Epoch 477. Avg accuracy 0.8905850383631714 Epoch 478. Avg accuracy 0.8941216432225064 Epoch 479. Avg accuracy 0.9005754475703325 Epoch 480. Avg accuracy 0.9011548913043478 Epoch 481. Avg accuracy 0.902093989769821 Epoch 482. Avg accuracy 0.9039721867007673 Epoch 483. Avg accuracy 0.9056106138107417 Epoch 484. Avg accuracy 0.9052509590792839 Epoch 485. Avg accuracy 0.9049712276214834 Epoch 486. Avg accuracy 0.9075887148337596 Epoch 487. Avg accuracy 0.9082480818414322 Epoch 488. Avg accuracy 0.9030530690537084 Epoch 489. Avg accuracy 0.9025735294117647 Epoch 490. Avg accuracy 0.9042119565217391 Epoch 491. Avg accuracy 0.9088075447570333 Epoch 492. Avg accuracy 0.9123441496163683 Epoch 493. Avg accuracy 0.9182584718670077 Epoch 494. Avg accuracy 0.9191176470588235 Epoch 495. Avg accuracy 0.9218949808184144 Epoch 496. Avg accuracy 0.9208959398976982 Epoch 497. Avg accuracy 0.923733216112532 Epoch 498. Avg accuracy 0.9249520460358056 Epoch 499. Avg accuracy 0.9239330242966752 Epoch 500. Avg accuracy 0.9249520460358056 Epoch 501. Avg accuracy 0.9225943094629157 Epoch 502. Avg accuracy 0.9216951726342711 Epoch 503. Avg accuracy 0.9250519501278772 Epoch 504. Avg accuracy 0.9245724104859335 Epoch 505. Avg accuracy 0.9253716432225064 Epoch 506. Avg accuracy 0.924912084398977 Epoch 507. Avg accuracy 0.9293877877237852 Epoch 508. Avg accuracy 0.9334438938618926 Epoch 509. Avg accuracy 0.9341032608695652 Epoch 510. Avg accuracy 0.9338834718670077 Epoch 511. Avg accuracy 0.934343030690537 Epoch 512. Avg accuracy 0.9388187340153452 Epoch 513. Avg accuracy 0.9385589833759591 Epoch 514. Avg accuracy 0.9395979859335039 Epoch 515. Avg accuracy 0.9394781010230179 Epoch 516. Avg accuracy 0.942395300511509 Epoch 517. Avg accuracy 0.9407768542199488 Epoch 518. Avg accuracy 0.9420156649616368 Epoch 519. Avg accuracy 0.9434143222506394 Epoch 520. Avg accuracy 0.9426350703324808 Epoch 521. Avg accuracy 0.9403372762148338 Epoch 522. Avg accuracy 0.9426350703324808 Epoch 523. Avg accuracy 0.9437140345268542 Epoch 524. Avg accuracy 0.9431745524296675 Epoch 525. Avg accuracy 0.9462515984654731 Epoch 526. Avg accuracy 0.946611253196931 Epoch 527. Avg accuracy 0.9465712915601023 Epoch 528. Avg accuracy 0.9452725383631714 Epoch 529. Avg accuracy 0.9478700447570333 Epoch 530. Avg accuracy 0.9467710997442456 Epoch 531. Avg accuracy 0.9460717710997443 Epoch 532. Avg accuracy 0.9483296035805626 Epoch 533. Avg accuracy 0.9475903132992327 Epoch 534. Avg accuracy 0.9493086636828645 Epoch 535. Avg accuracy 0.9497882033248082 Epoch 536. Avg accuracy 0.9492287404092071 Epoch 537. Avg accuracy 0.9474704283887468 Epoch 538. Avg accuracy 0.9481297953964194 Epoch 539. Avg accuracy 0.951946131713555 Epoch 540. Avg accuracy 0.951826246803069 Epoch 541. Avg accuracy 0.9506673593350383 Epoch 542. Avg accuracy 0.9501078964194374 Epoch 543. Avg accuracy 0.9541839833759591 Epoch 544. Avg accuracy 0.9533248081841432 Epoch 545. Avg accuracy 0.9566016624040921 Epoch 546. Avg accuracy 0.9526654411764706 Epoch 547. Avg accuracy 0.9558623721227621 Epoch 548. Avg accuracy 0.9551630434782609 Epoch 549. Avg accuracy 0.956281969309463 Epoch 550. Avg accuracy 0.9552629475703325 Epoch 551. Avg accuracy 0.9573009910485933 Epoch 552. Avg accuracy 0.959638746803069 Epoch 553. Avg accuracy 0.9585997442455243 Epoch 554. Avg accuracy 0.9573809143222506 Epoch 555. Avg accuracy 0.9610973465473146 Epoch 556. Avg accuracy 0.9595588235294118 Epoch 557. Avg accuracy 0.9631353900255755 Epoch 558. Avg accuracy 0.9642343350383632 Epoch 559. Avg accuracy 0.960997442455243 Epoch 560. Avg accuracy 0.9667519181585678 Epoch 561. Avg accuracy 0.9637947570332481 Epoch 562. Avg accuracy 0.9668518222506394 Epoch 563. Avg accuracy 0.965832800511509 Epoch 564. Avg accuracy 0.9651934143222506 Epoch 565. Avg accuracy 0.9662523976982097 Epoch 566. Avg accuracy 0.9666719948849105 Epoch 567. Avg accuracy 0.967071611253197 Epoch 568. Avg accuracy 0.966891783887468 Epoch 569. Avg accuracy 0.965832800511509 Epoch 570. Avg accuracy 0.9685302109974424 Epoch 571. Avg accuracy 0.9710477941176471 Epoch 572. Avg accuracy 0.9692894820971867 Epoch 573. Avg accuracy 0.9711476982097187 Epoch 574. Avg accuracy 0.9680906329923273 Epoch 575. Avg accuracy 0.9694293478260869 Epoch 576. Avg accuracy 0.9696491368286445 Epoch 577. Avg accuracy 0.9700687340153452 Epoch 578. Avg accuracy 0.9733256074168798 Epoch 579. Avg accuracy 0.9726062979539642 Epoch 580. Avg accuracy 0.9731058184143222 Epoch 581. Avg accuracy 0.971667199488491 Epoch 582. Avg accuracy 0.9715473145780051 Epoch 583. Avg accuracy 0.9736253196930946 Epoch 584. Avg accuracy 0.9711077365728901 Epoch 585. Avg accuracy 0.9728260869565217 Epoch 586. Avg accuracy 0.9741648017902813 Epoch 587. Avg accuracy 0.9708679667519181 Epoch 588. Avg accuracy 0.9740648976982097 Epoch 589. Avg accuracy 0.9753636508951407 Epoch 590. Avg accuracy 0.9737851662404092 Epoch 591. Avg accuracy 0.9711476982097187 Epoch 592. Avg accuracy 0.9748041879795396 Epoch 593. Avg accuracy 0.9737851662404092 Epoch 594. Avg accuracy 0.9743446291560103 Epoch 595. Avg accuracy 0.9761029411764706 Epoch 596. Avg accuracy 0.9735653772378516 Epoch 597. Avg accuracy 0.9758631713554987 Epoch 598. Avg accuracy 0.9746243606138107 Epoch 599. Avg accuracy 0.9746843030690537 Epoch 600. Avg accuracy 0.9767223465473146 Epoch 601. Avg accuracy 0.9757832480818415 Epoch 602. Avg accuracy 0.9763227301790282 Epoch 603. Avg accuracy 0.9762028452685422 Epoch 604. Avg accuracy 0.9757233056265985 Epoch 605. Avg accuracy 0.9753037084398977 Epoch 606. Avg accuracy 0.9786005434782609 Epoch 607. Avg accuracy 0.9766424232736572 Epoch 608. Avg accuracy 0.9772018861892583 Epoch 609. Avg accuracy 0.974884111253197 Epoch 610. Avg accuracy 0.9768422314578005 Epoch 611. Avg accuracy 0.9762428069053708 Epoch 612. Avg accuracy 0.9797794117647058 Epoch 613. Avg accuracy 0.977921195652174 Epoch 614. Avg accuracy 0.9744645140664961 Epoch 615. Avg accuracy 0.9792599104859335 Epoch 616. Avg accuracy 0.9800391624040921 Epoch 617. Avg accuracy 0.9766624040920716 Epoch 618. Avg accuracy 0.974704283887468 Epoch 619. Avg accuracy 0.9784606777493606 Epoch 620. Avg accuracy 0.9798793158567775 Epoch 621. Avg accuracy 0.9791999680306905 Epoch 622. Avg accuracy 0.9768622122762148 Epoch 623. Avg accuracy 0.9785605818414322 Epoch 624. Avg accuracy 0.9792399296675192 Epoch 625. Avg accuracy 0.9774816176470589 Epoch 626. Avg accuracy 0.980778452685422 Epoch 627. Avg accuracy 0.976502557544757 Epoch 628. Avg accuracy 0.9799392583120204 Epoch 629. Avg accuracy 0.97965952685422 Epoch 630. Avg accuracy 0.9784806585677749 Epoch 631. Avg accuracy 0.9791200447570333 Epoch 632. Avg accuracy 0.9788802749360613 Epoch 633. Avg accuracy 0.9825367647058824 Epoch 634. Avg accuracy 0.9782009271099744 Epoch 635. Avg accuracy 0.9794397378516624 Epoch 636. Avg accuracy 0.980838395140665 Epoch 637. Avg accuracy 0.98127797314578 Epoch 638. Avg accuracy 0.9786205242966752 Epoch 639. Avg accuracy 0.9818773976982097 Epoch 640. Avg accuracy 0.9800191815856778 Epoch 641. Avg accuracy 0.980778452685422 Epoch 642. Avg accuracy 0.9821571291560103 Epoch 643. Avg accuracy 0.9795596227621484 Epoch 644. Avg accuracy 0.9809382992327366 Epoch 645. Avg accuracy 0.9780011189258312 Epoch 646. Avg accuracy 0.982696611253197 Epoch 647. Avg accuracy 0.9812979539641944 Epoch 648. Avg accuracy 0.9820172634271099 Epoch 649. Avg accuracy 0.9811780690537084 Epoch 650. Avg accuracy 0.979539641943734 Epoch 651. Avg accuracy 0.981397858056266 Epoch 652. Avg accuracy 0.9801990089514067 Epoch 653. Avg accuracy 0.9850943094629157 Epoch 654. Avg accuracy 0.9821571291560103 Epoch 655. Avg accuracy 0.9804987212276215 Epoch 656. Avg accuracy 0.9823569373401535 Epoch 657. Avg accuracy 0.9802389705882353 Epoch 658. Avg accuracy 0.9837955562659847 Epoch 659. Avg accuracy 0.9823569373401535 Epoch 660. Avg accuracy 0.9823169757033248 Epoch 661. Avg accuracy 0.9809982416879796 Epoch 662. Avg accuracy 0.9825367647058824 Epoch 663. Avg accuracy 0.9828964194373402 Epoch 664. Avg accuracy 0.9840553069053708 Epoch 665. Avg accuracy 0.983196131713555 Epoch 666. Avg accuracy 0.9820772058823529 Epoch 667. Avg accuracy 0.9814178388746803 Epoch 668. Avg accuracy 0.9839753836317136 Epoch 669. Avg accuracy 0.9822969948849105 Epoch 670. Avg accuracy 0.9818973785166241 Epoch 671. Avg accuracy 0.9841152493606138 Epoch 672. Avg accuracy 0.9840553069053708 Epoch 673. Avg accuracy 0.9833160166240409 Epoch 674. Avg accuracy 0.9835557864450127 Epoch 675. Avg accuracy 0.983076246803069 Epoch 676. Avg accuracy 0.9841352301790282 Epoch 677. Avg accuracy 0.9854339833759591 Epoch 678. Avg accuracy 0.9838754795396419 Epoch 679. Avg accuracy 0.9835757672634271 Epoch 680. Avg accuracy 0.9815377237851662 Epoch 681. Avg accuracy 0.9832360933503836 Epoch 682. Avg accuracy 0.9846347506393862 Epoch 683. Avg accuracy 0.9816975703324808 Epoch 684. Avg accuracy 0.9865529092071611 Epoch 685. Avg accuracy 0.9830962276214834 Epoch 686. Avg accuracy 0.9833759590792839 Epoch 687. Avg accuracy 0.9853140984654731 Epoch 688. Avg accuracy 0.9848145780051151 Epoch 689. Avg accuracy 0.9832161125319693 Epoch 690. Avg accuracy 0.9826566496163683 Epoch 691. Avg accuracy 0.9853340792838875 Epoch 692. Avg accuracy 0.984315057544757 Epoch 693. Avg accuracy 0.9850743286445013 Epoch 694. Avg accuracy 0.9846747122762148 Epoch 695. Avg accuracy 0.9846347506393862 Epoch 696. Avg accuracy 0.9858335997442456 Epoch 697. Avg accuracy 0.9841352301790282 Epoch 698. Avg accuracy 0.9853140984654731 Epoch 699. Avg accuracy 0.9829963235294118 Epoch 700. Avg accuracy 0.9859734654731458 Epoch 701. Avg accuracy 0.9829563618925832 Epoch 702. Avg accuracy 0.9848545396419437 Epoch 703. Avg accuracy 0.987292199488491 Epoch 704. Avg accuracy 0.9840752877237852 Epoch 705. Avg accuracy 0.9863930626598465 Epoch 706. Avg accuracy 0.982696611253197 Epoch 707. Avg accuracy 0.9867127557544757 Epoch 708. Avg accuracy 0.9850143861892583 Epoch 709. Avg accuracy 0.9856537723785166 Epoch 710. Avg accuracy 0.9849544437340153 Epoch 711. Avg accuracy 0.9841352301790282 Epoch 712. Avg accuracy 0.9851142902813299 Epoch 713. Avg accuracy 0.987352141943734 Epoch 714. Avg accuracy 0.9859135230179028 Epoch 715. Avg accuracy 0.9829363810741688 Epoch 716. Avg accuracy 0.986173273657289 Epoch 717. Avg accuracy 0.9873321611253197 Epoch 718. Avg accuracy 0.9854739450127877 Epoch 719. Avg accuracy 0.9863531010230179 Epoch 720. Avg accuracy 0.9854939258312021 Epoch 721. Avg accuracy 0.984494884910486 Epoch 722. Avg accuracy 0.9862731777493606 Epoch 723. Avg accuracy 0.9870524296675192 Epoch 724. Avg accuracy 0.9854539641943734 Epoch 725. Avg accuracy 0.9864729859335039 Epoch 726. Avg accuracy 0.9848945012787724 Epoch 727. Avg accuracy 0.9862731777493606 Epoch 728. Avg accuracy 0.9870124680306905 Epoch 729. Avg accuracy 0.987531969309463 Epoch 730. Avg accuracy 0.9834958439897699 Epoch 731. Avg accuracy 0.9869325447570333 Epoch 732. Avg accuracy 0.9852941176470589 Epoch 733. Avg accuracy 0.9859135230179028 Epoch 734. Avg accuracy 0.9882312979539642 Epoch 735. Avg accuracy 0.9854140025575447 Epoch 736. Avg accuracy 0.987412084398977 Epoch 737. Avg accuracy 0.9858136189258312 Epoch 738. Avg accuracy 0.987911604859335 Epoch 739. Avg accuracy 0.9855338874680307 Epoch 740. Avg accuracy 0.9865529092071611 Epoch 741. Avg accuracy 0.9849144820971867 Epoch 742. Avg accuracy 0.9872122762148338 Epoch 743. Avg accuracy 0.9865728900255755 Epoch 744. Avg accuracy 0.9882113171355499 Epoch 745. Avg accuracy 0.985733695652174 Epoch 746. Avg accuracy 0.9881513746803069 Epoch 747. Avg accuracy 0.9865728900255755 Epoch 748. Avg accuracy 0.9863531010230179 Epoch 749. Avg accuracy 0.9872722186700768 Epoch 750. Avg accuracy 0.98747202685422 Epoch 751. Avg accuracy 0.9881913363171355 Epoch 752. Avg accuracy 0.9881713554987213 Epoch 753. Avg accuracy 0.9851542519181585 Epoch 754. Avg accuracy 0.987531969309463 Epoch 755. Avg accuracy 0.9874920076726342 Epoch 756. Avg accuracy 0.9875119884910486 Epoch 757. Avg accuracy 0.9855139066496164 Epoch 758. Avg accuracy 0.9886708759590793 Epoch 759. Avg accuracy 0.9882512787723785 Epoch 760. Avg accuracy 0.9863131393861893 Epoch 761. Avg accuracy 0.9870524296675192 Epoch 762. Avg accuracy 0.988531010230179 Epoch 763. Avg accuracy 0.9879315856777494 Epoch 764. Avg accuracy 0.9871523337595908 Epoch 765. Avg accuracy 0.9869125639386189 Epoch 766. Avg accuracy 0.9883911445012787 Epoch 767. Avg accuracy 0.9888906649616368 Epoch 768. Avg accuracy 0.9881513746803069 Epoch 769. Avg accuracy 0.987352141943734 Epoch 770. Avg accuracy 0.9878916240409207 Epoch 771. Avg accuracy 0.9867327365728901 Epoch 772. Avg accuracy 0.9869924872122762 Epoch 773. Avg accuracy 0.9888107416879796 Epoch 774. Avg accuracy 0.986792679028133 Epoch 775. Avg accuracy 0.9859534846547314 Epoch 776. Avg accuracy 0.9878117007672634 Epoch 777. Avg accuracy 0.9884910485933504 Epoch 778. Avg accuracy 0.9883511828644501 Epoch 779. Avg accuracy 0.9876118925831202 Epoch 780. Avg accuracy 0.9881713554987213 Epoch 781. Avg accuracy 0.98747202685422 Epoch 782. Avg accuracy 0.9877517583120204 Epoch 783. Avg accuracy 0.9886309143222506 Epoch 784. Avg accuracy 0.9882912404092071 Epoch 785. Avg accuracy 0.9861932544757033 Epoch 786. Avg accuracy 0.9907089194373402 Epoch 787. Avg accuracy 0.987412084398977 Epoch 788. Avg accuracy 0.9894101662404092 Epoch 789. Avg accuracy 0.9886309143222506 Epoch 790. Avg accuracy 0.9891304347826086 Epoch 791. Avg accuracy 0.9878117007672634 Epoch 792. Avg accuracy 0.9870124680306905 Epoch 793. Avg accuracy 0.9889905690537084 Epoch 794. Avg accuracy 0.990449168797954 Epoch 795. Avg accuracy 0.9871123721227621 Epoch 796. Avg accuracy 0.9889106457800512 Epoch 797. Avg accuracy 0.9868126598465473 Epoch 798. Avg accuracy 0.9901894181585678 Epoch 799. Avg accuracy 0.9880914322250639 Epoch 800. Avg accuracy 0.9876718350383632 Epoch 801. Avg accuracy 0.9902293797953964 Epoch 802. Avg accuracy 0.9865928708439897 Epoch 803. Avg accuracy 0.9893502237851662 Epoch 804. Avg accuracy 0.9880514705882353 Epoch 805. Avg accuracy 0.9887907608695652 Epoch 806. Avg accuracy 0.9885509910485933 Epoch 807. Avg accuracy 0.9879515664961637 Epoch 808. Avg accuracy 0.9907488810741688 Epoch 809. Avg accuracy 0.988031489769821 Epoch 810. Avg accuracy 0.9893502237851662 Epoch 811. Avg accuracy 0.9882712595907929 Epoch 812. Avg accuracy 0.9878916240409207 Epoch 813. Avg accuracy 0.9899096867007673 Epoch 814. Avg accuracy 0.9878117007672634 Epoch 815. Avg accuracy 0.9877717391304348 Epoch 816. Avg accuracy 0.9891903772378516 Epoch 817. Avg accuracy 0.9898297634271099 Epoch 818. Avg accuracy 0.9908088235294118 Epoch 819. Avg accuracy 0.98747202685422 Epoch 820. Avg accuracy 0.9889306265984654 Epoch 821. Avg accuracy 0.9891703964194374 Epoch 822. Avg accuracy 0.9878316815856778 Epoch 823. Avg accuracy 0.9899896099744245 Epoch 824. Avg accuracy 0.9897298593350383 Epoch 825. Avg accuracy 0.9874920076726342 Epoch 826. Avg accuracy 0.9898697250639387 Epoch 827. Avg accuracy 0.9888307225063938 Epoch 828. Avg accuracy 0.9878117007672634 Epoch 829. Avg accuracy 0.9897898017902813 Epoch 830. Avg accuracy 0.9896499360613811 Epoch 831. Avg accuracy 0.9875719309462916 Epoch 832. Avg accuracy 0.9905490728900256 Epoch 833. Avg accuracy 0.9892303388746803 Epoch 834. Avg accuracy 0.9894701086956522 Epoch 835. Avg accuracy 0.9885509910485933 Epoch 836. Avg accuracy 0.9889106457800512 Epoch 837. Avg accuracy 0.9904691496163683 Epoch 838. Avg accuracy 0.9902693414322251 Epoch 839. Avg accuracy 0.9883711636828645 Epoch 840. Avg accuracy 0.9891903772378516 Epoch 841. Avg accuracy 0.9886309143222506 Epoch 842. Avg accuracy 0.9896699168797954 Epoch 843. Avg accuracy 0.9894501278772379 Epoch 844. Avg accuracy 0.9907089194373402 Epoch 845. Avg accuracy 0.9879515664961637 Epoch 846. Avg accuracy 0.9896699168797954 Epoch 847. Avg accuracy 0.9885509910485933 Epoch 848. Avg accuracy 0.9907688618925832 Epoch 849. Avg accuracy 0.9884311061381074 Epoch 850. Avg accuracy 0.9904092071611253 Epoch 851. Avg accuracy 0.9880714514066496 Epoch 852. Avg accuracy 0.9917279411764706 Epoch 853. Avg accuracy 0.9898297634271099 Epoch 854. Avg accuracy 0.9893502237851662 Epoch 855. Avg accuracy 0.9906289961636828 Epoch 856. Avg accuracy 0.9891703964194374 Epoch 857. Avg accuracy 0.9887108375959079 Epoch 858. Avg accuracy 0.9899296675191815 Epoch 859. Avg accuracy 0.9899496483375959 Epoch 860. Avg accuracy 0.9883112212276215 Epoch 861. Avg accuracy 0.9904891304347826 Epoch 862. Avg accuracy 0.9905490728900256 Epoch 863. Avg accuracy 0.9880115089514067 Epoch 864. Avg accuracy 0.989769820971867 Epoch 865. Avg accuracy 0.9894900895140665 Epoch 866. Avg accuracy 0.9899696291560103 Epoch 867. Avg accuracy 0.990389226342711 Epoch 868. Avg accuracy 0.9907488810741688 Epoch 869. Avg accuracy 0.9909886508951407 Epoch 870. Avg accuracy 0.9887308184143222 Epoch 871. Avg accuracy 0.9907688618925832 Epoch 872. Avg accuracy 0.9892902813299232 Epoch 873. Avg accuracy 0.9926070971867008 Epoch 874. Avg accuracy 0.9896898976982097 Epoch 875. Avg accuracy 0.9887507992327366 Epoch 876. Avg accuracy 0.9919677109974424 Epoch 877. Avg accuracy 0.9887707800511509 Epoch 878. Avg accuracy 0.989769820971867 Epoch 879. Avg accuracy 0.9900695332480819 Epoch 880. Avg accuracy 0.9898297634271099 Epoch 881. Avg accuracy 0.9912883631713555 Epoch 882. Avg accuracy 0.988590952685422 Epoch 883. Avg accuracy 0.9912284207161125 Epoch 884. Avg accuracy 0.9903093030690537 Epoch 885. Avg accuracy 0.9897098785166241 Epoch 886. Avg accuracy 0.9888307225063938 Epoch 887. Avg accuracy 0.9898297634271099 Epoch 888. Avg accuracy 0.9916679987212276 Epoch 889. Avg accuracy 0.989030530690537 Epoch 890. Avg accuracy 0.9906289961636828 Epoch 891. Avg accuracy 0.9900495524296675 Epoch 892. Avg accuracy 0.9887707800511509 Epoch 893. Avg accuracy 0.992067615089514 Epoch 894. Avg accuracy 0.9902693414322251 Epoch 895. Avg accuracy 0.9911285166240409 Epoch 896. Avg accuracy 0.9875919117647058 Epoch 897. Avg accuracy 0.9922274616368286 Epoch 898. Avg accuracy 0.9906689578005116 Epoch 899. Avg accuracy 0.9881913363171355 Epoch 900. Avg accuracy 0.9924272698209718 Epoch 901. Avg accuracy 0.9904891304347826 Epoch 902. Avg accuracy 0.9898097826086957 Epoch 903. Avg accuracy 0.9904092071611253 Epoch 904. Avg accuracy 0.9910485933503836 Epoch 905. Avg accuracy 0.9905290920716112 Epoch 906. Avg accuracy 0.9899896099744245 Epoch 907. Avg accuracy 0.9901094948849105 Epoch 908. Avg accuracy 0.9896699168797954 Epoch 909. Avg accuracy 0.9908487851662404 Epoch 910. Avg accuracy 0.9901494565217391 Epoch 911. Avg accuracy 0.9908088235294118 Epoch 912. Avg accuracy 0.9902693414322251 Epoch 913. Avg accuracy 0.9903492647058824 Epoch 914. Avg accuracy 0.9912284207161125 Epoch 915. Avg accuracy 0.9925871163682864 Epoch 916. Avg accuracy 0.9898697250639387 Epoch 917. Avg accuracy 0.99056905370844 Epoch 918. Avg accuracy 0.9920276534526854 Epoch 919. Avg accuracy 0.987911604859335 Epoch 920. Avg accuracy 0.9925871163682864 Epoch 921. Avg accuracy 0.9912284207161125 Epoch 922. Avg accuracy 0.9906889386189258 Epoch 923. Avg accuracy 0.9918678069053708 Epoch 924. Avg accuracy 0.9896699168797954 Epoch 925. Avg accuracy 0.9907089194373402 Epoch 926. Avg accuracy 0.9909287084398977 Epoch 927. Avg accuracy 0.9912883631713555 Epoch 928. Avg accuracy 0.9918278452685422 Epoch 929. Avg accuracy 0.9875919117647058 Epoch 930. Avg accuracy 0.9917878836317136 Epoch 931. Avg accuracy 0.9924872122762148 Epoch 932. Avg accuracy 0.9900295716112532 Epoch 933. Avg accuracy 0.9920076726342711 Epoch 934. Avg accuracy 0.9903692455242967 Epoch 935. Avg accuracy 0.9914482097186701 Epoch 936. Avg accuracy 0.9897098785166241 Epoch 937. Avg accuracy 0.990449168797954 Epoch 938. Avg accuracy 0.9906289961636828 Epoch 939. Avg accuracy 0.9915880754475703 Epoch 940. Avg accuracy 0.9913083439897699 Epoch 941. Avg accuracy 0.989769820971867 Epoch 942. Avg accuracy 0.9918078644501279 Epoch 943. Avg accuracy 0.9924872122762148 Epoch 944. Avg accuracy 0.9901894181585678 Epoch 945. Avg accuracy 0.989210358056266 Epoch 946. Avg accuracy 0.9924872122762148 Epoch 947. Avg accuracy 0.9918078644501279 Epoch 948. Avg accuracy 0.9912084398976982 Epoch 949. Avg accuracy 0.9909087276214834 Epoch 950. Avg accuracy 0.9908088235294118 Epoch 951. Avg accuracy 0.9894900895140665 Epoch 952. Avg accuracy 0.9921875 Epoch 953. Avg accuracy 0.99056905370844 Epoch 954. Avg accuracy 0.9915880754475703 Epoch 955. Avg accuracy 0.9901894181585678 Epoch 956. Avg accuracy 0.9924072890025576 Epoch 957. Avg accuracy 0.9906090153452686 Epoch 958. Avg accuracy 0.991008631713555 Epoch 959. Avg accuracy 0.991628037084399 Epoch 960. Avg accuracy 0.9904092071611253 Epoch 961. Avg accuracy 0.9923673273657289 Epoch 962. Avg accuracy 0.9908487851662404 Epoch 963. Avg accuracy 0.991568094629156 Epoch 964. Avg accuracy 0.9909087276214834 Epoch 965. Avg accuracy 0.9910685741687979 Epoch 966. Avg accuracy 0.9929667519181585 Epoch 967. Avg accuracy 0.9906090153452686 Epoch 968. Avg accuracy 0.9914881713554987 Epoch 969. Avg accuracy 0.9917079603580563 Epoch 970. Avg accuracy 0.9920276534526854 Epoch 971. Avg accuracy 0.992127557544757 Epoch 972. Avg accuracy 0.9921675191815856 Epoch 973. Avg accuracy 0.9894101662404092 Epoch 974. Avg accuracy 0.9931465792838875 Epoch 975. Avg accuracy 0.9893901854219949 Epoch 976. Avg accuracy 0.9924872122762148 Epoch 977. Avg accuracy 0.9890505115089514 Epoch 978. Avg accuracy 0.99380594629156 Epoch 979. Avg accuracy 0.9917079603580563 Epoch 980. Avg accuracy 0.9897298593350383 Epoch 981. Avg accuracy 0.991628037084399 Epoch 982. Avg accuracy 0.9921075767263428 Epoch 983. Avg accuracy 0.9912683823529411 Epoch 984. Avg accuracy 0.9918278452685422 Epoch 985. Avg accuracy 0.9941855818414322 Epoch 986. Avg accuracy 0.988650895140665 Epoch 987. Avg accuracy 0.9930666560102301 Epoch 988. Avg accuracy 0.9914881713554987 Epoch 989. Avg accuracy 0.9911884590792839 Epoch 990. Avg accuracy 0.9926270780051151 Epoch 991. Avg accuracy 0.9912284207161125 Epoch 992. Avg accuracy 0.9920476342710998 Epoch 993. Avg accuracy 0.9922674232736572 Epoch 994. Avg accuracy 0.990888746803069 Epoch 995. Avg accuracy 0.9921675191815856 Epoch 996. Avg accuracy 0.9927669437340153 Epoch 997. Avg accuracy 0.9915481138107417 Epoch 998. Avg accuracy 0.9925271739130435 Epoch 999. Avg accuracy 0.9902493606138107