-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathhpt_cifar10_decentralized-0.075-1-8_gpus.log
4161 lines (4109 loc) · 236 KB
/
hpt_cifar10_decentralized-0.075-1-8_gpus.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Files already downloaded and verified
Files already downloaded and verifiedFiles already downloaded and verified
Files already downloaded and verified
Files already downloaded and verified
Files already downloaded and verifiedFiles already downloaded and verified
Files already downloaded and verified
INFO:root:Train Epoch: 1 [0/50000 (0%)] Loss: 2.314826
INFO:root:Train Epoch: 1 [80/50000 (1%)] Loss: 1.895447
INFO:root:Train Epoch: 1 [160/50000 (3%)] Loss: 2.225776
INFO:root:Train Epoch: 1 [240/50000 (4%)] Loss: 2.189150
INFO:root:Train Epoch: 1 [320/50000 (5%)] Loss: 2.167576
INFO:root:Train Epoch: 1 [400/50000 (6%)] Loss: 2.769124
INFO:root:Train Epoch: 1 [480/50000 (8%)] Loss: 2.002908
INFO:root:Train Epoch: 1 [560/50000 (9%)] Loss: 2.200439
INFO:root:Train Epoch: 1 [640/50000 (10%)] Loss: 2.271099
INFO:root:Train Epoch: 1 [720/50000 (12%)] Loss: 2.125907
INFO:root:Train Epoch: 1 [800/50000 (13%)] Loss: 2.411308
INFO:root:Train Epoch: 1 [880/50000 (14%)] Loss: 2.029043
INFO:root:Train Epoch: 1 [960/50000 (15%)] Loss: 2.023989
INFO:root:Train Epoch: 1 [1040/50000 (17%)] Loss: 2.233941
INFO:root:Train Epoch: 1 [1120/50000 (18%)] Loss: 1.994633
INFO:root:Train Epoch: 1 [1200/50000 (19%)] Loss: 2.365995
INFO:root:Train Epoch: 1 [1280/50000 (20%)] Loss: 2.188716
INFO:root:Train Epoch: 1 [1360/50000 (22%)] Loss: 2.222555
INFO:root:Train Epoch: 1 [1440/50000 (23%)] Loss: 2.104018
INFO:root:Train Epoch: 1 [1520/50000 (24%)] Loss: 2.705156
INFO:root:Train Epoch: 1 [1600/50000 (26%)] Loss: 1.656927
INFO:root:Train Epoch: 1 [1680/50000 (27%)] Loss: 1.731100
INFO:root:Train Epoch: 1 [1760/50000 (28%)] Loss: 2.015221
INFO:root:Train Epoch: 1 [1840/50000 (29%)] Loss: 2.012054
INFO:root:Train Epoch: 1 [1920/50000 (31%)] Loss: 2.149578
INFO:root:Train Epoch: 1 [2000/50000 (32%)] Loss: 2.938973
INFO:root:Train Epoch: 1 [2080/50000 (33%)] Loss: 1.707947
INFO:root:Train Epoch: 1 [2160/50000 (35%)] Loss: 1.854326
INFO:root:Train Epoch: 1 [2240/50000 (36%)] Loss: 2.039985
INFO:root:Train Epoch: 1 [2320/50000 (37%)] Loss: 2.004580
INFO:root:Train Epoch: 1 [2400/50000 (38%)] Loss: 1.979132
INFO:root:Train Epoch: 1 [2480/50000 (40%)] Loss: 2.187657
INFO:root:Train Epoch: 1 [2560/50000 (41%)] Loss: 2.081073
INFO:root:Train Epoch: 1 [2640/50000 (42%)] Loss: 1.646383
INFO:root:Train Epoch: 1 [2720/50000 (43%)] Loss: 1.732718
INFO:root:Train Epoch: 1 [2800/50000 (45%)] Loss: 2.154254
INFO:root:Train Epoch: 1 [2880/50000 (46%)] Loss: 1.485840
INFO:root:Train Epoch: 1 [2960/50000 (47%)] Loss: 1.580939
INFO:root:Train Epoch: 1 [3040/50000 (49%)] Loss: 2.263047
INFO:root:Train Epoch: 1 [3120/50000 (50%)] Loss: 1.831831
INFO:root:Train Epoch: 1 [3200/50000 (51%)] Loss: 2.133316
INFO:root:Train Epoch: 1 [3280/50000 (52%)] Loss: 2.191008
INFO:root:Train Epoch: 1 [3360/50000 (54%)] Loss: 2.393916
INFO:root:Train Epoch: 1 [3440/50000 (55%)] Loss: 1.108264
INFO:root:Train Epoch: 1 [3520/50000 (56%)] Loss: 1.405798
INFO:root:Train Epoch: 1 [3600/50000 (58%)] Loss: 2.056196
INFO:root:Train Epoch: 1 [3680/50000 (59%)] Loss: 1.864082
INFO:root:Train Epoch: 1 [3760/50000 (60%)] Loss: 1.471709
INFO:root:Train Epoch: 1 [3840/50000 (61%)] Loss: 2.497704
INFO:root:Train Epoch: 1 [3920/50000 (63%)] Loss: 1.673673
INFO:root:Train Epoch: 1 [4000/50000 (64%)] Loss: 1.929340
INFO:root:Train Epoch: 1 [4080/50000 (65%)] Loss: 1.813716
INFO:root:Train Epoch: 1 [4160/50000 (66%)] Loss: 1.605231
INFO:root:Train Epoch: 1 [4240/50000 (68%)] Loss: 1.621041
INFO:root:Train Epoch: 1 [4320/50000 (69%)] Loss: 1.998485
INFO:root:Train Epoch: 1 [4400/50000 (70%)] Loss: 1.565868
INFO:root:Train Epoch: 1 [4480/50000 (72%)] Loss: 1.502689
INFO:root:Train Epoch: 1 [4560/50000 (73%)] Loss: 1.910750
INFO:root:Train Epoch: 1 [4640/50000 (74%)] Loss: 1.681852
INFO:root:Train Epoch: 1 [4720/50000 (75%)] Loss: 2.188416
INFO:root:Train Epoch: 1 [4800/50000 (77%)] Loss: 1.574995
INFO:root:Train Epoch: 1 [4880/50000 (78%)] Loss: 1.878733
INFO:root:Train Epoch: 1 [4960/50000 (79%)] Loss: 1.619533
INFO:root:Train Epoch: 1 [5040/50000 (81%)] Loss: 1.727825
INFO:root:Train Epoch: 1 [5120/50000 (82%)] Loss: 1.615624
INFO:root:Train Epoch: 1 [5200/50000 (83%)] Loss: 1.557185
INFO:root:Train Epoch: 1 [5280/50000 (84%)] Loss: 1.306035
INFO:root:Train Epoch: 1 [5360/50000 (86%)] Loss: 1.649850
INFO:root:Train Epoch: 1 [5440/50000 (87%)] Loss: 1.954450
INFO:root:Train Epoch: 1 [5520/50000 (88%)] Loss: 1.508868
INFO:root:Train Epoch: 1 [5600/50000 (90%)] Loss: 1.765501
INFO:root:Train Epoch: 1 [5680/50000 (91%)] Loss: 1.564031
INFO:root:Train Epoch: 1 [5760/50000 (92%)] Loss: 1.753037
INFO:root:Train Epoch: 1 [5840/50000 (93%)] Loss: 1.640037
INFO:root:Train Epoch: 1 [5920/50000 (95%)] Loss: 1.883165
INFO:root:Train Epoch: 1 [6000/50000 (96%)] Loss: 1.688129
INFO:root:Train Epoch: 1 [6080/50000 (97%)] Loss: 1.972582
INFO:root:Train Epoch: 1 [6160/50000 (98%)] Loss: 1.360798
INFO:root:Train Epoch: 1 [6240/50000 (100%)] Loss: 1.639164
INFO:root:
Test set: Average loss: 2.0773, Accuracy: 2731/10000 (27%)
INFO:root:Epoch time: 23.59561014175415
INFO:root:Train Epoch: 2 [0/50000 (0%)] Loss: 1.332843
INFO:root:Train Epoch: 2 [80/50000 (1%)] Loss: 1.629605
INFO:root:Train Epoch: 2 [160/50000 (3%)] Loss: 1.776871
INFO:root:Train Epoch: 2 [240/50000 (4%)] Loss: 2.083940
INFO:root:Train Epoch: 2 [320/50000 (5%)] Loss: 1.332748
INFO:root:Train Epoch: 2 [400/50000 (6%)] Loss: 1.530371
INFO:root:Train Epoch: 2 [480/50000 (8%)] Loss: 1.845058
INFO:root:Train Epoch: 2 [560/50000 (9%)] Loss: 1.821370
INFO:root:Train Epoch: 2 [640/50000 (10%)] Loss: 1.462279
INFO:root:Train Epoch: 2 [720/50000 (12%)] Loss: 1.912674
INFO:root:Train Epoch: 2 [800/50000 (13%)] Loss: 2.817497
INFO:root:Train Epoch: 2 [880/50000 (14%)] Loss: 1.483069
INFO:root:Train Epoch: 2 [960/50000 (15%)] Loss: 1.717201
INFO:root:Train Epoch: 2 [1040/50000 (17%)] Loss: 1.693512
INFO:root:Train Epoch: 2 [1120/50000 (18%)] Loss: 1.869456
INFO:root:Train Epoch: 2 [1200/50000 (19%)] Loss: 1.556261
INFO:root:Train Epoch: 2 [1280/50000 (20%)] Loss: 1.297063
INFO:root:Train Epoch: 2 [1360/50000 (22%)] Loss: 1.645718
INFO:root:Train Epoch: 2 [1440/50000 (23%)] Loss: 2.172411
INFO:root:Train Epoch: 2 [1520/50000 (24%)] Loss: 2.573897
INFO:root:Train Epoch: 2 [1600/50000 (26%)] Loss: 1.632358
INFO:root:Train Epoch: 2 [1680/50000 (27%)] Loss: 1.366076
INFO:root:Train Epoch: 2 [1760/50000 (28%)] Loss: 1.627497
INFO:root:Train Epoch: 2 [1840/50000 (29%)] Loss: 1.672949
INFO:root:Train Epoch: 2 [1920/50000 (31%)] Loss: 1.975892
INFO:root:Train Epoch: 2 [2000/50000 (32%)] Loss: 2.078739
INFO:root:Train Epoch: 2 [2080/50000 (33%)] Loss: 1.781934
INFO:root:Train Epoch: 2 [2160/50000 (35%)] Loss: 1.731176
INFO:root:Train Epoch: 2 [2240/50000 (36%)] Loss: 2.172078
INFO:root:Train Epoch: 2 [2320/50000 (37%)] Loss: 1.799261
INFO:root:Train Epoch: 2 [2400/50000 (38%)] Loss: 1.553922
INFO:root:Train Epoch: 2 [2480/50000 (40%)] Loss: 1.542924
INFO:root:Train Epoch: 2 [2560/50000 (41%)] Loss: 1.645930
INFO:root:Train Epoch: 2 [2640/50000 (42%)] Loss: 1.825380
INFO:root:Train Epoch: 2 [2720/50000 (43%)] Loss: 2.043648
INFO:root:Train Epoch: 2 [2800/50000 (45%)] Loss: 2.102218
INFO:root:Train Epoch: 2 [2880/50000 (46%)] Loss: 1.648603
INFO:root:Train Epoch: 2 [2960/50000 (47%)] Loss: 1.503587
INFO:root:Train Epoch: 2 [3040/50000 (49%)] Loss: 2.224480
INFO:root:Train Epoch: 2 [3120/50000 (50%)] Loss: 1.589713
INFO:root:Train Epoch: 2 [3200/50000 (51%)] Loss: 2.620622
INFO:root:Train Epoch: 2 [3280/50000 (52%)] Loss: 1.589125
INFO:root:Train Epoch: 2 [3360/50000 (54%)] Loss: 2.409197
INFO:root:Train Epoch: 2 [3440/50000 (55%)] Loss: 0.971234
INFO:root:Train Epoch: 2 [3520/50000 (56%)] Loss: 1.087615
INFO:root:Train Epoch: 2 [3600/50000 (58%)] Loss: 2.312397
INFO:root:Train Epoch: 2 [3680/50000 (59%)] Loss: 1.207424
INFO:root:Train Epoch: 2 [3760/50000 (60%)] Loss: 1.305167
INFO:root:Train Epoch: 2 [3840/50000 (61%)] Loss: 1.344703
INFO:root:Train Epoch: 2 [3920/50000 (63%)] Loss: 1.141131
INFO:root:Train Epoch: 2 [4000/50000 (64%)] Loss: 1.379913
INFO:root:Train Epoch: 2 [4080/50000 (65%)] Loss: 1.406805
INFO:root:Train Epoch: 2 [4160/50000 (66%)] Loss: 1.751658
INFO:root:Train Epoch: 2 [4240/50000 (68%)] Loss: 0.959191
INFO:root:Train Epoch: 2 [4320/50000 (69%)] Loss: 2.087339
INFO:root:Train Epoch: 2 [4400/50000 (70%)] Loss: 1.379653
INFO:root:Train Epoch: 2 [4480/50000 (72%)] Loss: 0.947492
INFO:root:Train Epoch: 2 [4560/50000 (73%)] Loss: 1.870189
INFO:root:Train Epoch: 2 [4640/50000 (74%)] Loss: 1.131186
INFO:root:Train Epoch: 2 [4720/50000 (75%)] Loss: 2.008097
INFO:root:Train Epoch: 2 [4800/50000 (77%)] Loss: 1.741466
INFO:root:Train Epoch: 2 [4880/50000 (78%)] Loss: 1.624128
INFO:root:Train Epoch: 2 [4960/50000 (79%)] Loss: 1.392120
INFO:root:Train Epoch: 2 [5040/50000 (81%)] Loss: 1.204446
INFO:root:Train Epoch: 2 [5120/50000 (82%)] Loss: 1.573983
INFO:root:Train Epoch: 2 [5200/50000 (83%)] Loss: 1.437538
INFO:root:Train Epoch: 2 [5280/50000 (84%)] Loss: 1.369268
INFO:root:Train Epoch: 2 [5360/50000 (86%)] Loss: 1.064309
INFO:root:Train Epoch: 2 [5440/50000 (87%)] Loss: 1.801341
INFO:root:Train Epoch: 2 [5520/50000 (88%)] Loss: 1.055110
INFO:root:Train Epoch: 2 [5600/50000 (90%)] Loss: 0.916277
INFO:root:Train Epoch: 2 [5680/50000 (91%)] Loss: 0.965180
INFO:root:Train Epoch: 2 [5760/50000 (92%)] Loss: 1.281749
INFO:root:Train Epoch: 2 [5840/50000 (93%)] Loss: 1.688259
INFO:root:Train Epoch: 2 [5920/50000 (95%)] Loss: 1.655872
INFO:root:Train Epoch: 2 [6000/50000 (96%)] Loss: 1.044485
INFO:root:Train Epoch: 2 [6080/50000 (97%)] Loss: 1.390969
INFO:root:Train Epoch: 2 [6160/50000 (98%)] Loss: 0.870275
INFO:root:Train Epoch: 2 [6240/50000 (100%)] Loss: 1.375581
INFO:root:
Test set: Average loss: 1.8127, Accuracy: 3655/10000 (37%)
INFO:root:Epoch time: 23.747750997543335
INFO:root:Train Epoch: 3 [0/50000 (0%)] Loss: 1.561236
INFO:root:Train Epoch: 3 [80/50000 (1%)] Loss: 1.213791
INFO:root:Train Epoch: 3 [160/50000 (3%)] Loss: 1.312836
INFO:root:Train Epoch: 3 [240/50000 (4%)] Loss: 1.829628
INFO:root:Train Epoch: 3 [320/50000 (5%)] Loss: 1.104344
INFO:root:Train Epoch: 3 [400/50000 (6%)] Loss: 1.302339
INFO:root:Train Epoch: 3 [480/50000 (8%)] Loss: 1.337194
INFO:root:Train Epoch: 3 [560/50000 (9%)] Loss: 2.886130
INFO:root:Train Epoch: 3 [640/50000 (10%)] Loss: 1.595197
INFO:root:Train Epoch: 3 [720/50000 (12%)] Loss: 1.605334
INFO:root:Train Epoch: 3 [800/50000 (13%)] Loss: 2.642122
INFO:root:Train Epoch: 3 [880/50000 (14%)] Loss: 1.021296
INFO:root:Train Epoch: 3 [960/50000 (15%)] Loss: 1.460713
INFO:root:Train Epoch: 3 [1040/50000 (17%)] Loss: 1.894855
INFO:root:Train Epoch: 3 [1120/50000 (18%)] Loss: 1.015479
INFO:root:Train Epoch: 3 [1200/50000 (19%)] Loss: 1.625401
INFO:root:Train Epoch: 3 [1280/50000 (20%)] Loss: 1.683845
INFO:root:Train Epoch: 3 [1360/50000 (22%)] Loss: 1.792092
INFO:root:Train Epoch: 3 [1440/50000 (23%)] Loss: 1.850338
INFO:root:Train Epoch: 3 [1520/50000 (24%)] Loss: 1.946163
INFO:root:Train Epoch: 3 [1600/50000 (26%)] Loss: 1.308100
INFO:root:Train Epoch: 3 [1680/50000 (27%)] Loss: 1.445197
INFO:root:Train Epoch: 3 [1760/50000 (28%)] Loss: 1.912571
INFO:root:Train Epoch: 3 [1840/50000 (29%)] Loss: 1.467862
INFO:root:Train Epoch: 3 [1920/50000 (31%)] Loss: 1.324959
INFO:root:Train Epoch: 3 [2000/50000 (32%)] Loss: 1.407660
INFO:root:Train Epoch: 3 [2080/50000 (33%)] Loss: 0.909826
INFO:root:Train Epoch: 3 [2160/50000 (35%)] Loss: 1.348212
INFO:root:Train Epoch: 3 [2240/50000 (36%)] Loss: 1.122477
INFO:root:Train Epoch: 3 [2320/50000 (37%)] Loss: 1.363241
INFO:root:Train Epoch: 3 [2400/50000 (38%)] Loss: 1.642547
INFO:root:Train Epoch: 3 [2480/50000 (40%)] Loss: 1.951525
INFO:root:Train Epoch: 3 [2560/50000 (41%)] Loss: 1.418081
INFO:root:Train Epoch: 3 [2640/50000 (42%)] Loss: 0.964662
INFO:root:Train Epoch: 3 [2720/50000 (43%)] Loss: 1.429747
INFO:root:Train Epoch: 3 [2800/50000 (45%)] Loss: 1.777265
INFO:root:Train Epoch: 3 [2880/50000 (46%)] Loss: 1.570678
INFO:root:Train Epoch: 3 [2960/50000 (47%)] Loss: 1.191426
INFO:root:Train Epoch: 3 [3040/50000 (49%)] Loss: 1.570789
INFO:root:Train Epoch: 3 [3120/50000 (50%)] Loss: 1.439345
INFO:root:Train Epoch: 3 [3200/50000 (51%)] Loss: 1.462490
INFO:root:Train Epoch: 3 [3280/50000 (52%)] Loss: 1.562683
INFO:root:Train Epoch: 3 [3360/50000 (54%)] Loss: 1.331561
INFO:root:Train Epoch: 3 [3440/50000 (55%)] Loss: 1.045246
INFO:root:Train Epoch: 3 [3520/50000 (56%)] Loss: 1.117660
INFO:root:Train Epoch: 3 [3600/50000 (58%)] Loss: 1.054094
INFO:root:Train Epoch: 3 [3680/50000 (59%)] Loss: 1.235981
INFO:root:Train Epoch: 3 [3760/50000 (60%)] Loss: 1.292851
INFO:root:Train Epoch: 3 [3840/50000 (61%)] Loss: 1.691317
INFO:root:Train Epoch: 3 [3920/50000 (63%)] Loss: 0.780538
INFO:root:Train Epoch: 3 [4000/50000 (64%)] Loss: 1.619416
INFO:root:Train Epoch: 3 [4080/50000 (65%)] Loss: 0.839787
INFO:root:Train Epoch: 3 [4160/50000 (66%)] Loss: 1.033436
INFO:root:Train Epoch: 3 [4240/50000 (68%)] Loss: 2.011978
INFO:root:Train Epoch: 3 [4320/50000 (69%)] Loss: 1.526709
INFO:root:Train Epoch: 3 [4400/50000 (70%)] Loss: 1.878573
INFO:root:Train Epoch: 3 [4480/50000 (72%)] Loss: 0.572816
INFO:root:Train Epoch: 3 [4560/50000 (73%)] Loss: 1.571650
INFO:root:Train Epoch: 3 [4640/50000 (74%)] Loss: 0.864129
INFO:root:Train Epoch: 3 [4720/50000 (75%)] Loss: 0.984315
INFO:root:Train Epoch: 3 [4800/50000 (77%)] Loss: 1.860164
INFO:root:Train Epoch: 3 [4880/50000 (78%)] Loss: 1.456013
INFO:root:Train Epoch: 3 [4960/50000 (79%)] Loss: 1.274951
INFO:root:Train Epoch: 3 [5040/50000 (81%)] Loss: 0.958944
INFO:root:Train Epoch: 3 [5120/50000 (82%)] Loss: 1.121406
INFO:root:Train Epoch: 3 [5200/50000 (83%)] Loss: 1.340711
INFO:root:Train Epoch: 3 [5280/50000 (84%)] Loss: 0.358331
INFO:root:Train Epoch: 3 [5360/50000 (86%)] Loss: 1.056863
INFO:root:Train Epoch: 3 [5440/50000 (87%)] Loss: 1.547366
INFO:root:Train Epoch: 3 [5520/50000 (88%)] Loss: 0.550381
INFO:root:Train Epoch: 3 [5600/50000 (90%)] Loss: 1.157740
INFO:root:Train Epoch: 3 [5680/50000 (91%)] Loss: 0.977390
INFO:root:Train Epoch: 3 [5760/50000 (92%)] Loss: 0.865412
INFO:root:Train Epoch: 3 [5840/50000 (93%)] Loss: 1.829362
INFO:root:Train Epoch: 3 [5920/50000 (95%)] Loss: 1.091253
INFO:root:Train Epoch: 3 [6000/50000 (96%)] Loss: 0.946935
INFO:root:Train Epoch: 3 [6080/50000 (97%)] Loss: 1.462794
INFO:root:Train Epoch: 3 [6160/50000 (98%)] Loss: 1.034806
INFO:root:Train Epoch: 3 [6240/50000 (100%)] Loss: 1.030664
INFO:root:
Test set: Average loss: 1.6172, Accuracy: 4375/10000 (44%)
INFO:root:Epoch time: 24.442452907562256
INFO:root:Train Epoch: 4 [0/50000 (0%)] Loss: 1.952743
INFO:root:Train Epoch: 4 [80/50000 (1%)] Loss: 1.554976
INFO:root:Train Epoch: 4 [160/50000 (3%)] Loss: 1.015669
INFO:root:Train Epoch: 4 [240/50000 (4%)] Loss: 1.364879
INFO:root:Train Epoch: 4 [320/50000 (5%)] Loss: 1.019488
INFO:root:Train Epoch: 4 [400/50000 (6%)] Loss: 1.168570
INFO:root:Train Epoch: 4 [480/50000 (8%)] Loss: 1.731302
INFO:root:Train Epoch: 4 [560/50000 (9%)] Loss: 1.873895
INFO:root:Train Epoch: 4 [640/50000 (10%)] Loss: 1.329454
INFO:root:Train Epoch: 4 [720/50000 (12%)] Loss: 1.242028
INFO:root:Train Epoch: 4 [800/50000 (13%)] Loss: 1.732562
INFO:root:Train Epoch: 4 [880/50000 (14%)] Loss: 1.080167
INFO:root:Train Epoch: 4 [960/50000 (15%)] Loss: 1.119068
INFO:root:Train Epoch: 4 [1040/50000 (17%)] Loss: 1.576716
INFO:root:Train Epoch: 4 [1120/50000 (18%)] Loss: 1.181156
INFO:root:Train Epoch: 4 [1200/50000 (19%)] Loss: 1.236302
INFO:root:Train Epoch: 4 [1280/50000 (20%)] Loss: 0.720758
INFO:root:Train Epoch: 4 [1360/50000 (22%)] Loss: 1.887981
INFO:root:Train Epoch: 4 [1440/50000 (23%)] Loss: 1.084051
INFO:root:Train Epoch: 4 [1520/50000 (24%)] Loss: 2.232238
INFO:root:Train Epoch: 4 [1600/50000 (26%)] Loss: 1.376525
INFO:root:Train Epoch: 4 [1680/50000 (27%)] Loss: 1.277059
INFO:root:Train Epoch: 4 [1760/50000 (28%)] Loss: 1.723215
INFO:root:Train Epoch: 4 [1840/50000 (29%)] Loss: 0.932350
INFO:root:Train Epoch: 4 [1920/50000 (31%)] Loss: 1.775919
INFO:root:Train Epoch: 4 [2000/50000 (32%)] Loss: 1.390346
INFO:root:Train Epoch: 4 [2080/50000 (33%)] Loss: 0.597787
INFO:root:Train Epoch: 4 [2160/50000 (35%)] Loss: 0.806167
INFO:root:Train Epoch: 4 [2240/50000 (36%)] Loss: 0.983136
INFO:root:Train Epoch: 4 [2320/50000 (37%)] Loss: 1.293757
INFO:root:Train Epoch: 4 [2400/50000 (38%)] Loss: 1.196952
INFO:root:Train Epoch: 4 [2480/50000 (40%)] Loss: 2.221051
INFO:root:Train Epoch: 4 [2560/50000 (41%)] Loss: 1.248200
INFO:root:Train Epoch: 4 [2640/50000 (42%)] Loss: 0.363595
INFO:root:Train Epoch: 4 [2720/50000 (43%)] Loss: 1.759970
INFO:root:Train Epoch: 4 [2800/50000 (45%)] Loss: 1.436496
INFO:root:Train Epoch: 4 [2880/50000 (46%)] Loss: 1.319703
INFO:root:Train Epoch: 4 [2960/50000 (47%)] Loss: 1.439680
INFO:root:Train Epoch: 4 [3040/50000 (49%)] Loss: 1.412066
INFO:root:Train Epoch: 4 [3120/50000 (50%)] Loss: 1.062900
INFO:root:Train Epoch: 4 [3200/50000 (51%)] Loss: 0.763240
INFO:root:Train Epoch: 4 [3280/50000 (52%)] Loss: 1.299197
INFO:root:Train Epoch: 4 [3360/50000 (54%)] Loss: 1.367653
INFO:root:Train Epoch: 4 [3440/50000 (55%)] Loss: 1.209713
INFO:root:Train Epoch: 4 [3520/50000 (56%)] Loss: 1.216651
INFO:root:Train Epoch: 4 [3600/50000 (58%)] Loss: 1.573529
INFO:root:Train Epoch: 4 [3680/50000 (59%)] Loss: 0.917867
INFO:root:Train Epoch: 4 [3760/50000 (60%)] Loss: 1.364030
INFO:root:Train Epoch: 4 [3840/50000 (61%)] Loss: 1.831224
INFO:root:Train Epoch: 4 [3920/50000 (63%)] Loss: 0.822523
INFO:root:Train Epoch: 4 [4000/50000 (64%)] Loss: 1.840524
INFO:root:Train Epoch: 4 [4080/50000 (65%)] Loss: 0.656949
INFO:root:Train Epoch: 4 [4160/50000 (66%)] Loss: 1.071449
INFO:root:Train Epoch: 4 [4240/50000 (68%)] Loss: 1.136916
INFO:root:Train Epoch: 4 [4320/50000 (69%)] Loss: 1.344895
INFO:root:Train Epoch: 4 [4400/50000 (70%)] Loss: 1.783635
INFO:root:Train Epoch: 4 [4480/50000 (72%)] Loss: 1.077403
INFO:root:Train Epoch: 4 [4560/50000 (73%)] Loss: 1.987539
INFO:root:Train Epoch: 4 [4640/50000 (74%)] Loss: 0.663969
INFO:root:Train Epoch: 4 [4720/50000 (75%)] Loss: 1.164829
INFO:root:Train Epoch: 4 [4800/50000 (77%)] Loss: 1.399798
INFO:root:Train Epoch: 4 [4880/50000 (78%)] Loss: 0.936371
INFO:root:Train Epoch: 4 [4960/50000 (79%)] Loss: 1.510260
INFO:root:Train Epoch: 4 [5040/50000 (81%)] Loss: 0.777580
INFO:root:Train Epoch: 4 [5120/50000 (82%)] Loss: 0.656497
INFO:root:Train Epoch: 4 [5200/50000 (83%)] Loss: 1.514521
INFO:root:Train Epoch: 4 [5280/50000 (84%)] Loss: 0.313910
INFO:root:Train Epoch: 4 [5360/50000 (86%)] Loss: 0.570743
INFO:root:Train Epoch: 4 [5440/50000 (87%)] Loss: 1.396513
INFO:root:Train Epoch: 4 [5520/50000 (88%)] Loss: 0.660368
INFO:root:Train Epoch: 4 [5600/50000 (90%)] Loss: 1.658197
INFO:root:Train Epoch: 4 [5680/50000 (91%)] Loss: 1.549121
INFO:root:Train Epoch: 4 [5760/50000 (92%)] Loss: 1.671007
INFO:root:Train Epoch: 4 [5840/50000 (93%)] Loss: 2.074777
INFO:root:Train Epoch: 4 [5920/50000 (95%)] Loss: 0.888621
INFO:root:Train Epoch: 4 [6000/50000 (96%)] Loss: 0.984798
INFO:root:Train Epoch: 4 [6080/50000 (97%)] Loss: 2.017721
INFO:root:Train Epoch: 4 [6160/50000 (98%)] Loss: 0.427750
INFO:root:Train Epoch: 4 [6240/50000 (100%)] Loss: 0.850542
INFO:root:
Test set: Average loss: 1.8012, Accuracy: 4669/10000 (47%)
INFO:root:Epoch time: 23.53754234313965
INFO:root:Train Epoch: 5 [0/50000 (0%)] Loss: 1.267893
INFO:root:Train Epoch: 5 [80/50000 (1%)] Loss: 1.194013
INFO:root:Train Epoch: 5 [160/50000 (3%)] Loss: 0.964225
INFO:root:Train Epoch: 5 [240/50000 (4%)] Loss: 1.770032
INFO:root:Train Epoch: 5 [320/50000 (5%)] Loss: 0.702673
INFO:root:Train Epoch: 5 [400/50000 (6%)] Loss: 0.682961
INFO:root:Train Epoch: 5 [480/50000 (8%)] Loss: 1.653848
INFO:root:Train Epoch: 5 [560/50000 (9%)] Loss: 1.302871
INFO:root:Train Epoch: 5 [640/50000 (10%)] Loss: 0.988255
INFO:root:Train Epoch: 5 [720/50000 (12%)] Loss: 1.694377
INFO:root:Train Epoch: 5 [800/50000 (13%)] Loss: 1.322922
INFO:root:Train Epoch: 5 [880/50000 (14%)] Loss: 0.877563
INFO:root:Train Epoch: 5 [960/50000 (15%)] Loss: 1.280301
INFO:root:Train Epoch: 5 [1040/50000 (17%)] Loss: 2.072935
INFO:root:Train Epoch: 5 [1120/50000 (18%)] Loss: 1.059145
INFO:root:Train Epoch: 5 [1200/50000 (19%)] Loss: 0.925303
INFO:root:Train Epoch: 5 [1280/50000 (20%)] Loss: 0.596431
INFO:root:Train Epoch: 5 [1360/50000 (22%)] Loss: 1.309161
INFO:root:Train Epoch: 5 [1440/50000 (23%)] Loss: 1.028656
INFO:root:Train Epoch: 5 [1520/50000 (24%)] Loss: 1.828205
INFO:root:Train Epoch: 5 [1600/50000 (26%)] Loss: 0.762174
INFO:root:Train Epoch: 5 [1680/50000 (27%)] Loss: 1.074789
INFO:root:Train Epoch: 5 [1760/50000 (28%)] Loss: 1.452503
INFO:root:Train Epoch: 5 [1840/50000 (29%)] Loss: 0.770785
INFO:root:Train Epoch: 5 [1920/50000 (31%)] Loss: 1.503325
INFO:root:Train Epoch: 5 [2000/50000 (32%)] Loss: 1.296901
INFO:root:Train Epoch: 5 [2080/50000 (33%)] Loss: 0.421790
INFO:root:Train Epoch: 5 [2160/50000 (35%)] Loss: 0.909721
INFO:root:Train Epoch: 5 [2240/50000 (36%)] Loss: 1.089372
INFO:root:Train Epoch: 5 [2320/50000 (37%)] Loss: 1.155136
INFO:root:Train Epoch: 5 [2400/50000 (38%)] Loss: 1.753152
INFO:root:Train Epoch: 5 [2480/50000 (40%)] Loss: 1.263815
INFO:root:Train Epoch: 5 [2560/50000 (41%)] Loss: 0.837905
INFO:root:Train Epoch: 5 [2640/50000 (42%)] Loss: 0.747354
INFO:root:Train Epoch: 5 [2720/50000 (43%)] Loss: 1.657751
INFO:root:Train Epoch: 5 [2800/50000 (45%)] Loss: 1.082929
INFO:root:Train Epoch: 5 [2880/50000 (46%)] Loss: 0.981887
INFO:root:Train Epoch: 5 [2960/50000 (47%)] Loss: 0.992953
INFO:root:Train Epoch: 5 [3040/50000 (49%)] Loss: 0.811697
INFO:root:Train Epoch: 5 [3120/50000 (50%)] Loss: 0.760716
INFO:root:Train Epoch: 5 [3200/50000 (51%)] Loss: 1.705397
INFO:root:Train Epoch: 5 [3280/50000 (52%)] Loss: 1.443986
INFO:root:Train Epoch: 5 [3360/50000 (54%)] Loss: 1.208950
INFO:root:Train Epoch: 5 [3440/50000 (55%)] Loss: 1.225412
INFO:root:Train Epoch: 5 [3520/50000 (56%)] Loss: 0.810848
INFO:root:Train Epoch: 5 [3600/50000 (58%)] Loss: 0.939034
INFO:root:Train Epoch: 5 [3680/50000 (59%)] Loss: 0.887410
INFO:root:Train Epoch: 5 [3760/50000 (60%)] Loss: 1.060195
INFO:root:Train Epoch: 5 [3840/50000 (61%)] Loss: 1.608685
INFO:root:Train Epoch: 5 [3920/50000 (63%)] Loss: 1.158689
INFO:root:Train Epoch: 5 [4000/50000 (64%)] Loss: 1.952622
INFO:root:Train Epoch: 5 [4080/50000 (65%)] Loss: 0.771346
INFO:root:Train Epoch: 5 [4160/50000 (66%)] Loss: 1.245132
INFO:root:Train Epoch: 5 [4240/50000 (68%)] Loss: 0.994396
INFO:root:Train Epoch: 5 [4320/50000 (69%)] Loss: 1.734128
INFO:root:Train Epoch: 5 [4400/50000 (70%)] Loss: 1.277112
INFO:root:Train Epoch: 5 [4480/50000 (72%)] Loss: 0.598512
INFO:root:Train Epoch: 5 [4560/50000 (73%)] Loss: 1.109040
INFO:root:Train Epoch: 5 [4640/50000 (74%)] Loss: 1.299262
INFO:root:Train Epoch: 5 [4720/50000 (75%)] Loss: 1.130803
INFO:root:Train Epoch: 5 [4800/50000 (77%)] Loss: 2.308003
INFO:root:Train Epoch: 5 [4880/50000 (78%)] Loss: 0.942097
INFO:root:Train Epoch: 5 [4960/50000 (79%)] Loss: 0.848142
INFO:root:Train Epoch: 5 [5040/50000 (81%)] Loss: 1.627363
INFO:root:Train Epoch: 5 [5120/50000 (82%)] Loss: 0.747682
INFO:root:Train Epoch: 5 [5200/50000 (83%)] Loss: 0.765125
INFO:root:Train Epoch: 5 [5280/50000 (84%)] Loss: 0.341389
INFO:root:Train Epoch: 5 [5360/50000 (86%)] Loss: 0.717333
INFO:root:Train Epoch: 5 [5440/50000 (87%)] Loss: 1.016493
INFO:root:Train Epoch: 5 [5520/50000 (88%)] Loss: 0.576617
INFO:root:Train Epoch: 5 [5600/50000 (90%)] Loss: 0.898620
INFO:root:Train Epoch: 5 [5680/50000 (91%)] Loss: 1.043450
INFO:root:Train Epoch: 5 [5760/50000 (92%)] Loss: 0.951038
INFO:root:Train Epoch: 5 [5840/50000 (93%)] Loss: 1.451940
INFO:root:Train Epoch: 5 [5920/50000 (95%)] Loss: 1.025864
INFO:root:Train Epoch: 5 [6000/50000 (96%)] Loss: 0.856748
INFO:root:Train Epoch: 5 [6080/50000 (97%)] Loss: 1.510426
INFO:root:Train Epoch: 5 [6160/50000 (98%)] Loss: 0.243770
INFO:root:Train Epoch: 5 [6240/50000 (100%)] Loss: 1.275648
INFO:root:
Test set: Average loss: 1.2371, Accuracy: 5748/10000 (57%)
INFO:root:Epoch time: 30.545427322387695
INFO:root:Train Epoch: 6 [0/50000 (0%)] Loss: 1.281361
INFO:root:Train Epoch: 6 [80/50000 (1%)] Loss: 1.318910
INFO:root:Train Epoch: 6 [160/50000 (3%)] Loss: 0.847154
INFO:root:Train Epoch: 6 [240/50000 (4%)] Loss: 1.607329
INFO:root:Train Epoch: 6 [320/50000 (5%)] Loss: 0.405321
INFO:root:Train Epoch: 6 [400/50000 (6%)] Loss: 1.099220
INFO:root:Train Epoch: 6 [480/50000 (8%)] Loss: 0.926893
INFO:root:Train Epoch: 6 [560/50000 (9%)] Loss: 0.757567
INFO:root:Train Epoch: 6 [640/50000 (10%)] Loss: 1.185125
INFO:root:Train Epoch: 6 [720/50000 (12%)] Loss: 1.071333
INFO:root:Train Epoch: 6 [800/50000 (13%)] Loss: 1.363698
INFO:root:Train Epoch: 6 [880/50000 (14%)] Loss: 0.842984
INFO:root:Train Epoch: 6 [960/50000 (15%)] Loss: 1.058706
INFO:root:Train Epoch: 6 [1040/50000 (17%)] Loss: 1.303154
INFO:root:Train Epoch: 6 [1120/50000 (18%)] Loss: 1.057460
INFO:root:Train Epoch: 6 [1200/50000 (19%)] Loss: 0.607925
INFO:root:Train Epoch: 6 [1280/50000 (20%)] Loss: 0.447552
INFO:root:Train Epoch: 6 [1360/50000 (22%)] Loss: 1.430436
INFO:root:Train Epoch: 6 [1440/50000 (23%)] Loss: 1.020742
INFO:root:Train Epoch: 6 [1520/50000 (24%)] Loss: 2.069448
INFO:root:Train Epoch: 6 [1600/50000 (26%)] Loss: 0.454729
INFO:root:Train Epoch: 6 [1680/50000 (27%)] Loss: 0.643455
INFO:root:Train Epoch: 6 [1760/50000 (28%)] Loss: 1.230341
INFO:root:Train Epoch: 6 [1840/50000 (29%)] Loss: 1.311561
INFO:root:Train Epoch: 6 [1920/50000 (31%)] Loss: 1.227825
INFO:root:Train Epoch: 6 [2000/50000 (32%)] Loss: 1.232090
INFO:root:Train Epoch: 6 [2080/50000 (33%)] Loss: 0.747748
INFO:root:Train Epoch: 6 [2160/50000 (35%)] Loss: 0.208283
INFO:root:Train Epoch: 6 [2240/50000 (36%)] Loss: 0.680684
INFO:root:Train Epoch: 6 [2320/50000 (37%)] Loss: 1.098393
INFO:root:Train Epoch: 6 [2400/50000 (38%)] Loss: 1.138387
INFO:root:Train Epoch: 6 [2480/50000 (40%)] Loss: 1.203115
INFO:root:Train Epoch: 6 [2560/50000 (41%)] Loss: 0.899981
INFO:root:Train Epoch: 6 [2640/50000 (42%)] Loss: 0.445412
INFO:root:Train Epoch: 6 [2720/50000 (43%)] Loss: 0.685790
INFO:root:Train Epoch: 6 [2800/50000 (45%)] Loss: 0.574225
INFO:root:Train Epoch: 6 [2880/50000 (46%)] Loss: 0.857173
INFO:root:Train Epoch: 6 [2960/50000 (47%)] Loss: 1.116636
INFO:root:Train Epoch: 6 [3040/50000 (49%)] Loss: 0.631800
INFO:root:Train Epoch: 6 [3120/50000 (50%)] Loss: 0.782844
INFO:root:Train Epoch: 6 [3200/50000 (51%)] Loss: 1.783543
INFO:root:Train Epoch: 6 [3280/50000 (52%)] Loss: 0.855822
INFO:root:Train Epoch: 6 [3360/50000 (54%)] Loss: 0.525805
INFO:root:Train Epoch: 6 [3440/50000 (55%)] Loss: 0.950884
INFO:root:Train Epoch: 6 [3520/50000 (56%)] Loss: 0.729211
INFO:root:Train Epoch: 6 [3600/50000 (58%)] Loss: 1.079521
INFO:root:Train Epoch: 6 [3680/50000 (59%)] Loss: 0.937003
INFO:root:Train Epoch: 6 [3760/50000 (60%)] Loss: 0.937868
INFO:root:Train Epoch: 6 [3840/50000 (61%)] Loss: 0.887981
INFO:root:Train Epoch: 6 [3920/50000 (63%)] Loss: 0.489963
INFO:root:Train Epoch: 6 [4000/50000 (64%)] Loss: 1.258300
INFO:root:Train Epoch: 6 [4080/50000 (65%)] Loss: 0.704352
INFO:root:Train Epoch: 6 [4160/50000 (66%)] Loss: 0.928431
INFO:root:Train Epoch: 6 [4240/50000 (68%)] Loss: 1.327838
INFO:root:Train Epoch: 6 [4320/50000 (69%)] Loss: 1.339573
INFO:root:Train Epoch: 6 [4400/50000 (70%)] Loss: 1.026527
INFO:root:Train Epoch: 6 [4480/50000 (72%)] Loss: 0.211520
INFO:root:Train Epoch: 6 [4560/50000 (73%)] Loss: 1.531722
INFO:root:Train Epoch: 6 [4640/50000 (74%)] Loss: 0.756867
INFO:root:Train Epoch: 6 [4720/50000 (75%)] Loss: 0.804198
INFO:root:Train Epoch: 6 [4800/50000 (77%)] Loss: 1.698059
INFO:root:Train Epoch: 6 [4880/50000 (78%)] Loss: 0.613216
INFO:root:Train Epoch: 6 [4960/50000 (79%)] Loss: 1.597762
INFO:root:Train Epoch: 6 [5040/50000 (81%)] Loss: 1.073994
INFO:root:Train Epoch: 6 [5120/50000 (82%)] Loss: 0.658829
INFO:root:Train Epoch: 6 [5200/50000 (83%)] Loss: 0.955158
INFO:root:Train Epoch: 6 [5280/50000 (84%)] Loss: 0.411401
INFO:root:Train Epoch: 6 [5360/50000 (86%)] Loss: 1.027680
INFO:root:Train Epoch: 6 [5440/50000 (87%)] Loss: 1.234288
INFO:root:Train Epoch: 6 [5520/50000 (88%)] Loss: 0.288699
INFO:root:Train Epoch: 6 [5600/50000 (90%)] Loss: 0.423883
INFO:root:Train Epoch: 6 [5680/50000 (91%)] Loss: 0.635992
INFO:root:Train Epoch: 6 [5760/50000 (92%)] Loss: 1.014220
INFO:root:Train Epoch: 6 [5840/50000 (93%)] Loss: 0.783886
INFO:root:Train Epoch: 6 [5920/50000 (95%)] Loss: 0.653725
INFO:root:Train Epoch: 6 [6000/50000 (96%)] Loss: 0.686486
INFO:root:Train Epoch: 6 [6080/50000 (97%)] Loss: 0.624022
INFO:root:Train Epoch: 6 [6160/50000 (98%)] Loss: 0.154315
INFO:root:Train Epoch: 6 [6240/50000 (100%)] Loss: 0.827227
INFO:root:
Test set: Average loss: 1.1598, Accuracy: 6168/10000 (62%)
INFO:root:Epoch time: 30.275245189666748
INFO:root:Train Epoch: 7 [0/50000 (0%)] Loss: 0.588812
INFO:root:Train Epoch: 7 [80/50000 (1%)] Loss: 1.580881
INFO:root:Train Epoch: 7 [160/50000 (3%)] Loss: 0.635561
INFO:root:Train Epoch: 7 [240/50000 (4%)] Loss: 1.798564
INFO:root:Train Epoch: 7 [320/50000 (5%)] Loss: 0.685117
INFO:root:Train Epoch: 7 [400/50000 (6%)] Loss: 0.910443
INFO:root:Train Epoch: 7 [480/50000 (8%)] Loss: 1.069390
INFO:root:Train Epoch: 7 [560/50000 (9%)] Loss: 0.677533
INFO:root:Train Epoch: 7 [640/50000 (10%)] Loss: 0.509418
INFO:root:Train Epoch: 7 [720/50000 (12%)] Loss: 1.340728
INFO:root:Train Epoch: 7 [800/50000 (13%)] Loss: 1.189702
INFO:root:Train Epoch: 7 [880/50000 (14%)] Loss: 0.449640
INFO:root:Train Epoch: 7 [960/50000 (15%)] Loss: 0.734689
INFO:root:Train Epoch: 7 [1040/50000 (17%)] Loss: 1.569899
INFO:root:Train Epoch: 7 [1120/50000 (18%)] Loss: 0.896657
INFO:root:Train Epoch: 7 [1200/50000 (19%)] Loss: 1.188791
INFO:root:Train Epoch: 7 [1280/50000 (20%)] Loss: 0.840283
INFO:root:Train Epoch: 7 [1360/50000 (22%)] Loss: 0.850214
INFO:root:Train Epoch: 7 [1440/50000 (23%)] Loss: 0.328219
INFO:root:Train Epoch: 7 [1520/50000 (24%)] Loss: 2.627230
INFO:root:Train Epoch: 7 [1600/50000 (26%)] Loss: 1.119516
INFO:root:Train Epoch: 7 [1680/50000 (27%)] Loss: 0.657385
INFO:root:Train Epoch: 7 [1760/50000 (28%)] Loss: 0.903042
INFO:root:Train Epoch: 7 [1840/50000 (29%)] Loss: 0.981492
INFO:root:Train Epoch: 7 [1920/50000 (31%)] Loss: 1.120113
INFO:root:Train Epoch: 7 [2000/50000 (32%)] Loss: 1.116084
INFO:root:Train Epoch: 7 [2080/50000 (33%)] Loss: 0.820303
INFO:root:Train Epoch: 7 [2160/50000 (35%)] Loss: 0.144251
INFO:root:Train Epoch: 7 [2240/50000 (36%)] Loss: 1.239521
INFO:root:Train Epoch: 7 [2320/50000 (37%)] Loss: 0.950246
INFO:root:Train Epoch: 7 [2400/50000 (38%)] Loss: 1.515040
INFO:root:Train Epoch: 7 [2480/50000 (40%)] Loss: 1.188339
INFO:root:Train Epoch: 7 [2560/50000 (41%)] Loss: 0.787621
INFO:root:Train Epoch: 7 [2640/50000 (42%)] Loss: 0.518182
INFO:root:Train Epoch: 7 [2720/50000 (43%)] Loss: 1.808843
INFO:root:Train Epoch: 7 [2800/50000 (45%)] Loss: 0.653970
INFO:root:Train Epoch: 7 [2880/50000 (46%)] Loss: 0.633788
INFO:root:Train Epoch: 7 [2960/50000 (47%)] Loss: 0.795235
INFO:root:Train Epoch: 7 [3040/50000 (49%)] Loss: 1.747397
INFO:root:Train Epoch: 7 [3120/50000 (50%)] Loss: 0.520925
INFO:root:Train Epoch: 7 [3200/50000 (51%)] Loss: 0.597389
INFO:root:Train Epoch: 7 [3280/50000 (52%)] Loss: 0.802483
INFO:root:Train Epoch: 7 [3360/50000 (54%)] Loss: 0.362846
INFO:root:Train Epoch: 7 [3440/50000 (55%)] Loss: 1.107782
INFO:root:Train Epoch: 7 [3520/50000 (56%)] Loss: 0.414385
INFO:root:Train Epoch: 7 [3600/50000 (58%)] Loss: 0.967745
INFO:root:Train Epoch: 7 [3680/50000 (59%)] Loss: 0.497621
INFO:root:Train Epoch: 7 [3760/50000 (60%)] Loss: 0.545378
INFO:root:Train Epoch: 7 [3840/50000 (61%)] Loss: 1.026295
INFO:root:Train Epoch: 7 [3920/50000 (63%)] Loss: 0.575762
INFO:root:Train Epoch: 7 [4000/50000 (64%)] Loss: 1.809316
INFO:root:Train Epoch: 7 [4080/50000 (65%)] Loss: 0.764221
INFO:root:Train Epoch: 7 [4160/50000 (66%)] Loss: 0.742279
INFO:root:Train Epoch: 7 [4240/50000 (68%)] Loss: 1.502498
INFO:root:Train Epoch: 7 [4320/50000 (69%)] Loss: 0.978763
INFO:root:Train Epoch: 7 [4400/50000 (70%)] Loss: 0.868790
INFO:root:Train Epoch: 7 [4480/50000 (72%)] Loss: 0.085283
INFO:root:Train Epoch: 7 [4560/50000 (73%)] Loss: 1.523093
INFO:root:Train Epoch: 7 [4640/50000 (74%)] Loss: 0.670323
INFO:root:Train Epoch: 7 [4720/50000 (75%)] Loss: 1.069291
INFO:root:Train Epoch: 7 [4800/50000 (77%)] Loss: 1.219691
INFO:root:Train Epoch: 7 [4880/50000 (78%)] Loss: 0.925881
INFO:root:Train Epoch: 7 [4960/50000 (79%)] Loss: 1.694647
INFO:root:Train Epoch: 7 [5040/50000 (81%)] Loss: 1.289392
INFO:root:Train Epoch: 7 [5120/50000 (82%)] Loss: 0.384615
INFO:root:Train Epoch: 7 [5200/50000 (83%)] Loss: 0.739997
INFO:root:Train Epoch: 7 [5280/50000 (84%)] Loss: 0.209255
INFO:root:Train Epoch: 7 [5360/50000 (86%)] Loss: 1.318551
INFO:root:Train Epoch: 7 [5440/50000 (87%)] Loss: 0.888471
INFO:root:Train Epoch: 7 [5520/50000 (88%)] Loss: 0.589757
INFO:root:Train Epoch: 7 [5600/50000 (90%)] Loss: 0.233342
INFO:root:Train Epoch: 7 [5680/50000 (91%)] Loss: 1.039745
INFO:root:Train Epoch: 7 [5760/50000 (92%)] Loss: 1.042616
INFO:root:Train Epoch: 7 [5840/50000 (93%)] Loss: 1.181321
INFO:root:Train Epoch: 7 [5920/50000 (95%)] Loss: 0.487899
INFO:root:Train Epoch: 7 [6000/50000 (96%)] Loss: 0.499617
INFO:root:Train Epoch: 7 [6080/50000 (97%)] Loss: 1.185239
INFO:root:Train Epoch: 7 [6160/50000 (98%)] Loss: 0.261593
INFO:root:Train Epoch: 7 [6240/50000 (100%)] Loss: 0.901599
INFO:root:
Test set: Average loss: 1.0066, Accuracy: 6654/10000 (67%)
INFO:root:Epoch time: 23.18604278564453
INFO:root:Train Epoch: 8 [0/50000 (0%)] Loss: 0.596978
INFO:root:Train Epoch: 8 [80/50000 (1%)] Loss: 0.990683
INFO:root:Train Epoch: 8 [160/50000 (3%)] Loss: 0.921793
INFO:root:Train Epoch: 8 [240/50000 (4%)] Loss: 0.859732
INFO:root:Train Epoch: 8 [320/50000 (5%)] Loss: 0.370992
INFO:root:Train Epoch: 8 [400/50000 (6%)] Loss: 0.567204
INFO:root:Train Epoch: 8 [480/50000 (8%)] Loss: 0.844704
INFO:root:Train Epoch: 8 [560/50000 (9%)] Loss: 1.080178
INFO:root:Train Epoch: 8 [640/50000 (10%)] Loss: 0.660832
INFO:root:Train Epoch: 8 [720/50000 (12%)] Loss: 1.014574
INFO:root:Train Epoch: 8 [800/50000 (13%)] Loss: 0.712794
INFO:root:Train Epoch: 8 [880/50000 (14%)] Loss: 0.607110
INFO:root:Train Epoch: 8 [960/50000 (15%)] Loss: 1.303677
INFO:root:Train Epoch: 8 [1040/50000 (17%)] Loss: 1.270071
INFO:root:Train Epoch: 8 [1120/50000 (18%)] Loss: 1.180368
INFO:root:Train Epoch: 8 [1200/50000 (19%)] Loss: 0.416422
INFO:root:Train Epoch: 8 [1280/50000 (20%)] Loss: 0.807112
INFO:root:Train Epoch: 8 [1360/50000 (22%)] Loss: 1.536701
INFO:root:Train Epoch: 8 [1440/50000 (23%)] Loss: 0.289217
INFO:root:Train Epoch: 8 [1520/50000 (24%)] Loss: 0.448846
INFO:root:Train Epoch: 8 [1600/50000 (26%)] Loss: 0.843617
INFO:root:Train Epoch: 8 [1680/50000 (27%)] Loss: 1.057996
INFO:root:Train Epoch: 8 [1760/50000 (28%)] Loss: 1.128989
INFO:root:Train Epoch: 8 [1840/50000 (29%)] Loss: 1.870939
INFO:root:Train Epoch: 8 [1920/50000 (31%)] Loss: 1.337647
INFO:root:Train Epoch: 8 [2000/50000 (32%)] Loss: 1.095257
INFO:root:Train Epoch: 8 [2080/50000 (33%)] Loss: 0.890030
INFO:root:Train Epoch: 8 [2160/50000 (35%)] Loss: 0.122903
INFO:root:Train Epoch: 8 [2240/50000 (36%)] Loss: 0.997073
INFO:root:Train Epoch: 8 [2320/50000 (37%)] Loss: 0.783411
INFO:root:Train Epoch: 8 [2400/50000 (38%)] Loss: 1.172412
INFO:root:Train Epoch: 8 [2480/50000 (40%)] Loss: 1.577134
INFO:root:Train Epoch: 8 [2560/50000 (41%)] Loss: 0.631141
INFO:root:Train Epoch: 8 [2640/50000 (42%)] Loss: 0.390531
INFO:root:Train Epoch: 8 [2720/50000 (43%)] Loss: 1.129177
INFO:root:Train Epoch: 8 [2800/50000 (45%)] Loss: 0.872965
INFO:root:Train Epoch: 8 [2880/50000 (46%)] Loss: 1.001533
INFO:root:Train Epoch: 8 [2960/50000 (47%)] Loss: 0.478834
INFO:root:Train Epoch: 8 [3040/50000 (49%)] Loss: 0.490087
INFO:root:Train Epoch: 8 [3120/50000 (50%)] Loss: 1.008001
INFO:root:Train Epoch: 8 [3200/50000 (51%)] Loss: 1.655400
INFO:root:Train Epoch: 8 [3280/50000 (52%)] Loss: 0.450502
INFO:root:Train Epoch: 8 [3360/50000 (54%)] Loss: 0.384750
INFO:root:Train Epoch: 8 [3440/50000 (55%)] Loss: 1.396673
INFO:root:Train Epoch: 8 [3520/50000 (56%)] Loss: 0.178285
INFO:root:Train Epoch: 8 [3600/50000 (58%)] Loss: 1.385121
INFO:root:Train Epoch: 8 [3680/50000 (59%)] Loss: 0.413087
INFO:root:Train Epoch: 8 [3760/50000 (60%)] Loss: 0.409400
INFO:root:Train Epoch: 8 [3840/50000 (61%)] Loss: 1.157255
INFO:root:Train Epoch: 8 [3920/50000 (63%)] Loss: 0.668810
INFO:root:Train Epoch: 8 [4000/50000 (64%)] Loss: 0.756500
INFO:root:Train Epoch: 8 [4080/50000 (65%)] Loss: 0.686146
INFO:root:Train Epoch: 8 [4160/50000 (66%)] Loss: 0.485506
INFO:root:Train Epoch: 8 [4240/50000 (68%)] Loss: 0.340662
INFO:root:Train Epoch: 8 [4320/50000 (69%)] Loss: 0.937751
INFO:root:Train Epoch: 8 [4400/50000 (70%)] Loss: 0.763111
INFO:root:Train Epoch: 8 [4480/50000 (72%)] Loss: 0.092425
INFO:root:Train Epoch: 8 [4560/50000 (73%)] Loss: 1.052019
INFO:root:Train Epoch: 8 [4640/50000 (74%)] Loss: 0.854956
INFO:root:Train Epoch: 8 [4720/50000 (75%)] Loss: 0.695714
INFO:root:Train Epoch: 8 [4800/50000 (77%)] Loss: 0.884178
INFO:root:Train Epoch: 8 [4880/50000 (78%)] Loss: 1.178430
INFO:root:Train Epoch: 8 [4960/50000 (79%)] Loss: 1.139965
INFO:root:Train Epoch: 8 [5040/50000 (81%)] Loss: 1.037670
INFO:root:Train Epoch: 8 [5120/50000 (82%)] Loss: 0.520607
INFO:root:Train Epoch: 8 [5200/50000 (83%)] Loss: 0.821322
INFO:root:Train Epoch: 8 [5280/50000 (84%)] Loss: 0.425549
INFO:root:Train Epoch: 8 [5360/50000 (86%)] Loss: 0.773207
INFO:root:Train Epoch: 8 [5440/50000 (87%)] Loss: 1.099116
INFO:root:Train Epoch: 8 [5520/50000 (88%)] Loss: 0.500734
INFO:root:Train Epoch: 8 [5600/50000 (90%)] Loss: 0.786641
INFO:root:Train Epoch: 8 [5680/50000 (91%)] Loss: 0.556628
INFO:root:Train Epoch: 8 [5760/50000 (92%)] Loss: 0.697607
INFO:root:Train Epoch: 8 [5840/50000 (93%)] Loss: 1.331391
INFO:root:Train Epoch: 8 [5920/50000 (95%)] Loss: 0.784513
INFO:root:Train Epoch: 8 [6000/50000 (96%)] Loss: 0.574366
INFO:root:Train Epoch: 8 [6080/50000 (97%)] Loss: 1.228585
INFO:root:Train Epoch: 8 [6160/50000 (98%)] Loss: 0.154650
INFO:root:Train Epoch: 8 [6240/50000 (100%)] Loss: 1.117633
INFO:root:
Test set: Average loss: 0.8836, Accuracy: 7062/10000 (71%)
INFO:root:Epoch time: 22.498751401901245
INFO:root:Train Epoch: 9 [0/50000 (0%)] Loss: 0.424283
INFO:root:Train Epoch: 9 [80/50000 (1%)] Loss: 1.284575
INFO:root:Train Epoch: 9 [160/50000 (3%)] Loss: 0.861503
INFO:root:Train Epoch: 9 [240/50000 (4%)] Loss: 0.957933
INFO:root:Train Epoch: 9 [320/50000 (5%)] Loss: 0.495244
INFO:root:Train Epoch: 9 [400/50000 (6%)] Loss: 0.330130
INFO:root:Train Epoch: 9 [480/50000 (8%)] Loss: 0.880968
INFO:root:Train Epoch: 9 [560/50000 (9%)] Loss: 0.684077
INFO:root:Train Epoch: 9 [640/50000 (10%)] Loss: 0.616765
INFO:root:Train Epoch: 9 [720/50000 (12%)] Loss: 1.516392
INFO:root:Train Epoch: 9 [800/50000 (13%)] Loss: 0.732821
INFO:root:Train Epoch: 9 [880/50000 (14%)] Loss: 0.478586
INFO:root:Train Epoch: 9 [960/50000 (15%)] Loss: 1.561521
INFO:root:Train Epoch: 9 [1040/50000 (17%)] Loss: 1.975109
INFO:root:Train Epoch: 9 [1120/50000 (18%)] Loss: 0.552237
INFO:root:Train Epoch: 9 [1200/50000 (19%)] Loss: 0.901236
INFO:root:Train Epoch: 9 [1280/50000 (20%)] Loss: 0.324421
INFO:root:Train Epoch: 9 [1360/50000 (22%)] Loss: 0.913631
INFO:root:Train Epoch: 9 [1440/50000 (23%)] Loss: 0.412392
INFO:root:Train Epoch: 9 [1520/50000 (24%)] Loss: 0.424053
INFO:root:Train Epoch: 9 [1600/50000 (26%)] Loss: 0.860494
INFO:root:Train Epoch: 9 [1680/50000 (27%)] Loss: 0.466401
INFO:root:Train Epoch: 9 [1760/50000 (28%)] Loss: 0.764615
INFO:root:Train Epoch: 9 [1840/50000 (29%)] Loss: 0.319452
INFO:root:Train Epoch: 9 [1920/50000 (31%)] Loss: 1.364230
INFO:root:Train Epoch: 9 [2000/50000 (32%)] Loss: 1.094860
INFO:root:Train Epoch: 9 [2080/50000 (33%)] Loss: 1.117346
INFO:root:Train Epoch: 9 [2160/50000 (35%)] Loss: 0.218677
INFO:root:Train Epoch: 9 [2240/50000 (36%)] Loss: 1.256392
INFO:root:Train Epoch: 9 [2320/50000 (37%)] Loss: 1.020307
INFO:root:Train Epoch: 9 [2400/50000 (38%)] Loss: 0.730970
INFO:root:Train Epoch: 9 [2480/50000 (40%)] Loss: 1.799856
INFO:root:Train Epoch: 9 [2560/50000 (41%)] Loss: 1.080693
INFO:root:Train Epoch: 9 [2640/50000 (42%)] Loss: 0.602524
INFO:root:Train Epoch: 9 [2720/50000 (43%)] Loss: 0.636523
INFO:root:Train Epoch: 9 [2800/50000 (45%)] Loss: 1.122926
INFO:root:Train Epoch: 9 [2880/50000 (46%)] Loss: 0.273299
INFO:root:Train Epoch: 9 [2960/50000 (47%)] Loss: 0.542395
INFO:root:Train Epoch: 9 [3040/50000 (49%)] Loss: 0.510375
INFO:root:Train Epoch: 9 [3120/50000 (50%)] Loss: 0.666100
INFO:root:Train Epoch: 9 [3200/50000 (51%)] Loss: 1.148543
INFO:root:Train Epoch: 9 [3280/50000 (52%)] Loss: 0.883612
INFO:root:Train Epoch: 9 [3360/50000 (54%)] Loss: 0.681936
INFO:root:Train Epoch: 9 [3440/50000 (55%)] Loss: 0.890897
INFO:root:Train Epoch: 9 [3520/50000 (56%)] Loss: 0.427001
INFO:root:Train Epoch: 9 [3600/50000 (58%)] Loss: 0.688438
INFO:root:Train Epoch: 9 [3680/50000 (59%)] Loss: 0.552784
INFO:root:Train Epoch: 9 [3760/50000 (60%)] Loss: 0.259267
INFO:root:Train Epoch: 9 [3840/50000 (61%)] Loss: 0.880405
INFO:root:Train Epoch: 9 [3920/50000 (63%)] Loss: 0.244839
INFO:root:Train Epoch: 9 [4000/50000 (64%)] Loss: 1.373575
INFO:root:Train Epoch: 9 [4080/50000 (65%)] Loss: 0.339990
INFO:root:Train Epoch: 9 [4160/50000 (66%)] Loss: 0.395720
INFO:root:Train Epoch: 9 [4240/50000 (68%)] Loss: 0.154440
INFO:root:Train Epoch: 9 [4320/50000 (69%)] Loss: 0.626203
INFO:root:Train Epoch: 9 [4400/50000 (70%)] Loss: 1.734851
INFO:root:Train Epoch: 9 [4480/50000 (72%)] Loss: 0.063308
INFO:root:Train Epoch: 9 [4560/50000 (73%)] Loss: 0.812914
INFO:root:Train Epoch: 9 [4640/50000 (74%)] Loss: 0.244070
INFO:root:Train Epoch: 9 [4720/50000 (75%)] Loss: 1.166016
INFO:root:Train Epoch: 9 [4800/50000 (77%)] Loss: 0.716567
INFO:root:Train Epoch: 9 [4880/50000 (78%)] Loss: 0.607996
INFO:root:Train Epoch: 9 [4960/50000 (79%)] Loss: 0.658152
INFO:root:Train Epoch: 9 [5040/50000 (81%)] Loss: 0.647579
INFO:root:Train Epoch: 9 [5120/50000 (82%)] Loss: 0.487793
INFO:root:Train Epoch: 9 [5200/50000 (83%)] Loss: 0.771936
INFO:root:Train Epoch: 9 [5280/50000 (84%)] Loss: 0.146605
INFO:root:Train Epoch: 9 [5360/50000 (86%)] Loss: 0.224849
INFO:root:Train Epoch: 9 [5440/50000 (87%)] Loss: 0.826616
INFO:root:Train Epoch: 9 [5520/50000 (88%)] Loss: 0.422058
INFO:root:Train Epoch: 9 [5600/50000 (90%)] Loss: 0.191733
INFO:root:Train Epoch: 9 [5680/50000 (91%)] Loss: 0.769444
INFO:root:Train Epoch: 9 [5760/50000 (92%)] Loss: 0.762571
INFO:root:Train Epoch: 9 [5840/50000 (93%)] Loss: 0.951001
INFO:root:Train Epoch: 9 [5920/50000 (95%)] Loss: 0.714903
INFO:root:Train Epoch: 9 [6000/50000 (96%)] Loss: 0.313025
INFO:root:Train Epoch: 9 [6080/50000 (97%)] Loss: 0.750842
INFO:root:Train Epoch: 9 [6160/50000 (98%)] Loss: 0.035296
INFO:root:Train Epoch: 9 [6240/50000 (100%)] Loss: 0.763336
INFO:root:
Test set: Average loss: 0.9909, Accuracy: 6769/10000 (68%)
INFO:root:Epoch time: 22.340657234191895
INFO:root:Train Epoch: 10 [0/50000 (0%)] Loss: 0.954179
INFO:root:Train Epoch: 10 [80/50000 (1%)] Loss: 1.732517
INFO:root:Train Epoch: 10 [160/50000 (3%)] Loss: 0.926099
INFO:root:Train Epoch: 10 [240/50000 (4%)] Loss: 0.796166
INFO:root:Train Epoch: 10 [320/50000 (5%)] Loss: 0.411826
INFO:root:Train Epoch: 10 [400/50000 (6%)] Loss: 0.256121
INFO:root:Train Epoch: 10 [480/50000 (8%)] Loss: 1.101908
INFO:root:Train Epoch: 10 [560/50000 (9%)] Loss: 0.558210
INFO:root:Train Epoch: 10 [640/50000 (10%)] Loss: 0.608257
INFO:root:Train Epoch: 10 [720/50000 (12%)] Loss: 1.248900
INFO:root:Train Epoch: 10 [800/50000 (13%)] Loss: 0.617808
INFO:root:Train Epoch: 10 [880/50000 (14%)] Loss: 0.764815
INFO:root:Train Epoch: 10 [960/50000 (15%)] Loss: 0.458086
INFO:root:Train Epoch: 10 [1040/50000 (17%)] Loss: 1.835626
INFO:root:Train Epoch: 10 [1120/50000 (18%)] Loss: 0.727342
INFO:root:Train Epoch: 10 [1200/50000 (19%)] Loss: 0.365412
INFO:root:Train Epoch: 10 [1280/50000 (20%)] Loss: 0.247198
INFO:root:Train Epoch: 10 [1360/50000 (22%)] Loss: 2.073148
INFO:root:Train Epoch: 10 [1440/50000 (23%)] Loss: 0.239084
INFO:root:Train Epoch: 10 [1520/50000 (24%)] Loss: 0.449502
INFO:root:Train Epoch: 10 [1600/50000 (26%)] Loss: 0.385866
INFO:root:Train Epoch: 10 [1680/50000 (27%)] Loss: 0.432609
INFO:root:Train Epoch: 10 [1760/50000 (28%)] Loss: 0.906021
INFO:root:Train Epoch: 10 [1840/50000 (29%)] Loss: 1.015196
INFO:root:Train Epoch: 10 [1920/50000 (31%)] Loss: 0.983764
INFO:root:Train Epoch: 10 [2000/50000 (32%)] Loss: 0.931711
INFO:root:Train Epoch: 10 [2080/50000 (33%)] Loss: 0.812501
INFO:root:Train Epoch: 10 [2160/50000 (35%)] Loss: 0.034617
INFO:root:Train Epoch: 10 [2240/50000 (36%)] Loss: 0.745396
INFO:root:Train Epoch: 10 [2320/50000 (37%)] Loss: 0.634563
INFO:root:Train Epoch: 10 [2400/50000 (38%)] Loss: 1.029359
INFO:root:Train Epoch: 10 [2480/50000 (40%)] Loss: 1.172975
INFO:root:Train Epoch: 10 [2560/50000 (41%)] Loss: 0.749753
INFO:root:Train Epoch: 10 [2640/50000 (42%)] Loss: 0.183208
INFO:root:Train Epoch: 10 [2720/50000 (43%)] Loss: 0.948232
INFO:root:Train Epoch: 10 [2800/50000 (45%)] Loss: 0.969341
INFO:root:Train Epoch: 10 [2880/50000 (46%)] Loss: 0.256581
INFO:root:Train Epoch: 10 [2960/50000 (47%)] Loss: 0.502808
INFO:root:Train Epoch: 10 [3040/50000 (49%)] Loss: 0.604781
INFO:root:Train Epoch: 10 [3120/50000 (50%)] Loss: 1.100887
INFO:root:Train Epoch: 10 [3200/50000 (51%)] Loss: 1.208025
INFO:root:Train Epoch: 10 [3280/50000 (52%)] Loss: 0.290820
INFO:root:Train Epoch: 10 [3360/50000 (54%)] Loss: 0.704092
INFO:root:Train Epoch: 10 [3440/50000 (55%)] Loss: 0.814410
INFO:root:Train Epoch: 10 [3520/50000 (56%)] Loss: 0.277389
INFO:root:Train Epoch: 10 [3600/50000 (58%)] Loss: 0.889096
INFO:root:Train Epoch: 10 [3680/50000 (59%)] Loss: 0.741906
INFO:root:Train Epoch: 10 [3760/50000 (60%)] Loss: 0.353702
INFO:root:Train Epoch: 10 [3840/50000 (61%)] Loss: 0.747593
INFO:root:Train Epoch: 10 [3920/50000 (63%)] Loss: 0.387989
INFO:root:Train Epoch: 10 [4000/50000 (64%)] Loss: 1.123707
INFO:root:Train Epoch: 10 [4080/50000 (65%)] Loss: 0.184653
INFO:root:Train Epoch: 10 [4160/50000 (66%)] Loss: 0.525145
INFO:root:Train Epoch: 10 [4240/50000 (68%)] Loss: 0.443284
INFO:root:Train Epoch: 10 [4320/50000 (69%)] Loss: 1.113302
INFO:root:Train Epoch: 10 [4400/50000 (70%)] Loss: 0.813419
INFO:root:Train Epoch: 10 [4480/50000 (72%)] Loss: 0.281217
INFO:root:Train Epoch: 10 [4560/50000 (73%)] Loss: 0.664455
INFO:root:Train Epoch: 10 [4640/50000 (74%)] Loss: 0.180425
INFO:root:Train Epoch: 10 [4720/50000 (75%)] Loss: 0.627908
INFO:root:Train Epoch: 10 [4800/50000 (77%)] Loss: 0.659521
INFO:root:Train Epoch: 10 [4880/50000 (78%)] Loss: 0.178042
INFO:root:Train Epoch: 10 [4960/50000 (79%)] Loss: 1.199844
INFO:root:Train Epoch: 10 [5040/50000 (81%)] Loss: 0.788902
INFO:root:Train Epoch: 10 [5120/50000 (82%)] Loss: 1.058518
INFO:root:Train Epoch: 10 [5200/50000 (83%)] Loss: 1.119751
INFO:root:Train Epoch: 10 [5280/50000 (84%)] Loss: 0.103538
INFO:root:Train Epoch: 10 [5360/50000 (86%)] Loss: 0.810262
INFO:root:Train Epoch: 10 [5440/50000 (87%)] Loss: 0.605515
INFO:root:Train Epoch: 10 [5520/50000 (88%)] Loss: 0.276378
INFO:root:Train Epoch: 10 [5600/50000 (90%)] Loss: 0.252038
INFO:root:Train Epoch: 10 [5680/50000 (91%)] Loss: 1.370721
INFO:root:Train Epoch: 10 [5760/50000 (92%)] Loss: 1.004714
INFO:root:Train Epoch: 10 [5840/50000 (93%)] Loss: 0.813363
INFO:root:Train Epoch: 10 [5920/50000 (95%)] Loss: 0.398955
INFO:root:Train Epoch: 10 [6000/50000 (96%)] Loss: 0.796209
INFO:root:Train Epoch: 10 [6080/50000 (97%)] Loss: 0.696200
INFO:root:Train Epoch: 10 [6160/50000 (98%)] Loss: 0.063817
INFO:root:Train Epoch: 10 [6240/50000 (100%)] Loss: 0.575955
INFO:root:
Test set: Average loss: 0.8315, Accuracy: 7259/10000 (73%)
INFO:root:Epoch time: 23.137418031692505
INFO:root:Train Epoch: 11 [0/50000 (0%)] Loss: 0.682293
INFO:root:Train Epoch: 11 [80/50000 (1%)] Loss: 1.360934
INFO:root:Train Epoch: 11 [160/50000 (3%)] Loss: 1.137584
INFO:root:Train Epoch: 11 [240/50000 (4%)] Loss: 1.030746
INFO:root:Train Epoch: 11 [320/50000 (5%)] Loss: 0.298686
INFO:root:Train Epoch: 11 [400/50000 (6%)] Loss: 0.292374
INFO:root:Train Epoch: 11 [480/50000 (8%)] Loss: 0.754160
INFO:root:Train Epoch: 11 [560/50000 (9%)] Loss: 0.689737
INFO:root:Train Epoch: 11 [640/50000 (10%)] Loss: 0.768699
INFO:root:Train Epoch: 11 [720/50000 (12%)] Loss: 0.875072
INFO:root:Train Epoch: 11 [800/50000 (13%)] Loss: 0.777661
INFO:root:Train Epoch: 11 [880/50000 (14%)] Loss: 0.915926
INFO:root:Train Epoch: 11 [960/50000 (15%)] Loss: 0.763211
INFO:root:Train Epoch: 11 [1040/50000 (17%)] Loss: 1.190098
INFO:root:Train Epoch: 11 [1120/50000 (18%)] Loss: 0.856777
INFO:root:Train Epoch: 11 [1200/50000 (19%)] Loss: 0.514774
INFO:root:Train Epoch: 11 [1280/50000 (20%)] Loss: 0.644377
INFO:root:Train Epoch: 11 [1360/50000 (22%)] Loss: 1.590923
INFO:root:Train Epoch: 11 [1440/50000 (23%)] Loss: 0.431846
INFO:root:Train Epoch: 11 [1520/50000 (24%)] Loss: 0.225443
INFO:root:Train Epoch: 11 [1600/50000 (26%)] Loss: 0.800045
INFO:root:Train Epoch: 11 [1680/50000 (27%)] Loss: 0.303215
INFO:root:Train Epoch: 11 [1760/50000 (28%)] Loss: 0.519048
INFO:root:Train Epoch: 11 [1840/50000 (29%)] Loss: 0.598382
INFO:root:Train Epoch: 11 [1920/50000 (31%)] Loss: 0.680516
INFO:root:Train Epoch: 11 [2000/50000 (32%)] Loss: 0.736580
INFO:root:Train Epoch: 11 [2080/50000 (33%)] Loss: 0.353193
INFO:root:Train Epoch: 11 [2160/50000 (35%)] Loss: 0.055373
INFO:root:Train Epoch: 11 [2240/50000 (36%)] Loss: 1.088447
INFO:root:Train Epoch: 11 [2320/50000 (37%)] Loss: 0.156857
INFO:root:Train Epoch: 11 [2400/50000 (38%)] Loss: 0.612340
INFO:root:Train Epoch: 11 [2480/50000 (40%)] Loss: 1.052839
INFO:root:Train Epoch: 11 [2560/50000 (41%)] Loss: 0.276154
INFO:root:Train Epoch: 11 [2640/50000 (42%)] Loss: 0.103210
INFO:root:Train Epoch: 11 [2720/50000 (43%)] Loss: 0.840660
INFO:root:Train Epoch: 11 [2800/50000 (45%)] Loss: 0.479550
INFO:root:Train Epoch: 11 [2880/50000 (46%)] Loss: 0.232080
INFO:root:Train Epoch: 11 [2960/50000 (47%)] Loss: 0.439999
INFO:root:Train Epoch: 11 [3040/50000 (49%)] Loss: 0.654224
INFO:root:Train Epoch: 11 [3120/50000 (50%)] Loss: 0.356144
INFO:root:Train Epoch: 11 [3200/50000 (51%)] Loss: 1.593766
INFO:root:Train Epoch: 11 [3280/50000 (52%)] Loss: 0.584175
INFO:root:Train Epoch: 11 [3360/50000 (54%)] Loss: 0.593147
INFO:root:Train Epoch: 11 [3440/50000 (55%)] Loss: 1.210141
INFO:root:Train Epoch: 11 [3520/50000 (56%)] Loss: 0.119039
INFO:root:Train Epoch: 11 [3600/50000 (58%)] Loss: 0.617340
INFO:root:Train Epoch: 11 [3680/50000 (59%)] Loss: 0.291465
INFO:root:Train Epoch: 11 [3760/50000 (60%)] Loss: 0.505697
INFO:root:Train Epoch: 11 [3840/50000 (61%)] Loss: 0.752808
INFO:root:Train Epoch: 11 [3920/50000 (63%)] Loss: 0.172597
INFO:root:Train Epoch: 11 [4000/50000 (64%)] Loss: 0.773650
INFO:root:Train Epoch: 11 [4080/50000 (65%)] Loss: 1.064563
INFO:root:Train Epoch: 11 [4160/50000 (66%)] Loss: 0.243251
INFO:root:Train Epoch: 11 [4240/50000 (68%)] Loss: 0.600274
INFO:root:Train Epoch: 11 [4320/50000 (69%)] Loss: 1.190411
INFO:root:Train Epoch: 11 [4400/50000 (70%)] Loss: 0.974640
INFO:root:Train Epoch: 11 [4480/50000 (72%)] Loss: 0.698606
INFO:root:Train Epoch: 11 [4560/50000 (73%)] Loss: 0.697273
INFO:root:Train Epoch: 11 [4640/50000 (74%)] Loss: 0.702725
INFO:root:Train Epoch: 11 [4720/50000 (75%)] Loss: 0.474613
INFO:root:Train Epoch: 11 [4800/50000 (77%)] Loss: 0.637600
INFO:root:Train Epoch: 11 [4880/50000 (78%)] Loss: 0.409410
INFO:root:Train Epoch: 11 [4960/50000 (79%)] Loss: 0.817789
INFO:root:Train Epoch: 11 [5040/50000 (81%)] Loss: 0.206232
INFO:root:Train Epoch: 11 [5120/50000 (82%)] Loss: 0.602871
INFO:root:Train Epoch: 11 [5200/50000 (83%)] Loss: 0.668004
INFO:root:Train Epoch: 11 [5280/50000 (84%)] Loss: 0.191477
INFO:root:Train Epoch: 11 [5360/50000 (86%)] Loss: 0.492709
INFO:root:Train Epoch: 11 [5440/50000 (87%)] Loss: 0.656811
INFO:root:Train Epoch: 11 [5520/50000 (88%)] Loss: 0.697705
INFO:root:Train Epoch: 11 [5600/50000 (90%)] Loss: 0.112675
INFO:root:Train Epoch: 11 [5680/50000 (91%)] Loss: 0.532464
INFO:root:Train Epoch: 11 [5760/50000 (92%)] Loss: 0.497422
INFO:root:Train Epoch: 11 [5840/50000 (93%)] Loss: 1.207425
INFO:root:Train Epoch: 11 [5920/50000 (95%)] Loss: 0.428938
INFO:root:Train Epoch: 11 [6000/50000 (96%)] Loss: 0.711816
INFO:root:Train Epoch: 11 [6080/50000 (97%)] Loss: 0.817254
INFO:root:Train Epoch: 11 [6160/50000 (98%)] Loss: 0.019954
INFO:root:Train Epoch: 11 [6240/50000 (100%)] Loss: 0.659375
INFO:root:
Test set: Average loss: 0.9269, Accuracy: 7017/10000 (70%)
INFO:root:Epoch time: 22.39287805557251
INFO:root:Train Epoch: 12 [0/50000 (0%)] Loss: 0.590945
INFO:root:Train Epoch: 12 [80/50000 (1%)] Loss: 0.679271
INFO:root:Train Epoch: 12 [160/50000 (3%)] Loss: 1.702273
INFO:root:Train Epoch: 12 [240/50000 (4%)] Loss: 0.334268
INFO:root:Train Epoch: 12 [320/50000 (5%)] Loss: 0.300015
INFO:root:Train Epoch: 12 [400/50000 (6%)] Loss: 0.321215
INFO:root:Train Epoch: 12 [480/50000 (8%)] Loss: 0.733487
INFO:root:Train Epoch: 12 [560/50000 (9%)] Loss: 0.523459
INFO:root:Train Epoch: 12 [640/50000 (10%)] Loss: 0.466175
INFO:root:Train Epoch: 12 [720/50000 (12%)] Loss: 0.719314
INFO:root:Train Epoch: 12 [800/50000 (13%)] Loss: 0.439680
INFO:root:Train Epoch: 12 [880/50000 (14%)] Loss: 0.354795
INFO:root:Train Epoch: 12 [960/50000 (15%)] Loss: 0.369269
INFO:root:Train Epoch: 12 [1040/50000 (17%)] Loss: 1.480979
INFO:root:Train Epoch: 12 [1120/50000 (18%)] Loss: 0.192241
INFO:root:Train Epoch: 12 [1200/50000 (19%)] Loss: 0.177839
INFO:root:Train Epoch: 12 [1280/50000 (20%)] Loss: 0.345626
INFO:root:Train Epoch: 12 [1360/50000 (22%)] Loss: 0.887501
INFO:root:Train Epoch: 12 [1440/50000 (23%)] Loss: 0.500595
INFO:root:Train Epoch: 12 [1520/50000 (24%)] Loss: 0.264257
INFO:root:Train Epoch: 12 [1600/50000 (26%)] Loss: 0.946825
INFO:root:Train Epoch: 12 [1680/50000 (27%)] Loss: 0.155507
INFO:root:Train Epoch: 12 [1760/50000 (28%)] Loss: 0.354518
INFO:root:Train Epoch: 12 [1840/50000 (29%)] Loss: 0.817487
INFO:root:Train Epoch: 12 [1920/50000 (31%)] Loss: 0.639233
INFO:root:Train Epoch: 12 [2000/50000 (32%)] Loss: 1.021617
INFO:root:Train Epoch: 12 [2080/50000 (33%)] Loss: 0.260060
INFO:root:Train Epoch: 12 [2160/50000 (35%)] Loss: 0.020257
INFO:root:Train Epoch: 12 [2240/50000 (36%)] Loss: 0.350920
INFO:root:Train Epoch: 12 [2320/50000 (37%)] Loss: 1.158523
INFO:root:Train Epoch: 12 [2400/50000 (38%)] Loss: 1.232888
INFO:root:Train Epoch: 12 [2480/50000 (40%)] Loss: 1.250125
INFO:root:Train Epoch: 12 [2560/50000 (41%)] Loss: 0.410585
INFO:root:Train Epoch: 12 [2640/50000 (42%)] Loss: 0.043542
INFO:root:Train Epoch: 12 [2720/50000 (43%)] Loss: 0.587487
INFO:root:Train Epoch: 12 [2800/50000 (45%)] Loss: 0.606584
INFO:root:Train Epoch: 12 [2880/50000 (46%)] Loss: 0.284561
INFO:root:Train Epoch: 12 [2960/50000 (47%)] Loss: 0.270663
INFO:root:Train Epoch: 12 [3040/50000 (49%)] Loss: 0.229658
INFO:root:Train Epoch: 12 [3120/50000 (50%)] Loss: 0.540495
INFO:root:Train Epoch: 12 [3200/50000 (51%)] Loss: 0.975998
INFO:root:Train Epoch: 12 [3280/50000 (52%)] Loss: 1.138255
INFO:root:Train Epoch: 12 [3360/50000 (54%)] Loss: 0.155439
INFO:root:Train Epoch: 12 [3440/50000 (55%)] Loss: 0.359686
INFO:root:Train Epoch: 12 [3520/50000 (56%)] Loss: 0.124434
INFO:root:Train Epoch: 12 [3600/50000 (58%)] Loss: 0.628841
INFO:root:Train Epoch: 12 [3680/50000 (59%)] Loss: 0.164854
INFO:root:Train Epoch: 12 [3760/50000 (60%)] Loss: 0.099679
INFO:root:Train Epoch: 12 [3840/50000 (61%)] Loss: 1.206025
INFO:root:Train Epoch: 12 [3920/50000 (63%)] Loss: 0.047567
INFO:root:Train Epoch: 12 [4000/50000 (64%)] Loss: 1.175249
INFO:root:Train Epoch: 12 [4080/50000 (65%)] Loss: 0.178396
INFO:root:Train Epoch: 12 [4160/50000 (66%)] Loss: 0.388515
INFO:root:Train Epoch: 12 [4240/50000 (68%)] Loss: 0.325797
INFO:root:Train Epoch: 12 [4320/50000 (69%)] Loss: 1.530245
INFO:root:Train Epoch: 12 [4400/50000 (70%)] Loss: 0.655677
INFO:root:Train Epoch: 12 [4480/50000 (72%)] Loss: 0.197912
INFO:root:Train Epoch: 12 [4560/50000 (73%)] Loss: 0.772641
INFO:root:Train Epoch: 12 [4640/50000 (74%)] Loss: 0.232663
INFO:root:Train Epoch: 12 [4720/50000 (75%)] Loss: 0.708218
INFO:root:Train Epoch: 12 [4800/50000 (77%)] Loss: 0.834434
INFO:root:Train Epoch: 12 [4880/50000 (78%)] Loss: 0.466336
INFO:root:Train Epoch: 12 [4960/50000 (79%)] Loss: 0.995236
INFO:root:Train Epoch: 12 [5040/50000 (81%)] Loss: 0.856992
INFO:root:Train Epoch: 12 [5120/50000 (82%)] Loss: 0.207793
INFO:root:Train Epoch: 12 [5200/50000 (83%)] Loss: 0.977203
INFO:root:Train Epoch: 12 [5280/50000 (84%)] Loss: 0.026662
INFO:root:Train Epoch: 12 [5360/50000 (86%)] Loss: 0.340813
INFO:root:Train Epoch: 12 [5440/50000 (87%)] Loss: 0.505765
INFO:root:Train Epoch: 12 [5520/50000 (88%)] Loss: 0.761414
INFO:root:Train Epoch: 12 [5600/50000 (90%)] Loss: 0.260247
INFO:root:Train Epoch: 12 [5680/50000 (91%)] Loss: 0.872699
INFO:root:Train Epoch: 12 [5760/50000 (92%)] Loss: 0.453815
INFO:root:Train Epoch: 12 [5840/50000 (93%)] Loss: 0.453472
INFO:root:Train Epoch: 12 [5920/50000 (95%)] Loss: 0.218694
INFO:root:Train Epoch: 12 [6000/50000 (96%)] Loss: 0.376688
INFO:root:Train Epoch: 12 [6080/50000 (97%)] Loss: 0.864355
INFO:root:Train Epoch: 12 [6160/50000 (98%)] Loss: 0.018082
INFO:root:Train Epoch: 12 [6240/50000 (100%)] Loss: 0.579039