-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathdqnlogs.txt
4732 lines (4545 loc) · 855 KB
/
dqnlogs.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
required memory = 23.85 GBs, available memory = 56.62 GBs
A.L.E: Arcade Learning Environment (version 0.10.1+unknown)
[Powered by Stella]
Model input shape: (1, 4, 80, 80)
Model output shape torch.Size([1, 6])
DQN(
(conv1): Conv2d(4, 16, kernel_size=(8, 8), stride=(4, 4))
(relu1): ReLU()
(conv2): Conv2d(16, 32, kernel_size=(4, 4), stride=(2, 2))
(relu2): ReLU()
(flatten): Flatten(start_dim=1, end_dim=-1)
(fc1): Linear(in_features=2048, out_features=256, bias=True)
(relu3): ReLU()
(fc2): Linear(in_features=256, out_features=6, bias=True)
)
Number of parameters: 538422
Training Starting...
/tmp/torchinductor_vvy/c5/cc5gii4hsyscaexernf7d5gehcvtfnlnnaz6ccatmram4finscs2.py:315: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf6, (1, 2048), (0, 1), 0), reinterpret_tensor(arg4_1, (2048, 256), (1, 2048), 0), out=buf7)
| Step: 3534 | Episode: 1 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 1.00 s || Eps: 0.996821 || INFO: {'lives': 0, 'episode_frame_number': 3534, 'frame_number': 3534} |
| Step: 7017 | Episode: 2 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.51 s || Eps: 0.993687 || INFO: {'lives': 0, 'episode_frame_number': 3483, 'frame_number': 7017} |
| Step: 10425 | Episode: 3 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.40 s || Eps: 0.990621 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 10425} |
| Step: 13945 | Episode: 4 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.42 s || Eps: 0.987453 || INFO: {'lives': 0, 'episode_frame_number': 3520, 'frame_number': 13945} |
| Step: 17353 | Episode: 5 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.41 s || Eps: 0.984386 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 17353} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 21341 | Episode: 6 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 0.47 s || Eps: 0.980797 || INFO: {'lives': 0, 'episode_frame_number': 3988, 'frame_number': 21341} |
|| Reward 1.0 ||
| Step: 25124 | Episode: 7 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 0.45 s || Eps: 0.977391 || INFO: {'lives': 0, 'episode_frame_number': 3783, 'frame_number': 25124} |
|| Reward 1.0 ||
| Step: 28674 | Episode: 8 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 0.42 s || Eps: 0.974195 || INFO: {'lives': 0, 'episode_frame_number': 3550, 'frame_number': 28674} |
|| Reward 1.0 ||
| Step: 32025 | Episode: 9 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 0.40 s || Eps: 0.971180 || INFO: {'lives': 0, 'episode_frame_number': 3351, 'frame_number': 32025} |
|| Reward 1.0 ||
| Step: 35684 | Episode: 10 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 0.44 s || Eps: 0.967887 || INFO: {'lives': 0, 'episode_frame_number': 3659, 'frame_number': 35684} |
| Step: 38740 | Episode: 11 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.37 s || Eps: 0.965138 || INFO: {'lives': 0, 'episode_frame_number': 3056, 'frame_number': 38740} |
| Step: 42268 | Episode: 12 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.42 s || Eps: 0.961962 || INFO: {'lives': 0, 'episode_frame_number': 3528, 'frame_number': 42268} |
| Step: 45436 | Episode: 13 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 0.38 s || Eps: 0.959111 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 45436} |
|| Reward 1.0 ||
| Step: 49139 | Episode: 14 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 0.44 s || Eps: 0.955778 || INFO: {'lives': 0, 'episode_frame_number': 3703, 'frame_number': 49139} |
/tmp/torchinductor_vvy/3o/c3oiw7slxscyia4b34oatjkuagjj34ukitmvojo3b34fvsp57ckx.py:472: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf8, (s0, 2048), (2048, 1), 0), reinterpret_tensor(buf9, (2048, 256), (1, 2048), 0), out=buf10)
/tmp/torchinductor_vvy/nu/cnudavhxapjn3azvila3qlgs7d6f5pzz4vnrcvz7ui5qzg56jqak.py:465: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf8, (s0, 2048), (2048, 1), 0), buf9, out=buf10)
/tmp/torchinductor_vvy/a6/ca6agpqf5v4ti4zzycrzkskbqmi7unfbka3obbbry5bs5kkjvdz7.py:501: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(tangents_1, permute_2, out=buf0)
/tmp/torchinductor_vvy/a6/ca6agpqf5v4ti4zzycrzkskbqmi7unfbka3obbbry5bs5kkjvdz7.py:505: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(tangents_1, (6, s0), (1, 6), 0), relu_2, out=buf1)
/tmp/torchinductor_vvy/a6/ca6agpqf5v4ti4zzycrzkskbqmi7unfbka3obbbry5bs5kkjvdz7.py:522: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(buf4, permute_6, out=buf5)
/tmp/torchinductor_vvy/a6/ca6agpqf5v4ti4zzycrzkskbqmi7unfbka3obbbry5bs5kkjvdz7.py:526: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf4, (256, s0), (1, 256), 0), view, out=buf6)
/tmp/torchinductor_vvy/3o/c3oiw7slxscyia4b34oatjkuagjj34ukitmvojo3b34fvsp57ckx.py:472: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf8, (s0, 2048), (2048, 1), 0), reinterpret_tensor(buf9, (2048, 256), (1, 2048), 0), out=buf10)
/tmp/torchinductor_vvy/c5/cc5gii4hsyscaexernf7d5gehcvtfnlnnaz6ccatmram4finscs2.py:315: UserWarning: Deterministic behavior was enabled with either `torch.use_deterministic_algorithms(True)` or `at::Context::setDeterministicAlgorithms(true)`, but this operation is not deterministic because it uses CuBLAS and you have CUDA >= 10.2. To enable deterministic behavior in this case, you must set an environment variable before running your PyTorch application: CUBLAS_WORKSPACE_CONFIG=:4096:8 or CUBLAS_WORKSPACE_CONFIG=:16:8. For more information, go to https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility (Triggered internally at ../aten/src/ATen/Context.cpp:185.)
extern_kernels.mm(reinterpret_tensor(buf6, (1, 2048), (0, 1), 0), reinterpret_tensor(arg4_1, (2048, 256), (1, 2048), 0), out=buf7)
| Step: 52679 | Episode: 15 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.35 s || Eps: 0.952592 || INFO: {'lives': 0, 'episode_frame_number': 3540, 'frame_number': 52679} |
|| Reward 1.0 ||
| Step: 56234 | Episode: 16 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.54 s || Eps: 0.949392 || INFO: {'lives': 0, 'episode_frame_number': 3555, 'frame_number': 56234} |
| Step: 59530 | Episode: 17 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.36 s || Eps: 0.946427 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 59530} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 63644 | Episode: 18 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 2.98 s || Eps: 0.942722 || INFO: {'lives': 0, 'episode_frame_number': 4114, 'frame_number': 63644} |
| Step: 67127 | Episode: 19 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.58 s || Eps: 0.939588 || INFO: {'lives': 0, 'episode_frame_number': 3483, 'frame_number': 67127} |
| Step: 70775 | Episode: 20 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.90 s || Eps: 0.936306 || INFO: {'lives': 0, 'episode_frame_number': 3648, 'frame_number': 70775} |
| Step: 74427 | Episode: 21 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.93 s || Eps: 0.933019 || INFO: {'lives': 0, 'episode_frame_number': 3652, 'frame_number': 74427} |
| Step: 77483 | Episode: 22 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.39 s || Eps: 0.930269 || INFO: {'lives': 0, 'episode_frame_number': 3056, 'frame_number': 77483} |
|| Reward 1.0 ||
| Step: 81210 | Episode: 23 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.94 s || Eps: 0.926914 || INFO: {'lives': 0, 'episode_frame_number': 3727, 'frame_number': 81210} |
|| Reward 1.0 ||
| Step: 85363 | Episode: 24 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.923174 || INFO: {'lives': 0, 'episode_frame_number': 4153, 'frame_number': 85363} |
| Step: 88771 | Episode: 25 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.05 s || Eps: 0.920110 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 88771} |
| Step: 91939 | Episode: 26 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.77 s || Eps: 0.917258 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 91939} |
| Step: 95723 | Episode: 27 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.07 s || Eps: 0.913853 || INFO: {'lives': 0, 'episode_frame_number': 3784, 'frame_number': 95723} |
| Step: 99882 | Episode: 28 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.07 s || Eps: 0.910109 || INFO: {'lives': 0, 'episode_frame_number': 4159, 'frame_number': 99882} |
|| Reward 1.0 ||
| Step: 103822 | Episode: 29 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.93 s || Eps: 0.906564 || INFO: {'lives': 0, 'episode_frame_number': 3940, 'frame_number': 103822} |
| Step: 107118 | Episode: 30 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.71 s || Eps: 0.903597 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 107118} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 111113 | Episode: 31 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.00 s || Eps: 0.900001 || INFO: {'lives': 0, 'episode_frame_number': 3995, 'frame_number': 111113} |
|| Reward 1.0 ||
| Step: 115278 | Episode: 32 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.26 s || Eps: 0.896251 || INFO: {'lives': 0, 'episode_frame_number': 4165, 'frame_number': 115278} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 119129 | Episode: 33 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 2.95 s || Eps: 0.892787 || INFO: {'lives': 0, 'episode_frame_number': 3851, 'frame_number': 119129} |
| Step: 122726 | Episode: 34 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.73 s || Eps: 0.889547 || INFO: {'lives': 0, 'episode_frame_number': 3597, 'frame_number': 122726} |
| Step: 125857 | Episode: 35 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.32 s || Eps: 0.886731 || INFO: {'lives': 0, 'episode_frame_number': 3131, 'frame_number': 125857} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 129843 | Episode: 36 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.08 s || Eps: 0.883143 || INFO: {'lives': 0, 'episode_frame_number': 3986, 'frame_number': 129843} |
| Step: 133558 | Episode: 37 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.89 s || Eps: 0.879800 || INFO: {'lives': 0, 'episode_frame_number': 3715, 'frame_number': 133558} |
|| Reward 1.0 ||
| Step: 138189 | Episode: 38 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.76 s || Eps: 0.875633 || INFO: {'lives': 0, 'episode_frame_number': 4631, 'frame_number': 138189} |
| Step: 141826 | Episode: 39 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.92 s || Eps: 0.872358 || INFO: {'lives': 0, 'episode_frame_number': 3637, 'frame_number': 141826} |
|| Reward 1.0 ||
| Step: 145725 | Episode: 40 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.25 s || Eps: 0.868850 || INFO: {'lives': 0, 'episode_frame_number': 3899, 'frame_number': 145725} |
| Step: 149361 | Episode: 41 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.75 s || Eps: 0.865579 || INFO: {'lives': 0, 'episode_frame_number': 3636, 'frame_number': 149361} |
|| Reward 1.0 ||
| Step: 153619 | Episode: 42 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.35 s || Eps: 0.861745 || INFO: {'lives': 0, 'episode_frame_number': 4258, 'frame_number': 153619} |
| Step: 157035 | Episode: 43 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.62 s || Eps: 0.858672 || INFO: {'lives': 0, 'episode_frame_number': 3416, 'frame_number': 157035} |
|| Reward 1.0 ||
| Step: 161286 | Episode: 44 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.47 s || Eps: 0.854845 || INFO: {'lives': 0, 'episode_frame_number': 4251, 'frame_number': 161286} |
|| Reward 1.0 ||
| Step: 164634 | Episode: 45 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.74 s || Eps: 0.851833 || INFO: {'lives': 0, 'episode_frame_number': 3348, 'frame_number': 164634} |
| Step: 168278 | Episode: 46 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.94 s || Eps: 0.848553 || INFO: {'lives': 0, 'episode_frame_number': 3644, 'frame_number': 168278} |
| Step: 171814 | Episode: 47 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.845371 || INFO: {'lives': 0, 'episode_frame_number': 3536, 'frame_number': 171814} |
| Step: 175411 | Episode: 48 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.75 s || Eps: 0.842131 || INFO: {'lives': 0, 'episode_frame_number': 3597, 'frame_number': 175411} |
|| Reward 1.0 ||
| Step: 179160 | Episode: 49 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.91 s || Eps: 0.838757 || INFO: {'lives': 0, 'episode_frame_number': 3749, 'frame_number': 179160} |
| Step: 182641 | Episode: 50 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.62 s || Eps: 0.835624 || INFO: {'lives': 0, 'episode_frame_number': 3481, 'frame_number': 182641} |
| Step: 185884 | Episode: 51 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.45 s || Eps: 0.832707 || INFO: {'lives': 0, 'episode_frame_number': 3243, 'frame_number': 185884} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 190611 | Episode: 52 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 3.52 s || Eps: 0.828453 || INFO: {'lives': 0, 'episode_frame_number': 4727, 'frame_number': 190611} |
| Step: 194019 | Episode: 53 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.49 s || Eps: 0.825387 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 194019} |
|| Reward 1.0 ||
| Step: 197594 | Episode: 54 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.96 s || Eps: 0.822168 || INFO: {'lives': 0, 'episode_frame_number': 3575, 'frame_number': 197594} |
| Step: 201005 | Episode: 55 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.74 s || Eps: 0.819098 || INFO: {'lives': 0, 'episode_frame_number': 3411, 'frame_number': 201005} |
|| Reward 1.0 ||
| Step: 204465 | Episode: 56 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.79 s || Eps: 0.815985 || INFO: {'lives': 0, 'episode_frame_number': 3460, 'frame_number': 204465} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 208495 | Episode: 57 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.08 s || Eps: 0.812356 || INFO: {'lives': 0, 'episode_frame_number': 4030, 'frame_number': 208495} |
| Step: 212108 | Episode: 58 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.10 s || Eps: 0.809104 || INFO: {'lives': 0, 'episode_frame_number': 3613, 'frame_number': 212108} |
|| Reward 1.0 ||
| Step: 215829 | Episode: 59 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.96 s || Eps: 0.805755 || INFO: {'lives': 0, 'episode_frame_number': 3721, 'frame_number': 215829} |
| Step: 218997 | Episode: 60 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.47 s || Eps: 0.802906 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 218997} |
|| Reward 1.0 ||
| Step: 222929 | Episode: 61 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.85 s || Eps: 0.799368 || INFO: {'lives': 0, 'episode_frame_number': 3932, 'frame_number': 222929} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 226983 | Episode: 62 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.00 s || Eps: 0.795717 || INFO: {'lives': 0, 'episode_frame_number': 4054, 'frame_number': 226983} |
| Step: 230151 | Episode: 63 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.32 s || Eps: 0.792868 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 230151} |
| Step: 233447 | Episode: 64 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.40 s || Eps: 0.789901 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 233447} |
| Step: 237103 | Episode: 65 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.67 s || Eps: 0.786611 || INFO: {'lives': 0, 'episode_frame_number': 3656, 'frame_number': 237103} |
| Step: 240639 | Episode: 66 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.60 s || Eps: 0.783428 || INFO: {'lives': 0, 'episode_frame_number': 3536, 'frame_number': 240639} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 244671 | Episode: 67 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.05 s || Eps: 0.779800 || INFO: {'lives': 0, 'episode_frame_number': 4032, 'frame_number': 244671} |
| Step: 248681 | Episode: 68 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.94 s || Eps: 0.776189 || INFO: {'lives': 0, 'episode_frame_number': 4010, 'frame_number': 248681} |
| Step: 252304 | Episode: 69 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.92 s || Eps: 0.772929 || INFO: {'lives': 0, 'episode_frame_number': 3623, 'frame_number': 252304} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 256612 | Episode: 70 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.15 s || Eps: 0.769053 || INFO: {'lives': 0, 'episode_frame_number': 4308, 'frame_number': 256612} |
| Step: 259983 | Episode: 71 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.48 s || Eps: 0.766018 || INFO: {'lives': 0, 'episode_frame_number': 3371, 'frame_number': 259983} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 264327 | Episode: 72 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.19 s || Eps: 0.762109 || INFO: {'lives': 0, 'episode_frame_number': 4344, 'frame_number': 264327} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 268232 | Episode: 73 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.19 s || Eps: 0.758592 || INFO: {'lives': 0, 'episode_frame_number': 3905, 'frame_number': 268232} |
| Step: 271890 | Episode: 74 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.69 s || Eps: 0.755301 || INFO: {'lives': 0, 'episode_frame_number': 3658, 'frame_number': 271890} |
| Step: 274946 | Episode: 75 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.30 s || Eps: 0.752552 || INFO: {'lives': 0, 'episode_frame_number': 3056, 'frame_number': 274946} |
| Step: 278594 | Episode: 76 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.99 s || Eps: 0.749269 || INFO: {'lives': 0, 'episode_frame_number': 3648, 'frame_number': 278594} |
|| Reward 1.0 ||
| Step: 282812 | Episode: 77 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.30 s || Eps: 0.745471 || INFO: {'lives': 0, 'episode_frame_number': 4218, 'frame_number': 282812} |
|| Reward 1.0 ||
| Step: 286787 | Episode: 78 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.35 s || Eps: 0.741894 || INFO: {'lives': 0, 'episode_frame_number': 3975, 'frame_number': 286787} |
| Step: 290030 | Episode: 79 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.62 s || Eps: 0.738976 || INFO: {'lives': 0, 'episode_frame_number': 3243, 'frame_number': 290030} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 294490 | Episode: 80 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.60 s || Eps: 0.734963 || INFO: {'lives': 0, 'episode_frame_number': 4460, 'frame_number': 294490} |
| Step: 298030 | Episode: 81 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.15 s || Eps: 0.731777 || INFO: {'lives': 0, 'episode_frame_number': 3540, 'frame_number': 298030} |
| Step: 301641 | Episode: 82 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.97 s || Eps: 0.728526 || INFO: {'lives': 0, 'episode_frame_number': 3611, 'frame_number': 301641} |
|| Reward 1.0 ||
| Step: 304991 | Episode: 83 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.725510 || INFO: {'lives': 0, 'episode_frame_number': 3350, 'frame_number': 304991} |
| Step: 308235 | Episode: 84 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.722592 || INFO: {'lives': 0, 'episode_frame_number': 3244, 'frame_number': 308235} |
| Step: 311607 | Episode: 85 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.69 s || Eps: 0.719557 || INFO: {'lives': 0, 'episode_frame_number': 3372, 'frame_number': 311607} |
| Step: 315022 | Episode: 86 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.84 s || Eps: 0.716483 || INFO: {'lives': 0, 'episode_frame_number': 3415, 'frame_number': 315022} |
| Step: 318310 | Episode: 87 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.69 s || Eps: 0.713525 || INFO: {'lives': 0, 'episode_frame_number': 3288, 'frame_number': 318310} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 322215 | Episode: 88 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.31 s || Eps: 0.710007 || INFO: {'lives': 0, 'episode_frame_number': 3905, 'frame_number': 322215} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 326456 | Episode: 89 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.43 s || Eps: 0.706190 || INFO: {'lives': 0, 'episode_frame_number': 4241, 'frame_number': 326456} |
| Step: 329827 | Episode: 90 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.81 s || Eps: 0.703158 || INFO: {'lives': 0, 'episode_frame_number': 3371, 'frame_number': 329827} |
| Step: 333182 | Episode: 91 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.91 s || Eps: 0.700139 || INFO: {'lives': 0, 'episode_frame_number': 3355, 'frame_number': 333182} |
| Step: 336478 | Episode: 92 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.57 s || Eps: 0.697173 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 336478} |
| Step: 340126 | Episode: 93 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.78 s || Eps: 0.693890 || INFO: {'lives': 0, 'episode_frame_number': 3648, 'frame_number': 340126} |
| Step: 343422 | Episode: 94 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.54 s || Eps: 0.690924 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 343422} |
| Step: 347149 | Episode: 95 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.90 s || Eps: 0.687569 || INFO: {'lives': 0, 'episode_frame_number': 3727, 'frame_number': 347149} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 351118 | Episode: 96 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.06 s || Eps: 0.683995 || INFO: {'lives': 0, 'episode_frame_number': 3969, 'frame_number': 351118} |
| Step: 354286 | Episode: 97 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.45 s || Eps: 0.681146 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 354286} |
|| Reward 1.0 ||
| Step: 358390 | Episode: 98 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.11 s || Eps: 0.677453 || INFO: {'lives': 0, 'episode_frame_number': 4104, 'frame_number': 358390} |
| Step: 361802 | Episode: 99 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.59 s || Eps: 0.674382 || INFO: {'lives': 0, 'episode_frame_number': 3412, 'frame_number': 361802} |
|| Reward 1.0 ||
| Step: 365977 | Episode: 100 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.670623 || INFO: {'lives': 0, 'episode_frame_number': 4175, 'frame_number': 365977} |
| Step: 369108 | Episode: 101 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.31 s || Eps: 0.667806 || INFO: {'lives': 0, 'episode_frame_number': 3131, 'frame_number': 369108} |
| Step: 372723 | Episode: 102 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.73 s || Eps: 0.664552 || INFO: {'lives': 0, 'episode_frame_number': 3615, 'frame_number': 372723} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 377140 | Episode: 103 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.38 s || Eps: 0.660575 || INFO: {'lives': 0, 'episode_frame_number': 4417, 'frame_number': 377140} |
|| Reward 1.0 ||
| Step: 381284 | Episode: 104 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.37 s || Eps: 0.656848 || INFO: {'lives': 0, 'episode_frame_number': 4144, 'frame_number': 381284} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 385347 | Episode: 105 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.653190 || INFO: {'lives': 0, 'episode_frame_number': 4063, 'frame_number': 385347} |
| Step: 388631 | Episode: 106 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.56 s || Eps: 0.650236 || INFO: {'lives': 0, 'episode_frame_number': 3284, 'frame_number': 388631} |
| Step: 392352 | Episode: 107 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.85 s || Eps: 0.646884 || INFO: {'lives': 0, 'episode_frame_number': 3721, 'frame_number': 392352} |
| Step: 396541 | Episode: 108 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.24 s || Eps: 0.643114 || INFO: {'lives': 0, 'episode_frame_number': 4189, 'frame_number': 396541} |
|| Reward 1.0 ||
| Step: 399911 | Episode: 109 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.640082 || INFO: {'lives': 0, 'episode_frame_number': 3370, 'frame_number': 399911} |
| Step: 403327 | Episode: 110 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.59 s || Eps: 0.637009 || INFO: {'lives': 0, 'episode_frame_number': 3416, 'frame_number': 403327} |
| Step: 407327 | Episode: 111 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.45 s || Eps: 0.633409 || INFO: {'lives': 0, 'episode_frame_number': 4000, 'frame_number': 407327} |
| Step: 410383 | Episode: 112 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.47 s || Eps: 0.630659 || INFO: {'lives': 0, 'episode_frame_number': 3056, 'frame_number': 410383} |
| Step: 414519 | Episode: 113 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.23 s || Eps: 0.626937 || INFO: {'lives': 0, 'episode_frame_number': 4136, 'frame_number': 414519} |
|| Reward 1.0 ||
| Step: 418370 | Episode: 114 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.623470 || INFO: {'lives': 0, 'episode_frame_number': 3851, 'frame_number': 418370} |
| Step: 421666 | Episode: 115 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.57 s || Eps: 0.620504 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 421666} |
|| Reward 1.0 ||
| Step: 425455 | Episode: 116 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.617091 || INFO: {'lives': 0, 'episode_frame_number': 3789, 'frame_number': 425455} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 429650 | Episode: 117 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.47 s || Eps: 0.613318 || INFO: {'lives': 0, 'episode_frame_number': 4195, 'frame_number': 429650} |
|| Reward 1.0 ||
| Step: 433020 | Episode: 118 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.75 s || Eps: 0.610284 || INFO: {'lives': 0, 'episode_frame_number': 3370, 'frame_number': 433020} |
| Step: 437144 | Episode: 119 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.51 s || Eps: 0.606574 || INFO: {'lives': 0, 'episode_frame_number': 4124, 'frame_number': 437144} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 441314 | Episode: 120 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.47 s || Eps: 0.602819 || INFO: {'lives': 0, 'episode_frame_number': 4170, 'frame_number': 441314} |
|| Reward 1.0 ||
| Step: 444910 | Episode: 121 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.79 s || Eps: 0.599585 || INFO: {'lives': 0, 'episode_frame_number': 3596, 'frame_number': 444910} |
|| Reward 1.0 ||
| Step: 448854 | Episode: 122 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.38 s || Eps: 0.596035 || INFO: {'lives': 0, 'episode_frame_number': 3944, 'frame_number': 448854} |
| Step: 452625 | Episode: 123 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.24 s || Eps: 0.592640 || INFO: {'lives': 0, 'episode_frame_number': 3771, 'frame_number': 452625} |
| Step: 456643 | Episode: 124 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.19 s || Eps: 0.589023 || INFO: {'lives': 0, 'episode_frame_number': 4018, 'frame_number': 456643} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 461334 | Episode: 125 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 3.78 s || Eps: 0.584802 || INFO: {'lives': 0, 'episode_frame_number': 4691, 'frame_number': 461334} |
| Step: 464746 | Episode: 126 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.75 s || Eps: 0.581732 || INFO: {'lives': 0, 'episode_frame_number': 3412, 'frame_number': 464746} |
| Step: 468475 | Episode: 127 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.99 s || Eps: 0.578373 || INFO: {'lives': 0, 'episode_frame_number': 3729, 'frame_number': 468475} |
|| Reward 1.0 ||
| Step: 473462 | Episode: 128 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.97 s || Eps: 0.573887 || INFO: {'lives': 0, 'episode_frame_number': 4987, 'frame_number': 473462} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 477895 | Episode: 129 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.73 s || Eps: 0.569895 || INFO: {'lives': 0, 'episode_frame_number': 4433, 'frame_number': 477895} |
| Step: 481663 | Episode: 130 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.21 s || Eps: 0.566507 || INFO: {'lives': 0, 'episode_frame_number': 3768, 'frame_number': 481663} |
| Step: 484967 | Episode: 131 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.76 s || Eps: 0.563533 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 484967} |
| Step: 488491 | Episode: 132 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.23 s || Eps: 0.560362 || INFO: {'lives': 0, 'episode_frame_number': 3524, 'frame_number': 488491} |
| Step: 492326 | Episode: 133 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.17 s || Eps: 0.556909 || INFO: {'lives': 0, 'episode_frame_number': 3835, 'frame_number': 492326} |
| Step: 496118 | Episode: 134 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.553497 || INFO: {'lives': 0, 'episode_frame_number': 3792, 'frame_number': 496118} |
| Step: 499843 | Episode: 135 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.550142 || INFO: {'lives': 0, 'episode_frame_number': 3725, 'frame_number': 499843} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 505937 | Episode: 136 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.02 s || Eps: 0.544658 || INFO: {'lives': 0, 'episode_frame_number': 6094, 'frame_number': 505937} |
| Step: 509830 | Episode: 137 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.05 s || Eps: 0.541154 || INFO: {'lives': 0, 'episode_frame_number': 3893, 'frame_number': 509830} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 513974 | Episode: 138 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.25 s || Eps: 0.537427 || INFO: {'lives': 0, 'episode_frame_number': 4144, 'frame_number': 513974} |
| Step: 517270 | Episode: 139 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.58 s || Eps: 0.534461 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 517270} |
| Step: 520926 | Episode: 140 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.07 s || Eps: 0.531170 || INFO: {'lives': 0, 'episode_frame_number': 3656, 'frame_number': 520926} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 524852 | Episode: 141 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.17 s || Eps: 0.527635 || INFO: {'lives': 0, 'episode_frame_number': 3926, 'frame_number': 524852} |
| Step: 528612 | Episode: 142 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.11 s || Eps: 0.524253 || INFO: {'lives': 0, 'episode_frame_number': 3760, 'frame_number': 528612} |
| Step: 531900 | Episode: 143 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.71 s || Eps: 0.521294 || INFO: {'lives': 0, 'episode_frame_number': 3288, 'frame_number': 531900} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 535930 | Episode: 144 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.45 s || Eps: 0.517665 || INFO: {'lives': 0, 'episode_frame_number': 4030, 'frame_number': 535930} |
| Step: 539822 | Episode: 145 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.30 s || Eps: 0.514164 || INFO: {'lives': 0, 'episode_frame_number': 3892, 'frame_number': 539822} |
| Step: 542953 | Episode: 146 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.80 s || Eps: 0.511345 || INFO: {'lives': 0, 'episode_frame_number': 3131, 'frame_number': 542953} |
| Step: 546249 | Episode: 147 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.90 s || Eps: 0.508379 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 546249} |
| Step: 549716 | Episode: 148 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.91 s || Eps: 0.505258 || INFO: {'lives': 0, 'episode_frame_number': 3467, 'frame_number': 549716} |
Saving Model Checkpoint...
| Step: 553580 | Episode: 149 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.97 s || Eps: 0.501782 || INFO: {'lives': 0, 'episode_frame_number': 3864, 'frame_number': 553580} |
| Step: 556876 | Episode: 150 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.49 s || Eps: 0.498815 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 556876} |
|| Reward 1.0 ||
| Step: 560680 | Episode: 151 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.94 s || Eps: 0.495392 || INFO: {'lives': 0, 'episode_frame_number': 3804, 'frame_number': 560680} |
|| Reward 1.0 ||
| Step: 565001 | Episode: 152 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.41 s || Eps: 0.491500 || INFO: {'lives': 0, 'episode_frame_number': 4321, 'frame_number': 565001} |
| Step: 569450 | Episode: 153 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.54 s || Eps: 0.487496 || INFO: {'lives': 0, 'episode_frame_number': 4449, 'frame_number': 569450} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 574384 | Episode: 154 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.78 s || Eps: 0.483056 || INFO: {'lives': 0, 'episode_frame_number': 4934, 'frame_number': 574384} |
| Step: 577512 | Episode: 155 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.40 s || Eps: 0.480243 || INFO: {'lives': 0, 'episode_frame_number': 3128, 'frame_number': 577512} |
|| Reward 1.0 ||
| Step: 582110 | Episode: 156 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.54 s || Eps: 0.476103 || INFO: {'lives': 0, 'episode_frame_number': 4598, 'frame_number': 582110} |
|| Reward 1.0 ||
| Step: 586317 | Episode: 157 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.34 s || Eps: 0.472317 || INFO: {'lives': 0, 'episode_frame_number': 4207, 'frame_number': 586317} |
| Step: 589977 | Episode: 158 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.89 s || Eps: 0.469024 || INFO: {'lives': 0, 'episode_frame_number': 3660, 'frame_number': 589977} |
|| Reward 1.0 ||
| Step: 593565 | Episode: 159 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.81 s || Eps: 0.465795 || INFO: {'lives': 0, 'episode_frame_number': 3588, 'frame_number': 593565} |
|| Reward 1.0 ||
| Step: 597294 | Episode: 160 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.88 s || Eps: 0.462436 || INFO: {'lives': 0, 'episode_frame_number': 3729, 'frame_number': 597294} |
|| Reward 1.0 ||
| Step: 600969 | Episode: 161 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.79 s || Eps: 0.459131 || INFO: {'lives': 0, 'episode_frame_number': 3675, 'frame_number': 600969} |
| Step: 604265 | Episode: 162 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.53 s || Eps: 0.456165 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 604265} |
| Step: 607561 | Episode: 163 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.55 s || Eps: 0.453199 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 607561} |
| Step: 611109 | Episode: 164 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.73 s || Eps: 0.450005 || INFO: {'lives': 0, 'episode_frame_number': 3548, 'frame_number': 611109} |
|| Reward 1.0 ||
| Step: 615436 | Episode: 165 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.32 s || Eps: 0.446110 || INFO: {'lives': 0, 'episode_frame_number': 4327, 'frame_number': 615436} |
| Step: 618740 | Episode: 166 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.55 s || Eps: 0.443138 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 618740} |
| Step: 622760 | Episode: 167 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.13 s || Eps: 0.439520 || INFO: {'lives': 0, 'episode_frame_number': 4020, 'frame_number': 622760} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 627242 | Episode: 168 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.55 s || Eps: 0.435484 || INFO: {'lives': 0, 'episode_frame_number': 4482, 'frame_number': 627242} |
| Step: 630970 | Episode: 169 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.35 s || Eps: 0.432131 || INFO: {'lives': 0, 'episode_frame_number': 3728, 'frame_number': 630970} |
|| Reward 1.0 ||
| Step: 634320 | Episode: 170 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.80 s || Eps: 0.429114 || INFO: {'lives': 0, 'episode_frame_number': 3350, 'frame_number': 634320} |
| Step: 637728 | Episode: 171 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.81 s || Eps: 0.426048 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 637728} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 641722 | Episode: 172 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.33 s || Eps: 0.422452 || INFO: {'lives': 0, 'episode_frame_number': 3994, 'frame_number': 641722} |
|| Reward 1.0 ||
| Step: 645645 | Episode: 173 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.85 s || Eps: 0.418922 || INFO: {'lives': 0, 'episode_frame_number': 3923, 'frame_number': 645645} |
| Step: 648941 | Episode: 174 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.68 s || Eps: 0.415957 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 648941} |
| Step: 652112 | Episode: 175 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.63 s || Eps: 0.413102 || INFO: {'lives': 0, 'episode_frame_number': 3171, 'frame_number': 652112} |
| Step: 656072 | Episode: 176 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.30 s || Eps: 0.409539 || INFO: {'lives': 0, 'episode_frame_number': 3960, 'frame_number': 656072} |
| Step: 659240 | Episode: 177 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.51 s || Eps: 0.406688 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 659240} |
| Step: 663140 | Episode: 178 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.27 s || Eps: 0.403178 || INFO: {'lives': 0, 'episode_frame_number': 3900, 'frame_number': 663140} |
| Step: 666308 | Episode: 179 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.57 s || Eps: 0.400326 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 666308} |
| Step: 669608 | Episode: 180 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.397356 || INFO: {'lives': 0, 'episode_frame_number': 3300, 'frame_number': 669608} |
| Step: 672904 | Episode: 181 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.394390 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 672904} |
|| Reward 1.0 ||
| Step: 676888 | Episode: 182 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.27 s || Eps: 0.390804 || INFO: {'lives': 0, 'episode_frame_number': 3984, 'frame_number': 676888} |
|| Reward 1.0 ||
| Step: 680675 | Episode: 183 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.14 s || Eps: 0.387395 || INFO: {'lives': 0, 'episode_frame_number': 3787, 'frame_number': 680675} |
|| Reward 1.0 ||
| Step: 684722 | Episode: 184 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.32 s || Eps: 0.383753 || INFO: {'lives': 0, 'episode_frame_number': 4047, 'frame_number': 684722} |
| Step: 688018 | Episode: 185 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.73 s || Eps: 0.380787 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 688018} |
| Step: 691314 | Episode: 186 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.74 s || Eps: 0.377821 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 691314} |
| Step: 694760 | Episode: 187 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.374718 || INFO: {'lives': 0, 'episode_frame_number': 3446, 'frame_number': 694760} |
| Step: 697928 | Episode: 188 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.48 s || Eps: 0.371868 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 697928} |
Saving Model Checkpoint...
| Step: 701336 | Episode: 189 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.77 s || Eps: 0.368801 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 701336} |
|| Reward 1.0 ||
| Step: 704709 | Episode: 190 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.74 s || Eps: 0.365763 || INFO: {'lives': 0, 'episode_frame_number': 3373, 'frame_number': 704709} |
|| Reward 1.0 ||
| Step: 708878 | Episode: 191 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.42 s || Eps: 0.362011 || INFO: {'lives': 0, 'episode_frame_number': 4169, 'frame_number': 708878} |
| Step: 712127 | Episode: 192 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.65 s || Eps: 0.359087 || INFO: {'lives': 0, 'episode_frame_number': 3249, 'frame_number': 712127} |
| Step: 715407 | Episode: 193 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.356137 || INFO: {'lives': 0, 'episode_frame_number': 3280, 'frame_number': 715407} |
| Step: 718703 | Episode: 194 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.77 s || Eps: 0.353171 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 718703} |
| Step: 722003 | Episode: 195 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.350201 || INFO: {'lives': 0, 'episode_frame_number': 3300, 'frame_number': 722003} |
| Step: 725299 | Episode: 196 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.69 s || Eps: 0.347235 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 725299} |
| Step: 730328 | Episode: 197 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 4.10 s || Eps: 0.342706 || INFO: {'lives': 0, 'episode_frame_number': 5029, 'frame_number': 730328} |
| Step: 733608 | Episode: 198 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.71 s || Eps: 0.339756 || INFO: {'lives': 0, 'episode_frame_number': 3280, 'frame_number': 733608} |
|| Reward 1.0 ||
| Step: 737297 | Episode: 199 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.336434 || INFO: {'lives': 0, 'episode_frame_number': 3689, 'frame_number': 737297} |
| Step: 741193 | Episode: 200 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.25 s || Eps: 0.332930 || INFO: {'lives': 0, 'episode_frame_number': 3896, 'frame_number': 741193} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 746092 | Episode: 201 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 4.13 s || Eps: 0.328520 || INFO: {'lives': 0, 'episode_frame_number': 4899, 'frame_number': 746092} |
|| Reward 1.0 ||Saving Model Checkpoint...
| Step: 750164 | Episode: 202 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.53 s || Eps: 0.324856 || INFO: {'lives': 0, 'episode_frame_number': 4072, 'frame_number': 750164} |
|| Reward 1.0 ||
| Step: 753866 | Episode: 203 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.321522 || INFO: {'lives': 0, 'episode_frame_number': 3702, 'frame_number': 753866} |
|| Reward 1.0 ||
| Step: 758168 | Episode: 204 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.58 s || Eps: 0.317651 || INFO: {'lives': 0, 'episode_frame_number': 4302, 'frame_number': 758168} |
| Step: 761336 | Episode: 205 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.69 s || Eps: 0.314801 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 761336} |
| Step: 764744 | Episode: 206 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.06 s || Eps: 0.311734 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 764744} |
| Step: 768048 | Episode: 207 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.90 s || Eps: 0.308760 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 768048} |
|| Reward 1.0 ||
| Step: 771398 | Episode: 208 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.98 s || Eps: 0.305744 || INFO: {'lives': 0, 'episode_frame_number': 3350, 'frame_number': 771398} |
| Step: 774934 | Episode: 209 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.04 s || Eps: 0.302563 || INFO: {'lives': 0, 'episode_frame_number': 3536, 'frame_number': 774934} |
| Step: 778238 | Episode: 210 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.85 s || Eps: 0.299589 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 778238} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 782916 | Episode: 211 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.59 s || Eps: 0.295377 || INFO: {'lives': 0, 'episode_frame_number': 4678, 'frame_number': 782916} |
| Step: 787073 | Episode: 212 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.83 s || Eps: 0.291635 || INFO: {'lives': 0, 'episode_frame_number': 4157, 'frame_number': 787073} |
| Step: 790377 | Episode: 213 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.70 s || Eps: 0.288664 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 790377} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 794907 | Episode: 214 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 3.63 s || Eps: 0.284586 || INFO: {'lives': 0, 'episode_frame_number': 4530, 'frame_number': 794907} |
| Step: 798209 | Episode: 215 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.67 s || Eps: 0.281614 || INFO: {'lives': 0, 'episode_frame_number': 3302, 'frame_number': 798209} |
| Step: 801513 | Episode: 216 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.278642 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 801513} |
|| Reward 1.0 ||
| Step: 805313 | Episode: 217 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.11 s || Eps: 0.275222 || INFO: {'lives': 0, 'episode_frame_number': 3800, 'frame_number': 805313} |
| Step: 808796 | Episode: 218 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.77 s || Eps: 0.272086 || INFO: {'lives': 0, 'episode_frame_number': 3483, 'frame_number': 808796} |
| Step: 812204 | Episode: 219 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.87 s || Eps: 0.269020 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 812204} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 817441 | Episode: 220 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.35 s || Eps: 0.264304 || INFO: {'lives': 0, 'episode_frame_number': 5237, 'frame_number': 817441} |
| Step: 820737 | Episode: 221 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.66 s || Eps: 0.261340 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 820737} |
| Step: 825318 | Episode: 222 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.86 s || Eps: 0.257215 || INFO: {'lives': 0, 'episode_frame_number': 4581, 'frame_number': 825318} |
| Step: 828726 | Episode: 223 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.74 s || Eps: 0.254150 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 828726} |
| Step: 832514 | Episode: 224 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.08 s || Eps: 0.250741 || INFO: {'lives': 0, 'episode_frame_number': 3788, 'frame_number': 832514} |
| Step: 836601 | Episode: 225 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.41 s || Eps: 0.247062 || INFO: {'lives': 0, 'episode_frame_number': 4087, 'frame_number': 836601} |
| Step: 839732 | Episode: 226 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.53 s || Eps: 0.244244 || INFO: {'lives': 0, 'episode_frame_number': 3131, 'frame_number': 839732} |
|| Reward 1.0 ||
| Step: 843330 | Episode: 227 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.93 s || Eps: 0.241005 || INFO: {'lives': 0, 'episode_frame_number': 3598, 'frame_number': 843330} |
| Step: 846618 | Episode: 228 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.70 s || Eps: 0.238047 || INFO: {'lives': 0, 'episode_frame_number': 3288, 'frame_number': 846618} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 850347 | Episode: 229 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.08 s || Eps: 0.234689 || INFO: {'lives': 0, 'episode_frame_number': 3729, 'frame_number': 850347} |
| Step: 853722 | Episode: 230 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.76 s || Eps: 0.231653 || INFO: {'lives': 0, 'episode_frame_number': 3375, 'frame_number': 853722} |
|| Reward 1.0 ||
| Step: 857201 | Episode: 231 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.81 s || Eps: 0.228522 || INFO: {'lives': 0, 'episode_frame_number': 3479, 'frame_number': 857201} |
|| Reward 1.0 ||
| Step: 861059 | Episode: 232 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.12 s || Eps: 0.225049 || INFO: {'lives': 0, 'episode_frame_number': 3858, 'frame_number': 861059} |
| Step: 864355 | Episode: 233 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.65 s || Eps: 0.222084 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 864355} |
|| Reward 1.0 ||
| Step: 867705 | Episode: 234 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.78 s || Eps: 0.219067 || INFO: {'lives': 0, 'episode_frame_number': 3350, 'frame_number': 867705} |
| Step: 871560 | Episode: 235 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.215599 || INFO: {'lives': 0, 'episode_frame_number': 3855, 'frame_number': 871560} |
|| Reward 1.0 ||
| Step: 874910 | Episode: 236 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.95 s || Eps: 0.212583 || INFO: {'lives': 0, 'episode_frame_number': 3350, 'frame_number': 874910} |
|| Reward 1.0 ||
| Step: 878703 | Episode: 237 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.19 s || Eps: 0.209168 || INFO: {'lives': 0, 'episode_frame_number': 3793, 'frame_number': 878703} |
| Step: 882119 | Episode: 238 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.87 s || Eps: 0.206097 || INFO: {'lives': 0, 'episode_frame_number': 3416, 'frame_number': 882119} |
| Step: 885775 | Episode: 239 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.00 s || Eps: 0.202806 || INFO: {'lives': 0, 'episode_frame_number': 3656, 'frame_number': 885775} |
| Step: 889195 | Episode: 240 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.86 s || Eps: 0.199728 || INFO: {'lives': 0, 'episode_frame_number': 3420, 'frame_number': 889195} |
|| Reward 1.0 ||
| Step: 893544 | Episode: 241 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.54 s || Eps: 0.195811 || INFO: {'lives': 0, 'episode_frame_number': 4349, 'frame_number': 893544} |
| Step: 897155 | Episode: 242 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.96 s || Eps: 0.192563 || INFO: {'lives': 0, 'episode_frame_number': 3611, 'frame_number': 897155} |
| Step: 901175 | Episode: 243 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.28 s || Eps: 0.188946 || INFO: {'lives': 0, 'episode_frame_number': 4020, 'frame_number': 901175} |
|| Reward 1.0 ||
| Step: 904616 | Episode: 244 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.76 s || Eps: 0.185847 || INFO: {'lives': 0, 'episode_frame_number': 3441, 'frame_number': 904616} |
|| Reward 1.0 ||
| Step: 908226 | Episode: 245 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.95 s || Eps: 0.182598 || INFO: {'lives': 0, 'episode_frame_number': 3610, 'frame_number': 908226} |
|| Reward 1.0 ||
| Step: 911915 | Episode: 246 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.10 s || Eps: 0.179277 || INFO: {'lives': 0, 'episode_frame_number': 3689, 'frame_number': 911915} |
|| Reward 1.0 ||
| Step: 915375 | Episode: 247 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.87 s || Eps: 0.176166 || INFO: {'lives': 0, 'episode_frame_number': 3460, 'frame_number': 915375} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 919756 | Episode: 248 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 3.58 s || Eps: 0.172220 || INFO: {'lives': 0, 'episode_frame_number': 4381, 'frame_number': 919756} |
| Step: 923284 | Episode: 249 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.95 s || Eps: 0.169048 || INFO: {'lives': 0, 'episode_frame_number': 3528, 'frame_number': 923284} |
| Step: 926415 | Episode: 250 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.67 s || Eps: 0.166229 || INFO: {'lives': 0, 'episode_frame_number': 3131, 'frame_number': 926415} |
| Step: 929719 | Episode: 251 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.81 s || Eps: 0.163257 || INFO: {'lives': 0, 'episode_frame_number': 3304, 'frame_number': 929719} |
|| Reward 1.0 ||
| Step: 933421 | Episode: 252 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.13 s || Eps: 0.159923 || INFO: {'lives': 0, 'episode_frame_number': 3702, 'frame_number': 933421} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 937590 | Episode: 253 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 3.44 s || Eps: 0.156170 || INFO: {'lives': 0, 'episode_frame_number': 4169, 'frame_number': 937590} |
|| Reward 1.0 ||
| Step: 941183 | Episode: 254 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.99 s || Eps: 0.152936 || INFO: {'lives': 0, 'episode_frame_number': 3593, 'frame_number': 941183} |
|| Reward 1.0 ||
| Step: 944662 | Episode: 255 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 2.86 s || Eps: 0.149807 || INFO: {'lives': 0, 'episode_frame_number': 3479, 'frame_number': 944662} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 949132 | Episode: 256 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 3.85 s || Eps: 0.145783 || INFO: {'lives': 0, 'episode_frame_number': 4470, 'frame_number': 949132} |
Saving Model Checkpoint...
|| Reward 1.0 ||
| Step: 953211 | Episode: 257 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.48 s || Eps: 0.142113 || INFO: {'lives': 0, 'episode_frame_number': 4079, 'frame_number': 953211} |
| Step: 956582 | Episode: 258 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.84 s || Eps: 0.139079 || INFO: {'lives': 0, 'episode_frame_number': 3371, 'frame_number': 956582} |
| Step: 959750 | Episode: 259 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.72 s || Eps: 0.136229 || INFO: {'lives': 0, 'episode_frame_number': 3168, 'frame_number': 959750} |
| Step: 962883 | Episode: 260 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.65 s || Eps: 0.133406 || INFO: {'lives': 0, 'episode_frame_number': 3133, 'frame_number': 962883} |
| Step: 966291 | Episode: 261 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.83 s || Eps: 0.130342 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 966291} |
| Step: 970219 | Episode: 262 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.32 s || Eps: 0.126806 || INFO: {'lives': 0, 'episode_frame_number': 3928, 'frame_number': 970219} |
| Step: 973627 | Episode: 263 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.85 s || Eps: 0.123739 || INFO: {'lives': 0, 'episode_frame_number': 3408, 'frame_number': 973627} |
| Step: 977346 | Episode: 264 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.13 s || Eps: 0.120391 || INFO: {'lives': 0, 'episode_frame_number': 3719, 'frame_number': 977346} |
|| Reward 1.0 ||
| Step: 980808 | Episode: 265 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.31 s || Eps: 0.117275 || INFO: {'lives': 0, 'episode_frame_number': 3462, 'frame_number': 980808} |
| Step: 984104 | Episode: 266 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.77 s || Eps: 0.114310 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 984104} |
| Step: 987400 | Episode: 267 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 2.93 s || Eps: 0.111344 || INFO: {'lives': 0, 'episode_frame_number': 3296, 'frame_number': 987400} |
| Step: 990936 | Episode: 268 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.27 s || Eps: 0.108161 || INFO: {'lives': 0, 'episode_frame_number': 3536, 'frame_number': 990936} |
| Step: 994347 | Episode: 269 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.03 s || Eps: 0.105090 || INFO: {'lives': 0, 'episode_frame_number': 3411, 'frame_number': 994347} |
|| Reward 1.0 ||
| Step: 998306 | Episode: 270 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.71 s || Eps: 0.101527 || INFO: {'lives': 0, 'episode_frame_number': 3959, 'frame_number': 998306} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1003229 | Episode: 271 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.64 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4923, 'frame_number': 1003229} |
| Step: 1006952 | Episode: 272 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.59 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 3723, 'frame_number': 1006952} |
|| Reward 1.0 ||
| Step: 1010941 | Episode: 273 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.45 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 3989, 'frame_number': 1010941} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1015836 | Episode: 274 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.21 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4895, 'frame_number': 1015836} |
|| Reward 1.0 ||
| Step: 1020037 | Episode: 275 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.63 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4201, 'frame_number': 1020037} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1025566 | Episode: 276 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.81 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5529, 'frame_number': 1025566} |
|| Reward 1.0 ||
| Step: 1029842 | Episode: 277 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.71 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4276, 'frame_number': 1029842} |
|| Reward 1.0 ||
| Step: 1034550 | Episode: 278 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.10 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4708, 'frame_number': 1034550} |
|| Reward 1.0 ||
| Step: 1038593 | Episode: 279 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 3.53 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4043, 'frame_number': 1038593} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1044018 | Episode: 280 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.66 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5425, 'frame_number': 1044018} |
| Step: 1047675 | Episode: 281 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.18 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 3657, 'frame_number': 1047675} |
| Step: 1052098 | Episode: 282 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 3.71 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4423, 'frame_number': 1052098} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1057241 | Episode: 283 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.40 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5143, 'frame_number': 1057241} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1064227 | Episode: 284 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.88 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6986, 'frame_number': 1064227} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1069003 | Episode: 285 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.08 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4776, 'frame_number': 1069003} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1073073 | Episode: 286 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 3.53 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4070, 'frame_number': 1073073} |
|| Reward 1.0 ||
| Step: 1078776 | Episode: 287 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.89 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5703, 'frame_number': 1078776} |
|| Reward 1.0 ||
| Step: 1083201 | Episode: 288 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.11 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4425, 'frame_number': 1083201} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1089392 | Episode: 289 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.42 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6191, 'frame_number': 1089392} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1094520 | Episode: 290 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.35 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5128, 'frame_number': 1094520} |
Saving Model Checkpoint...
| Step: 1100125 | Episode: 291 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 4.82 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5605, 'frame_number': 1100125} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1106451 | Episode: 292 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.59 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6326, 'frame_number': 1106451} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1111895 | Episode: 293 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 4.74 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5444, 'frame_number': 1111895} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1117640 | Episode: 294 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 5.04 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5745, 'frame_number': 1117640} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1122775 | Episode: 295 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.43 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5135, 'frame_number': 1122775} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1128336 | Episode: 296 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.74 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5561, 'frame_number': 1128336} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1133854 | Episode: 297 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 4.88 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5518, 'frame_number': 1133854} |
|| Reward 1.0 ||
| Step: 1138433 | Episode: 298 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.02 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4579, 'frame_number': 1138433} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1145147 | Episode: 299 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.97 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6714, 'frame_number': 1145147} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1151647 | Episode: 300 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.96 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6500, 'frame_number': 1151647} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1158271 | Episode: 301 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 5.90 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6624, 'frame_number': 1158271} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1164338 | Episode: 302 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.37 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6067, 'frame_number': 1164338} |
|| Reward 1.0 ||
| Step: 1169559 | Episode: 303 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.65 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5221, 'frame_number': 1169559} |
|| Reward 1.0 ||
| Step: 1174995 | Episode: 304 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.80 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5436, 'frame_number': 1174995} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1182082 | Episode: 305 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.30 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7087, 'frame_number': 1182082} |
|| Reward 1.0 ||
| Step: 1188295 | Episode: 306 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 5.48 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6213, 'frame_number': 1188295} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1194859 | Episode: 307 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.83 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6564, 'frame_number': 1194859} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1202101 | Episode: 308 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 6.46 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7242, 'frame_number': 1202101} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1209109 | Episode: 309 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.11 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7008, 'frame_number': 1209109} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1215555 | Episode: 310 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.57 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6446, 'frame_number': 1215555} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1221465 | Episode: 311 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.16 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5910, 'frame_number': 1221465} |
|| Reward 1.0 ||
| Step: 1228064 | Episode: 312 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 5.68 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6599, 'frame_number': 1228064} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1235807 | Episode: 313 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.88 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7743, 'frame_number': 1235807} |
|| Reward 1.0 ||
| Step: 1241728 | Episode: 314 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 5.35 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5921, 'frame_number': 1241728} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1249507 | Episode: 315 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 7.00 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7779, 'frame_number': 1249507} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1256091 | Episode: 316 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 5.88 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6584, 'frame_number': 1256091} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1262807 | Episode: 317 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.05 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6716, 'frame_number': 1262807} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1268815 | Episode: 318 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.41 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6008, 'frame_number': 1268815} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1275993 | Episode: 319 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 6.23 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7178, 'frame_number': 1275993} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1282512 | Episode: 320 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.91 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6519, 'frame_number': 1282512} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1288829 | Episode: 321 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.65 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6317, 'frame_number': 1288829} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1296374 | Episode: 322 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.60 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7545, 'frame_number': 1296374} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1303078 | Episode: 323 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.99 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6704, 'frame_number': 1303078} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1308359 | Episode: 324 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 4.76 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5281, 'frame_number': 1308359} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1314648 | Episode: 325 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 5.75 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6289, 'frame_number': 1314648} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1321940 | Episode: 326 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.70 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7292, 'frame_number': 1321940} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1328680 | Episode: 327 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.07 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6740, 'frame_number': 1328680} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1335358 | Episode: 328 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.06 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6678, 'frame_number': 1335358} |
|| Reward 1.0 ||
| Step: 1342641 | Episode: 329 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.69 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7283, 'frame_number': 1342641} |
|| Reward 1.0 ||
| Step: 1348742 | Episode: 330 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 5.63 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6101, 'frame_number': 1348742} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1356006 | Episode: 331 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 6.57 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7264, 'frame_number': 1356006} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1361286 | Episode: 332 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 4.81 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5280, 'frame_number': 1361286} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1369189 | Episode: 333 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.27 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7903, 'frame_number': 1369189} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1376013 | Episode: 334 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.21 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6824, 'frame_number': 1376013} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1381594 | Episode: 335 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.76 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5581, 'frame_number': 1381594} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1389735 | Episode: 336 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.98 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8141, 'frame_number': 1389735} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1396028 | Episode: 337 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.06 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6293, 'frame_number': 1396028} |
|| Reward 1.0 ||Saving Model Checkpoint...
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1402947 | Episode: 338 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.70 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6919, 'frame_number': 1402947} |
|| Reward 1.0 ||
| Step: 1409560 | Episode: 339 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.54 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6613, 'frame_number': 1409560} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1416711 | Episode: 340 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.83 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7151, 'frame_number': 1416711} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1423982 | Episode: 341 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.67 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7271, 'frame_number': 1423982} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1431826 | Episode: 342 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 7.18 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7844, 'frame_number': 1431826} |
| Step: 1437626 | Episode: 343 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 5.47 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5800, 'frame_number': 1437626} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1443825 | Episode: 344 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.74 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6199, 'frame_number': 1443825} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1451138 | Episode: 345 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.87 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7313, 'frame_number': 1451138} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1459176 | Episode: 346 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.53 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8038, 'frame_number': 1459176} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1468051 | Episode: 347 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 8.64 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8875, 'frame_number': 1468051} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1474584 | Episode: 348 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.29 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6533, 'frame_number': 1474584} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1481348 | Episode: 349 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.69 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6764, 'frame_number': 1481348} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1487812 | Episode: 350 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.20 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6464, 'frame_number': 1487812} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1494955 | Episode: 351 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.00 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7143, 'frame_number': 1494955} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1501553 | Episode: 352 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.48 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6598, 'frame_number': 1501553} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1509275 | Episode: 353 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.84 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7722, 'frame_number': 1509275} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1516914 | Episode: 354 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.40 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7639, 'frame_number': 1516914} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1521883 | Episode: 355 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 4.90 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4969, 'frame_number': 1521883} |
|| Reward 1.0 ||
| Step: 1526919 | Episode: 356 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 4.87 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5036, 'frame_number': 1526919} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1534333 | Episode: 357 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.05 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7414, 'frame_number': 1534333} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1542093 | Episode: 358 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 7.54 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7760, 'frame_number': 1542093} |
|| Reward 1.0 ||
| Step: 1548104 | Episode: 359 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.06 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6011, 'frame_number': 1548104} |
|| Reward 1.0 || || Reward 1.0 ||Saving Model Checkpoint...
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1556561 | Episode: 360 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 8.49 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8457, 'frame_number': 1556561} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1563894 | Episode: 361 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.89 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7333, 'frame_number': 1563894} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1569772 | Episode: 362 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.57 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5878, 'frame_number': 1569772} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1576422 | Episode: 363 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.29 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6650, 'frame_number': 1576422} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1582857 | Episode: 364 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.03 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6435, 'frame_number': 1582857} |
| Step: 1588145 | Episode: 365 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 4.92 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5288, 'frame_number': 1588145} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1594797 | Episode: 366 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6652, 'frame_number': 1594797} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1601608 | Episode: 367 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.06 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6811, 'frame_number': 1601608} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1608366 | Episode: 368 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.56 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6758, 'frame_number': 1608366} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1615424 | Episode: 369 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.73 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7058, 'frame_number': 1615424} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1621551 | Episode: 370 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.20 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6127, 'frame_number': 1621551} |
|| Reward 1.0 ||
| Step: 1628098 | Episode: 371 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.09 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6547, 'frame_number': 1628098} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1634805 | Episode: 372 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6707, 'frame_number': 1634805} |
|| Reward 1.0 ||
| Step: 1641473 | Episode: 373 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.50 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6668, 'frame_number': 1641473} |
|| Reward 1.0 ||
| Step: 1647400 | Episode: 374 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 5.68 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5927, 'frame_number': 1647400} |
|| Reward 1.0 ||Saving Model Checkpoint...
|| Reward 1.0 ||
| Step: 1653083 | Episode: 375 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.24 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5683, 'frame_number': 1653083} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1658965 | Episode: 376 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.89 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5882, 'frame_number': 1658965} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1664812 | Episode: 377 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.30 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5847, 'frame_number': 1664812} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1673208 | Episode: 378 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8396, 'frame_number': 1673208} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1678410 | Episode: 379 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.22 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5202, 'frame_number': 1678410} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1684741 | Episode: 380 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.22 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6331, 'frame_number': 1684741} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1690200 | Episode: 381 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.80 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5459, 'frame_number': 1690200} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1698376 | Episode: 382 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 8.02 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8176, 'frame_number': 1698376} |
|| Reward 1.0 ||Saving Model Checkpoint...
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1706062 | Episode: 383 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.39 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7686, 'frame_number': 1706062} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1713499 | Episode: 384 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7437, 'frame_number': 1713499} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1720656 | Episode: 385 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.40 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7157, 'frame_number': 1720656} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1727744 | Episode: 386 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 6.93 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7088, 'frame_number': 1727744} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1734168 | Episode: 387 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.22 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6424, 'frame_number': 1734168} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1741764 | Episode: 388 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.56 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7596, 'frame_number': 1741764} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1748603 | Episode: 389 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 6.82 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6839, 'frame_number': 1748603} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1755552 | Episode: 390 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.68 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6949, 'frame_number': 1755552} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1761858 | Episode: 391 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.19 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6306, 'frame_number': 1761858} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1768151 | Episode: 392 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.70 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6293, 'frame_number': 1768151} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1774961 | Episode: 393 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.97 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6810, 'frame_number': 1774961} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1781302 | Episode: 394 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.57 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6341, 'frame_number': 1781302} |
|| Reward 1.0 ||
| Step: 1787812 | Episode: 395 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.90 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6510, 'frame_number': 1787812} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1794138 | Episode: 396 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.52 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6326, 'frame_number': 1794138} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1801070 | Episode: 397 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.20 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6932, 'frame_number': 1801070} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1808056 | Episode: 398 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.99 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6986, 'frame_number': 1808056} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1815652 | Episode: 399 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 7.33 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7596, 'frame_number': 1815652} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1823237 | Episode: 400 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.54 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7585, 'frame_number': 1823237} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1829878 | Episode: 401 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 6.75 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6641, 'frame_number': 1829878} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1837210 | Episode: 402 || Σ Rewards: -13.00 || lr: 1.000000e-04 || dt: 7.32 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7332, 'frame_number': 1837210} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1843983 | Episode: 403 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.86 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6773, 'frame_number': 1843983} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1850608 | Episode: 404 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.63 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6625, 'frame_number': 1850608} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1857125 | Episode: 405 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.34 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6517, 'frame_number': 1857125} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1863893 | Episode: 406 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.07 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6768, 'frame_number': 1863893} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1870848 | Episode: 407 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.54 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6955, 'frame_number': 1870848} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1878005 | Episode: 408 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.78 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7157, 'frame_number': 1878005} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1884142 | Episode: 409 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.99 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6137, 'frame_number': 1884142} |
| Step: 1888717 | Episode: 410 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 4.60 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 4575, 'frame_number': 1888717} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1896232 | Episode: 411 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.77 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7515, 'frame_number': 1896232} |
|| Reward 1.0 || || Reward 1.0 ||Saving Model Checkpoint...
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1903650 | Episode: 412 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 7.50 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7418, 'frame_number': 1903650} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1910470 | Episode: 413 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.91 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6820, 'frame_number': 1910470} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1917206 | Episode: 414 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.01 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6736, 'frame_number': 1917206} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1924489 | Episode: 415 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.53 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7283, 'frame_number': 1924489} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1932183 | Episode: 416 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.02 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7694, 'frame_number': 1932183} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1940279 | Episode: 417 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 8.33 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8096, 'frame_number': 1940279} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1947282 | Episode: 418 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.34 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7003, 'frame_number': 1947282} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 1953540 | Episode: 419 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.55 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6258, 'frame_number': 1953540} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1960645 | Episode: 420 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.46 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7105, 'frame_number': 1960645} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1968109 | Episode: 421 || Σ Rewards: -13.00 || lr: 1.000000e-04 || dt: 7.90 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7464, 'frame_number': 1968109} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1975575 | Episode: 422 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 7.72 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7466, 'frame_number': 1975575} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1981132 | Episode: 423 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.80 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5557, 'frame_number': 1981132} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1987283 | Episode: 424 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.28 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6151, 'frame_number': 1987283} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 1994390 | Episode: 425 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7107, 'frame_number': 1994390} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2002146 | Episode: 426 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.11 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7756, 'frame_number': 2002146} |
|| Reward 1.0 ||
| Step: 2008026 | Episode: 427 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.29 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5880, 'frame_number': 2008026} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2014379 | Episode: 428 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.50 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6353, 'frame_number': 2014379} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2021327 | Episode: 429 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 7.31 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6948, 'frame_number': 2021327} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 2027036 | Episode: 430 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 5.92 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5709, 'frame_number': 2027036} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2033756 | Episode: 431 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.35 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6720, 'frame_number': 2033756} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2041854 | Episode: 432 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.58 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8098, 'frame_number': 2041854} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2049371 | Episode: 433 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 8.19 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7517, 'frame_number': 2049371} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2056852 | Episode: 434 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.81 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7481, 'frame_number': 2056852} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2064786 | Episode: 435 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.29 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7934, 'frame_number': 2064786} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2072638 | Episode: 436 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 8.18 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7852, 'frame_number': 2072638} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2078880 | Episode: 437 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.81 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6242, 'frame_number': 2078880} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2086306 | Episode: 438 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.37 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7426, 'frame_number': 2086306} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2093019 | Episode: 439 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.63 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6713, 'frame_number': 2093019} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2099545 | Episode: 440 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 6.78 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6526, 'frame_number': 2099545} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2106670 | Episode: 441 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.53 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7125, 'frame_number': 2106670} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2113639 | Episode: 442 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.44 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6969, 'frame_number': 2113639} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2120757 | Episode: 443 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.68 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7118, 'frame_number': 2120757} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2128930 | Episode: 444 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.76 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8173, 'frame_number': 2128930} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2137174 | Episode: 445 || Σ Rewards: -13.00 || lr: 1.000000e-04 || dt: 8.78 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8244, 'frame_number': 2137174} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2143676 | Episode: 446 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 6.80 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6502, 'frame_number': 2143676} |
|| Reward 1.0 || || Reward 1.0 ||Saving Model Checkpoint...
| Step: 2151642 | Episode: 447 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 8.83 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7966, 'frame_number': 2151642} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2158130 | Episode: 448 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.17 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6488, 'frame_number': 2158130} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2165793 | Episode: 449 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 9.01 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7663, 'frame_number': 2165793} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2174106 | Episode: 450 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 9.06 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8313, 'frame_number': 2174106} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2181564 | Episode: 451 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 8.14 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7458, 'frame_number': 2181564} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2186991 | Episode: 452 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 5.75 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5427, 'frame_number': 2186991} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2194437 | Episode: 453 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.91 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7446, 'frame_number': 2194437} |
|| Reward 1.0 ||
| Step: 2201538 | Episode: 454 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 8.49 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7101, 'frame_number': 2201538} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2209022 | Episode: 455 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 8.49 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7484, 'frame_number': 2209022} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2215528 | Episode: 456 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 7.33 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6506, 'frame_number': 2215528} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2223904 | Episode: 457 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 9.69 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8376, 'frame_number': 2223904} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2230897 | Episode: 458 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.52 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6993, 'frame_number': 2230897} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2239047 | Episode: 459 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 8.90 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8150, 'frame_number': 2239047} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2247197 | Episode: 460 || Σ Rewards: -14.00 || lr: 1.000000e-04 || dt: 9.02 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8150, 'frame_number': 2247197} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2254860 | Episode: 461 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.48 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7663, 'frame_number': 2254860} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2261582 | Episode: 462 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 7.51 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6722, 'frame_number': 2261582} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2268283 | Episode: 463 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.30 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6701, 'frame_number': 2268283} |
| Step: 2274215 | Episode: 464 || Σ Rewards: -21.00 || lr: 1.000000e-04 || dt: 6.45 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5932, 'frame_number': 2274215} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 2280276 | Episode: 465 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 6.73 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6061, 'frame_number': 2280276} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2286552 | Episode: 466 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 6.98 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6276, 'frame_number': 2286552} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2293552 | Episode: 467 || Σ Rewards: -16.00 || lr: 1.000000e-04 || dt: 8.45 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7000, 'frame_number': 2293552} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||Saving Model Checkpoint...
| Step: 2301837 | Episode: 468 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 9.91 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8285, 'frame_number': 2301837} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2310290 | Episode: 469 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 9.55 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 8453, 'frame_number': 2310290} |
|| Reward 1.0 ||
| Step: 2316497 | Episode: 470 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 7.29 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6207, 'frame_number': 2316497} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2324085 | Episode: 471 || Σ Rewards: -17.00 || lr: 1.000000e-04 || dt: 8.86 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7588, 'frame_number': 2324085} |
|| Reward 1.0 || || Reward 1.0 ||
| Step: 2331946 | Episode: 472 || Σ Rewards: -19.00 || lr: 1.000000e-04 || dt: 8.94 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7861, 'frame_number': 2331946} |
|| Reward 1.0 ||
| Step: 2337686 | Episode: 473 || Σ Rewards: -20.00 || lr: 1.000000e-04 || dt: 6.72 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 5740, 'frame_number': 2337686} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2345289 | Episode: 474 || Σ Rewards: -15.00 || lr: 1.000000e-04 || dt: 9.00 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 7603, 'frame_number': 2345289} |
|| Reward 1.0 || || Reward 1.0 || || Reward 1.0 ||
| Step: 2351753 | Episode: 475 || Σ Rewards: -18.00 || lr: 1.000000e-04 || dt: 7.91 s || Eps: 0.100000 || INFO: {'lives': 0, 'episode_frame_number': 6464, 'frame_number': 2351753} |