Skip to content

Instantly share code, notes, and snippets.

@milad621
Created February 8, 2023 22:17
Show Gist options
  • Save milad621/cd47cd1c7226ac09de9fd31b8102b372 to your computer and use it in GitHub Desktop.
Save milad621/cd47cd1c7226ac09de9fd31b8102b372 to your computer and use it in GitHub Desktop.
lr_2models_scaled reset at the end of epoch
5e-08 2e-07
small step: 0.0005 big step: 0.0020
Epoch 1 Batch 50 Loss 8.9662 Accuracy 0.0001 small step: 0.0005 big step: 0.0020
tf.Tensor(8.976346, shape=(), dtype=float32) tf.Tensor(8.956141, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 100 Loss 8.9406 Accuracy 0.0004 small step: 0.0010 big step: 0.0040
tf.Tensor(8.927561, shape=(), dtype=float32) tf.Tensor(8.901532, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 150 Loss 8.9037 Accuracy 0.0067 small step: 0.0020 big step: 0.0080
tf.Tensor(8.851914, shape=(), dtype=float32) tf.Tensor(8.806074, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 200 Loss 8.8493 Accuracy 0.0172 small step: 0.0040 big step: 0.0160
tf.Tensor(8.71848, shape=(), dtype=float32) tf.Tensor(8.651425, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 250 Loss 8.7797 Accuracy 0.0236 small step: 0.0080 big step: 0.0320
tf.Tensor(8.5373125, shape=(), dtype=float32) tf.Tensor(8.46304, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 300 Loss 8.7008 Accuracy 0.0279 small step: 0.0160 big step: 0.0640
tf.Tensor(8.345377, shape=(), dtype=float32) tf.Tensor(8.263751, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 350 Loss 8.6105 Accuracy 0.0310 small step: 0.0320 big step: 0.1280
tf.Tensor(8.1233225, shape=(), dtype=float32) tf.Tensor(8.010771, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 400 Loss 8.4961 Accuracy 0.0335 small step: 0.0640 big step: 0.2560
tf.Tensor(7.7883534, shape=(), dtype=float32) tf.Tensor(7.5973787, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 450 Loss 8.3425 Accuracy 0.0388 small step: 0.1280 big step: 0.5120
tf.Tensor(7.234321, shape=(), dtype=float32) tf.Tensor(6.987376, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 500 Loss 8.1723 Accuracy 0.0452 small step: 0.2560 big step: 1.0240
tf.Tensor(6.670275, shape=(), dtype=float32) tf.Tensor(6.603177, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 550 Loss 8.0162 Accuracy 0.0521 small step: 0.5120 big step: 2.0480
tf.Tensor(6.487422, shape=(), dtype=float32) tf.Tensor(6.4172435, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 600 Loss 7.8623 Accuracy 0.0589 small step: 1.0240 big step: 4.0960
tf.Tensor(6.183914, shape=(), dtype=float32) tf.Tensor(6.1481586, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 650 Loss 7.7111 Accuracy 0.0656 small step: 2.0480 big step: 8.1920
tf.Tensor(5.8906736, shape=(), dtype=float32) tf.Tensor(5.8966084, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 700 Loss 7.5696 Accuracy 0.0725 small step: 1.0240 big step: 4.0960
tf.Tensor(5.7352962, shape=(), dtype=float32) tf.Tensor(5.719729, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 750 Loss 7.4449 Accuracy 0.0781 small step: 2.0480 big step: 8.1920
tf.Tensor(5.5755367, shape=(), dtype=float32) tf.Tensor(5.8165603, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 800 Loss 7.3238 Accuracy 0.0841 small step: 1.0240 big step: 4.0960
tf.Tensor(5.502714, shape=(), dtype=float32) tf.Tensor(5.5077233, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 850 Loss 7.2140 Accuracy 0.0897 small step: 0.5120 big step: 2.0480
tf.Tensor(5.4582577, shape=(), dtype=float32) tf.Tensor(5.4523773, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 900 Loss 7.1126 Accuracy 0.0949 small step: 1.0240 big step: 4.0960
tf.Tensor(5.379767, shape=(), dtype=float32) tf.Tensor(5.394957, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 950 Loss 7.0194 Accuracy 0.0998 small step: 0.5120 big step: 2.0480
tf.Tensor(5.3390827, shape=(), dtype=float32) tf.Tensor(5.340045, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1000 Loss 6.9356 Accuracy 0.1042 small step: 0.2560 big step: 1.0240
tf.Tensor(5.3415523, shape=(), dtype=float32) tf.Tensor(5.3400493, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1050 Loss 6.8583 Accuracy 0.1082 small step: 0.5120 big step: 2.0480
tf.Tensor(5.30753, shape=(), dtype=float32) tf.Tensor(5.3140893, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1100 Loss 6.7855 Accuracy 0.1121 small step: 0.2560 big step: 1.0240
tf.Tensor(5.256278, shape=(), dtype=float32) tf.Tensor(5.256102, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1150 Loss 6.7189 Accuracy 0.1157 small step: 0.5120 big step: 2.0480
tf.Tensor(5.2464514, shape=(), dtype=float32) tf.Tensor(5.256838, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1200 Loss 6.6572 Accuracy 0.1190 small step: 0.2560 big step: 1.0240
tf.Tensor(5.235647, shape=(), dtype=float32) tf.Tensor(5.236596, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1250 Loss 6.6005 Accuracy 0.1220 small step: 0.1280 big step: 0.5120
tf.Tensor(5.2394905, shape=(), dtype=float32) tf.Tensor(5.2393203, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1300 Loss 6.5473 Accuracy 0.1249 small step: 0.2560 big step: 1.0240
tf.Tensor(5.2150326, shape=(), dtype=float32) tf.Tensor(5.2175045, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1350 Loss 6.4976 Accuracy 0.1275 small step: 0.1280 big step: 0.5120
tf.Tensor(5.2055097, shape=(), dtype=float32) tf.Tensor(5.2050724, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1400 Loss 6.4513 Accuracy 0.1300 small step: 0.2560 big step: 1.0240
tf.Tensor(5.1966553, shape=(), dtype=float32) tf.Tensor(5.203269, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1450 Loss 6.4076 Accuracy 0.1324 small step: 0.1280 big step: 0.5120
tf.Tensor(5.182253, shape=(), dtype=float32) tf.Tensor(5.18299, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1500 Loss 6.3661 Accuracy 0.1347 small step: 0.0640 big step: 0.2560
tf.Tensor(5.162857, shape=(), dtype=float32) tf.Tensor(5.162369, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1550 Loss 6.3282 Accuracy 0.1367 small step: 0.1280 big step: 0.5120
tf.Tensor(5.189858, shape=(), dtype=float32) tf.Tensor(5.1914735, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1600 Loss 6.2915 Accuracy 0.1387 small step: 0.0640 big step: 0.2560
tf.Tensor(5.153053, shape=(), dtype=float32) tf.Tensor(5.1527185, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1650 Loss 6.2571 Accuracy 0.1406 small step: 0.1280 big step: 0.5120
tf.Tensor(5.1527357, shape=(), dtype=float32) tf.Tensor(5.1545196, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1700 Loss 6.2245 Accuracy 0.1423 small step: 0.0640 big step: 0.2560
tf.Tensor(5.148643, shape=(), dtype=float32) tf.Tensor(5.1489406, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1750 Loss 6.1939 Accuracy 0.1440 small step: 0.0320 big step: 0.1280
tf.Tensor(5.1541657, shape=(), dtype=float32) tf.Tensor(5.153887, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1800 Loss 6.1648 Accuracy 0.1456 small step: 0.0640 big step: 0.2560
tf.Tensor(5.145213, shape=(), dtype=float32) tf.Tensor(5.145454, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1850 Loss 6.1372 Accuracy 0.1471 small step: 0.0320 big step: 0.1280
tf.Tensor(5.1426344, shape=(), dtype=float32) tf.Tensor(5.142469, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 1900 Loss 6.1111 Accuracy 0.1485 small step: 0.0640 big step: 0.2560
tf.Tensor(5.1467085, shape=(), dtype=float32) tf.Tensor(5.147191, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 1950 Loss 6.0861 Accuracy 0.1499 small step: 0.0320 big step: 0.1280
tf.Tensor(5.134027, shape=(), dtype=float32) tf.Tensor(5.133817, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2000 Loss 6.0622 Accuracy 0.1513 small step: 0.0640 big step: 0.2560
tf.Tensor(5.1274805, shape=(), dtype=float32) tf.Tensor(5.128371, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2050 Loss 6.0394 Accuracy 0.1525 small step: 0.0320 big step: 0.1280
tf.Tensor(5.1300063, shape=(), dtype=float32) tf.Tensor(5.1299024, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2100 Loss 6.0174 Accuracy 0.1538 small step: 0.0640 big step: 0.2560
tf.Tensor(5.1144633, shape=(), dtype=float32) tf.Tensor(5.1153936, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2150 Loss 5.9965 Accuracy 0.1549 small step: 0.0320 big step: 0.1280
tf.Tensor(5.11649, shape=(), dtype=float32) tf.Tensor(5.1165676, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2200 Loss 5.9764 Accuracy 0.1561 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1114745, shape=(), dtype=float32) tf.Tensor(5.111263, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2250 Loss 5.9573 Accuracy 0.1571 small step: 0.0320 big step: 0.1280
tf.Tensor(5.114889, shape=(), dtype=float32) tf.Tensor(5.115348, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2300 Loss 5.9387 Accuracy 0.1582 small step: 0.0160 big step: 0.0640
tf.Tensor(5.102275, shape=(), dtype=float32) tf.Tensor(5.102011, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2350 Loss 5.9212 Accuracy 0.1591 small step: 0.0320 big step: 0.1280
tf.Tensor(5.117477, shape=(), dtype=float32) tf.Tensor(5.1175303, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2400 Loss 5.9042 Accuracy 0.1601 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1026745, shape=(), dtype=float32) tf.Tensor(5.1024218, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2450 Loss 5.8882 Accuracy 0.1610 small step: 0.0320 big step: 0.1280
tf.Tensor(5.119616, shape=(), dtype=float32) tf.Tensor(5.119768, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2500 Loss 5.8728 Accuracy 0.1618 small step: 0.0160 big step: 0.0640
tf.Tensor(5.119783, shape=(), dtype=float32) tf.Tensor(5.1196957, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2550 Loss 5.8579 Accuracy 0.1626 small step: 0.0320 big step: 0.1280
tf.Tensor(5.113309, shape=(), dtype=float32) tf.Tensor(5.1134357, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2600 Loss 5.8435 Accuracy 0.1634 small step: 0.0160 big step: 0.0640
tf.Tensor(5.106097, shape=(), dtype=float32) tf.Tensor(5.1058154, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2650 Loss 5.8299 Accuracy 0.1642 small step: 0.0320 big step: 0.1280
tf.Tensor(5.1220927, shape=(), dtype=float32) tf.Tensor(5.1224775, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2700 Loss 5.8164 Accuracy 0.1649 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1050463, shape=(), dtype=float32) tf.Tensor(5.105012, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2750 Loss 5.8036 Accuracy 0.1657 small step: 0.0320 big step: 0.1280
tf.Tensor(5.107689, shape=(), dtype=float32) tf.Tensor(5.1077147, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2800 Loss 5.7910 Accuracy 0.1664 small step: 0.0160 big step: 0.0640
tf.Tensor(5.101472, shape=(), dtype=float32) tf.Tensor(5.10125, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2850 Loss 5.7788 Accuracy 0.1671 small step: 0.0320 big step: 0.1280
tf.Tensor(5.094894, shape=(), dtype=float32) tf.Tensor(5.095063, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 2900 Loss 5.7673 Accuracy 0.1677 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1092033, shape=(), dtype=float32) tf.Tensor(5.109076, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 2950 Loss 5.7560 Accuracy 0.1683 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0992885, shape=(), dtype=float32) tf.Tensor(5.0995255, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3000 Loss 5.7450 Accuracy 0.1689 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1009045, shape=(), dtype=float32) tf.Tensor(5.1008654, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3050 Loss 5.7345 Accuracy 0.1695 small step: 0.0320 big step: 0.1280
tf.Tensor(5.1026955, shape=(), dtype=float32) tf.Tensor(5.103218, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3100 Loss 5.7241 Accuracy 0.1701 small step: 0.0160 big step: 0.0640
tf.Tensor(5.089227, shape=(), dtype=float32) tf.Tensor(5.088944, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3150 Loss 5.7141 Accuracy 0.1707 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0897617, shape=(), dtype=float32) tf.Tensor(5.09009, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3200 Loss 5.7045 Accuracy 0.1712 small step: 0.0160 big step: 0.0640
tf.Tensor(5.1053734, shape=(), dtype=float32) tf.Tensor(5.1055956, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3250 Loss 5.6952 Accuracy 0.1717 small step: 0.0080 big step: 0.0320
tf.Tensor(5.095622, shape=(), dtype=float32) tf.Tensor(5.0955715, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3300 Loss 5.6860 Accuracy 0.1722 small step: 0.0160 big step: 0.0640
tf.Tensor(5.090687, shape=(), dtype=float32) tf.Tensor(5.0906024, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3350 Loss 5.6771 Accuracy 0.1727 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0863347, shape=(), dtype=float32) tf.Tensor(5.0865874, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3400 Loss 5.6681 Accuracy 0.1733 small step: 0.0160 big step: 0.0640
tf.Tensor(5.068757, shape=(), dtype=float32) tf.Tensor(5.0685897, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3450 Loss 5.6596 Accuracy 0.1737 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0770082, shape=(), dtype=float32) tf.Tensor(5.0771327, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3500 Loss 5.6514 Accuracy 0.1742 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0838656, shape=(), dtype=float32) tf.Tensor(5.0837812, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3550 Loss 5.6436 Accuracy 0.1746 small step: 0.0320 big step: 0.1280
tf.Tensor(5.098848, shape=(), dtype=float32) tf.Tensor(5.0990725, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3600 Loss 5.6361 Accuracy 0.1750 small step: 0.0160 big step: 0.0640
tf.Tensor(5.102101, shape=(), dtype=float32) tf.Tensor(5.101919, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3650 Loss 5.6285 Accuracy 0.1754 small step: 0.0320 big step: 0.1280
tf.Tensor(5.087204, shape=(), dtype=float32) tf.Tensor(5.0874834, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3700 Loss 5.6212 Accuracy 0.1758 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0854692, shape=(), dtype=float32) tf.Tensor(5.0854344, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3750 Loss 5.6140 Accuracy 0.1762 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0829506, shape=(), dtype=float32) tf.Tensor(5.083245, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3800 Loss 5.6071 Accuracy 0.1766 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0869617, shape=(), dtype=float32) tf.Tensor(5.0868707, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3850 Loss 5.6004 Accuracy 0.1770 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0916834, shape=(), dtype=float32) tf.Tensor(5.091906, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 3900 Loss 5.5939 Accuracy 0.1774 small step: 0.0160 big step: 0.0640
tf.Tensor(5.089595, shape=(), dtype=float32) tf.Tensor(5.0895934, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 3950 Loss 5.5874 Accuracy 0.1777 small step: 0.0320 big step: 0.1280
tf.Tensor(5.079377, shape=(), dtype=float32) tf.Tensor(5.0795307, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4000 Loss 5.5809 Accuracy 0.1781 small step: 0.0160 big step: 0.0640
tf.Tensor(5.07225, shape=(), dtype=float32) tf.Tensor(5.0721145, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4050 Loss 5.5746 Accuracy 0.1784 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0699544, shape=(), dtype=float32) tf.Tensor(5.070033, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4100 Loss 5.5684 Accuracy 0.1788 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0636, shape=(), dtype=float32) tf.Tensor(5.063683, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4150 Loss 5.5624 Accuracy 0.1792 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0699916, shape=(), dtype=float32) tf.Tensor(5.0699296, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4200 Loss 5.5565 Accuracy 0.1795 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0650177, shape=(), dtype=float32) tf.Tensor(5.0650053, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4250 Loss 5.5510 Accuracy 0.1798 small step: 0.0320 big step: 0.1280
tf.Tensor(5.091524, shape=(), dtype=float32) tf.Tensor(5.09178, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4300 Loss 5.5455 Accuracy 0.1801 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0822625, shape=(), dtype=float32) tf.Tensor(5.0822887, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4350 Loss 5.5401 Accuracy 0.1804 small step: 0.0080 big step: 0.0320
tf.Tensor(5.075228, shape=(), dtype=float32) tf.Tensor(5.0750885, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4400 Loss 5.5347 Accuracy 0.1807 small step: 0.0160 big step: 0.0640
tf.Tensor(5.057859, shape=(), dtype=float32) tf.Tensor(5.0578537, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4450 Loss 5.5293 Accuracy 0.1810 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0583925, shape=(), dtype=float32) tf.Tensor(5.058552, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4500 Loss 5.5242 Accuracy 0.1813 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0673976, shape=(), dtype=float32) tf.Tensor(5.067405, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4550 Loss 5.5191 Accuracy 0.1816 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0612416, shape=(), dtype=float32) tf.Tensor(5.0611024, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4600 Loss 5.5141 Accuracy 0.1819 small step: 0.0160 big step: 0.0640
tf.Tensor(5.060248, shape=(), dtype=float32) tf.Tensor(5.0602264, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4650 Loss 5.5092 Accuracy 0.1822 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0540133, shape=(), dtype=float32) tf.Tensor(5.0543823, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4700 Loss 5.5043 Accuracy 0.1825 small step: 0.0160 big step: 0.0640
tf.Tensor(5.05344, shape=(), dtype=float32) tf.Tensor(5.0534344, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4750 Loss 5.4995 Accuracy 0.1827 small step: 0.0320 big step: 0.1280
tf.Tensor(5.050473, shape=(), dtype=float32) tf.Tensor(5.0508575, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4800 Loss 5.4951 Accuracy 0.1830 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0719686, shape=(), dtype=float32) tf.Tensor(5.071956, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 4850 Loss 5.4907 Accuracy 0.1832 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0650015, shape=(), dtype=float32) tf.Tensor(5.0655212, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4900 Loss 5.4863 Accuracy 0.1835 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0654726, shape=(), dtype=float32) tf.Tensor(5.0655637, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 4950 Loss 5.4819 Accuracy 0.1837 small step: 0.0080 big step: 0.0320
tf.Tensor(5.05035, shape=(), dtype=float32) tf.Tensor(5.0501866, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5000 Loss 5.4778 Accuracy 0.1840 small step: 0.0160 big step: 0.0640
tf.Tensor(5.070565, shape=(), dtype=float32) tf.Tensor(5.0705843, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5050 Loss 5.4735 Accuracy 0.1842 small step: 0.0080 big step: 0.0320
tf.Tensor(5.04221, shape=(), dtype=float32) tf.Tensor(5.042139, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5100 Loss 5.4694 Accuracy 0.1845 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0534406, shape=(), dtype=float32) tf.Tensor(5.0535836, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5150 Loss 5.4654 Accuracy 0.1847 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0606437, shape=(), dtype=float32) tf.Tensor(5.060582, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5200 Loss 5.4615 Accuracy 0.1849 small step: 0.0160 big step: 0.0640
tf.Tensor(5.062358, shape=(), dtype=float32) tf.Tensor(5.0623446, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5250 Loss 5.4575 Accuracy 0.1851 small step: 0.0320 big step: 0.1280
tf.Tensor(5.040239, shape=(), dtype=float32) tf.Tensor(5.040865, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5300 Loss 5.4537 Accuracy 0.1853 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0536604, shape=(), dtype=float32) tf.Tensor(5.053747, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5350 Loss 5.4500 Accuracy 0.1856 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0542436, shape=(), dtype=float32) tf.Tensor(5.0541472, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5400 Loss 5.4462 Accuracy 0.1858 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0421605, shape=(), dtype=float32) tf.Tensor(5.0422626, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5450 Loss 5.4427 Accuracy 0.1860 small step: 0.0080 big step: 0.0320
tf.Tensor(5.05948, shape=(), dtype=float32) tf.Tensor(5.0593977, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5500 Loss 5.4390 Accuracy 0.1862 small step: 0.0160 big step: 0.0640
tf.Tensor(5.037077, shape=(), dtype=float32) tf.Tensor(5.037209, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5550 Loss 5.4354 Accuracy 0.1864 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0417376, shape=(), dtype=float32) tf.Tensor(5.041628, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5600 Loss 5.4320 Accuracy 0.1866 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0505714, shape=(), dtype=float32) tf.Tensor(5.0506253, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5650 Loss 5.4286 Accuracy 0.1868 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0563855, shape=(), dtype=float32) tf.Tensor(5.05634, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5700 Loss 5.4254 Accuracy 0.1870 small step: 0.0160 big step: 0.0640
tf.Tensor(5.063463, shape=(), dtype=float32) tf.Tensor(5.0636373, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5750 Loss 5.4221 Accuracy 0.1872 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0412307, shape=(), dtype=float32) tf.Tensor(5.041239, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5800 Loss 5.4189 Accuracy 0.1874 small step: 0.0040 big step: 0.0160
tf.Tensor(5.0494685, shape=(), dtype=float32) tf.Tensor(5.0493627, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5850 Loss 5.4158 Accuracy 0.1876 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0530148, shape=(), dtype=float32) tf.Tensor(5.052995, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 5900 Loss 5.4126 Accuracy 0.1877 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0422425, shape=(), dtype=float32) tf.Tensor(5.042383, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 5950 Loss 5.4095 Accuracy 0.1879 small step: 0.0080 big step: 0.0320
tf.Tensor(5.043539, shape=(), dtype=float32) tf.Tensor(5.0435777, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6000 Loss 5.4064 Accuracy 0.1881 small step: 0.0040 big step: 0.0160
tf.Tensor(5.0385556, shape=(), dtype=float32) tf.Tensor(5.038497, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6050 Loss 5.4034 Accuracy 0.1883 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0392094, shape=(), dtype=float32) tf.Tensor(5.0391397, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6100 Loss 5.4005 Accuracy 0.1884 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0524035, shape=(), dtype=float32) tf.Tensor(5.0525193, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6150 Loss 5.3975 Accuracy 0.1886 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0357103, shape=(), dtype=float32) tf.Tensor(5.035678, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6200 Loss 5.3947 Accuracy 0.1888 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0463, shape=(), dtype=float32) tf.Tensor(5.0463724, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6250 Loss 5.3918 Accuracy 0.1890 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0366035, shape=(), dtype=float32) tf.Tensor(5.036418, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6300 Loss 5.3889 Accuracy 0.1891 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0288277, shape=(), dtype=float32) tf.Tensor(5.028909, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6350 Loss 5.3862 Accuracy 0.1893 small step: 0.0080 big step: 0.0320
tf.Tensor(5.040138, shape=(), dtype=float32) tf.Tensor(5.0401144, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6400 Loss 5.3834 Accuracy 0.1894 small step: 0.0160 big step: 0.0640
tf.Tensor(5.030979, shape=(), dtype=float32) tf.Tensor(5.0309334, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6450 Loss 5.3805 Accuracy 0.1896 small step: 0.0320 big step: 0.1280
tf.Tensor(5.007011, shape=(), dtype=float32) tf.Tensor(5.0074778, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6500 Loss 5.3779 Accuracy 0.1898 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0473094, shape=(), dtype=float32) tf.Tensor(5.0474176, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6550 Loss 5.3753 Accuracy 0.1899 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0343223, shape=(), dtype=float32) tf.Tensor(5.034198, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6600 Loss 5.3728 Accuracy 0.1901 small step: 0.0160 big step: 0.0640
tf.Tensor(5.041411, shape=(), dtype=float32) tf.Tensor(5.0415883, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6650 Loss 5.3703 Accuracy 0.1902 small step: 0.0080 big step: 0.0320
tf.Tensor(5.035347, shape=(), dtype=float32) tf.Tensor(5.0353136, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6700 Loss 5.3677 Accuracy 0.1904 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0279145, shape=(), dtype=float32) tf.Tensor(5.028056, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6750 Loss 5.3653 Accuracy 0.1905 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0464973, shape=(), dtype=float32) tf.Tensor(5.046398, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6800 Loss 5.3630 Accuracy 0.1906 small step: 0.0160 big step: 0.0640
tf.Tensor(5.051677, shape=(), dtype=float32) tf.Tensor(5.0518613, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6850 Loss 5.3606 Accuracy 0.1908 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0309095, shape=(), dtype=float32) tf.Tensor(5.030927, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 6900 Loss 5.3581 Accuracy 0.1909 small step: 0.0040 big step: 0.0160
tf.Tensor(5.021994, shape=(), dtype=float32) tf.Tensor(5.0219274, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 6950 Loss 5.3557 Accuracy 0.1911 small step: 0.0080 big step: 0.0320
tf.Tensor(5.021269, shape=(), dtype=float32) tf.Tensor(5.0212045, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7000 Loss 5.3534 Accuracy 0.1912 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0256853, shape=(), dtype=float32) tf.Tensor(5.0256615, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7050 Loss 5.3511 Accuracy 0.1913 small step: 0.0320 big step: 0.1280
tf.Tensor(5.0332036, shape=(), dtype=float32) tf.Tensor(5.033765, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7100 Loss 5.3489 Accuracy 0.1914 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0428624, shape=(), dtype=float32) tf.Tensor(5.0429006, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7150 Loss 5.3467 Accuracy 0.1916 small step: 0.0080 big step: 0.0320
tf.Tensor(5.030774, shape=(), dtype=float32) tf.Tensor(5.030637, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7200 Loss 5.3446 Accuracy 0.1917 small step: 0.0160 big step: 0.0640
tf.Tensor(5.04142, shape=(), dtype=float32) tf.Tensor(5.041541, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7250 Loss 5.3424 Accuracy 0.1918 small step: 0.0080 big step: 0.0320
tf.Tensor(5.022968, shape=(), dtype=float32) tf.Tensor(5.022839, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7300 Loss 5.3402 Accuracy 0.1919 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0273113, shape=(), dtype=float32) tf.Tensor(5.027396, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7350 Loss 5.3380 Accuracy 0.1921 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0208755, shape=(), dtype=float32) tf.Tensor(5.0208707, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7400 Loss 5.3360 Accuracy 0.1922 small step: 0.0160 big step: 0.0640
tf.Tensor(5.030608, shape=(), dtype=float32) tf.Tensor(5.030841, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7450 Loss 5.3339 Accuracy 0.1923 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0282164, shape=(), dtype=float32) tf.Tensor(5.0281987, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7500 Loss 5.3317 Accuracy 0.1924 small step: 0.0160 big step: 0.0640
tf.Tensor(5.006111, shape=(), dtype=float32) tf.Tensor(5.0063643, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7550 Loss 5.3296 Accuracy 0.1926 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0127316, shape=(), dtype=float32) tf.Tensor(5.012634, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7600 Loss 5.3275 Accuracy 0.1927 small step: 0.0160 big step: 0.0640
tf.Tensor(5.014212, shape=(), dtype=float32) tf.Tensor(5.0143905, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7650 Loss 5.3256 Accuracy 0.1928 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0299397, shape=(), dtype=float32) tf.Tensor(5.0298686, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7700 Loss 5.3236 Accuracy 0.1929 small step: 0.0160 big step: 0.0640
tf.Tensor(5.023632, shape=(), dtype=float32) tf.Tensor(5.0239396, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7750 Loss 5.3215 Accuracy 0.1930 small step: 0.0080 big step: 0.0320
tf.Tensor(5.001112, shape=(), dtype=float32) tf.Tensor(5.001147, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7800 Loss 5.3196 Accuracy 0.1932 small step: 0.0040 big step: 0.0160
tf.Tensor(5.017173, shape=(), dtype=float32) tf.Tensor(5.0170913, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7850 Loss 5.3177 Accuracy 0.1933 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0275226, shape=(), dtype=float32) tf.Tensor(5.0275517, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 7900 Loss 5.3159 Accuracy 0.1934 small step: 0.0040 big step: 0.0160
tf.Tensor(5.027179, shape=(), dtype=float32) tf.Tensor(5.0271187, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 7950 Loss 5.3140 Accuracy 0.1935 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0133395, shape=(), dtype=float32) tf.Tensor(5.0132895, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8000 Loss 5.3122 Accuracy 0.1936 small step: 0.0160 big step: 0.0640
tf.Tensor(5.021479, shape=(), dtype=float32) tf.Tensor(5.021608, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8050 Loss 5.3104 Accuracy 0.1937 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0214143, shape=(), dtype=float32) tf.Tensor(5.0214143, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8100 Loss 5.3086 Accuracy 0.1938 small step: 0.0040 big step: 0.0160
tf.Tensor(5.025872, shape=(), dtype=float32) tf.Tensor(5.0258026, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8150 Loss 5.3068 Accuracy 0.1939 small step: 0.0080 big step: 0.0320
tf.Tensor(5.009163, shape=(), dtype=float32) tf.Tensor(5.0090423, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8200 Loss 5.3049 Accuracy 0.1940 small step: 0.0160 big step: 0.0640
tf.Tensor(4.999518, shape=(), dtype=float32) tf.Tensor(4.9996386, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8250 Loss 5.3030 Accuracy 0.1941 small step: 0.0080 big step: 0.0320
tf.Tensor(4.995169, shape=(), dtype=float32) tf.Tensor(4.995134, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8300 Loss 5.3012 Accuracy 0.1942 small step: 0.0160 big step: 0.0640
tf.Tensor(5.000335, shape=(), dtype=float32) tf.Tensor(5.000464, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8350 Loss 5.2994 Accuracy 0.1944 small step: 0.0080 big step: 0.0320
tf.Tensor(5.004238, shape=(), dtype=float32) tf.Tensor(5.0042086, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8400 Loss 5.2977 Accuracy 0.1945 small step: 0.0160 big step: 0.0640
tf.Tensor(5.016709, shape=(), dtype=float32) tf.Tensor(5.0169897, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8450 Loss 5.2960 Accuracy 0.1946 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0085955, shape=(), dtype=float32) tf.Tensor(5.008554, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8500 Loss 5.2943 Accuracy 0.1947 small step: 0.0160 big step: 0.0640
tf.Tensor(5.006552, shape=(), dtype=float32) tf.Tensor(5.006654, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8550 Loss 5.2925 Accuracy 0.1948 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9925346, shape=(), dtype=float32) tf.Tensor(4.99243, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8600 Loss 5.2909 Accuracy 0.1949 small step: 0.0160 big step: 0.0640
tf.Tensor(5.009374, shape=(), dtype=float32) tf.Tensor(5.009499, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8650 Loss 5.2892 Accuracy 0.1950 small step: 0.0080 big step: 0.0320
tf.Tensor(4.997046, shape=(), dtype=float32) tf.Tensor(4.9969454, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8700 Loss 5.2876 Accuracy 0.1951 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0054884, shape=(), dtype=float32) tf.Tensor(5.0056257, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8750 Loss 5.2860 Accuracy 0.1952 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0056615, shape=(), dtype=float32) tf.Tensor(5.005653, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8800 Loss 5.2843 Accuracy 0.1953 small step: 0.0160 big step: 0.0640
tf.Tensor(4.993664, shape=(), dtype=float32) tf.Tensor(4.9939203, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8850 Loss 5.2828 Accuracy 0.1954 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0157638, shape=(), dtype=float32) tf.Tensor(5.0156693, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 8900 Loss 5.2813 Accuracy 0.1955 small step: 0.0160 big step: 0.0640
tf.Tensor(5.016613, shape=(), dtype=float32) tf.Tensor(5.0167675, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 8950 Loss 5.2798 Accuracy 0.1955 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0078793, shape=(), dtype=float32) tf.Tensor(5.007848, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9000 Loss 5.2783 Accuracy 0.1956 small step: 0.0160 big step: 0.0640
tf.Tensor(5.014687, shape=(), dtype=float32) tf.Tensor(5.014914, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9050 Loss 5.2767 Accuracy 0.1957 small step: 0.0080 big step: 0.0320
tf.Tensor(4.986771, shape=(), dtype=float32) tf.Tensor(4.9866924, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9100 Loss 5.2752 Accuracy 0.1958 small step: 0.0160 big step: 0.0640
tf.Tensor(5.005644, shape=(), dtype=float32) tf.Tensor(5.0057673, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9150 Loss 5.2738 Accuracy 0.1959 small step: 0.0080 big step: 0.0320
tf.Tensor(5.011476, shape=(), dtype=float32) tf.Tensor(5.0114746, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9200 Loss 5.2723 Accuracy 0.1960 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0078373, shape=(), dtype=float32) tf.Tensor(5.008083, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9250 Loss 5.2708 Accuracy 0.1961 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9897857, shape=(), dtype=float32) tf.Tensor(4.9897203, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9300 Loss 5.2693 Accuracy 0.1962 small step: 0.0160 big step: 0.0640
tf.Tensor(5.001304, shape=(), dtype=float32) tf.Tensor(5.00149, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9350 Loss 5.2679 Accuracy 0.1962 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0081615, shape=(), dtype=float32) tf.Tensor(5.008093, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9400 Loss 5.2666 Accuracy 0.1963 small step: 0.0160 big step: 0.0640
tf.Tensor(5.012163, shape=(), dtype=float32) tf.Tensor(5.0123754, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9450 Loss 5.2651 Accuracy 0.1964 small step: 0.0080 big step: 0.0320
tf.Tensor(4.996161, shape=(), dtype=float32) tf.Tensor(4.9960885, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9500 Loss 5.2638 Accuracy 0.1965 small step: 0.0160 big step: 0.0640
tf.Tensor(5.006341, shape=(), dtype=float32) tf.Tensor(5.006369, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9550 Loss 5.2625 Accuracy 0.1966 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0102525, shape=(), dtype=float32) tf.Tensor(5.010207, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9600 Loss 5.2611 Accuracy 0.1966 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0041027, shape=(), dtype=float32) tf.Tensor(5.004268, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9650 Loss 5.2598 Accuracy 0.1967 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0084023, shape=(), dtype=float32) tf.Tensor(5.0084352, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9700 Loss 5.2585 Accuracy 0.1968 small step: 0.0040 big step: 0.0160
tf.Tensor(5.013871, shape=(), dtype=float32) tf.Tensor(5.0137877, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9750 Loss 5.2572 Accuracy 0.1969 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0043273, shape=(), dtype=float32) tf.Tensor(5.0043383, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9800 Loss 5.2559 Accuracy 0.1969 small step: 0.0040 big step: 0.0160
tf.Tensor(4.999742, shape=(), dtype=float32) tf.Tensor(4.999689, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9850 Loss 5.2546 Accuracy 0.1970 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0004077, shape=(), dtype=float32) tf.Tensor(5.000393, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 9900 Loss 5.2533 Accuracy 0.1971 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0023556, shape=(), dtype=float32) tf.Tensor(5.0025134, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 9950 Loss 5.2521 Accuracy 0.1972 small step: 0.0080 big step: 0.0320
tf.Tensor(5.008263, shape=(), dtype=float32) tf.Tensor(5.008332, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10000 Loss 5.2508 Accuracy 0.1972 small step: 0.0040 big step: 0.0160
tf.Tensor(4.991014, shape=(), dtype=float32) tf.Tensor(4.9909716, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10050 Loss 5.2494 Accuracy 0.1973 small step: 0.0080 big step: 0.0320
tf.Tensor(4.978233, shape=(), dtype=float32) tf.Tensor(4.978225, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10100 Loss 5.2482 Accuracy 0.1974 small step: 0.0160 big step: 0.0640
tf.Tensor(4.990136, shape=(), dtype=float32) tf.Tensor(4.9903917, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10150 Loss 5.2470 Accuracy 0.1975 small step: 0.0080 big step: 0.0320
tf.Tensor(5.0071073, shape=(), dtype=float32) tf.Tensor(5.0071197, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10200 Loss 5.2458 Accuracy 0.1975 small step: 0.0040 big step: 0.0160
tf.Tensor(4.999993, shape=(), dtype=float32) tf.Tensor(4.999955, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10250 Loss 5.2444 Accuracy 0.1976 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9749665, shape=(), dtype=float32) tf.Tensor(4.975036, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10300 Loss 5.2432 Accuracy 0.1977 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9811034, shape=(), dtype=float32) tf.Tensor(4.9811144, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10350 Loss 5.2420 Accuracy 0.1978 small step: 0.0020 big step: 0.0080
tf.Tensor(4.9986653, shape=(), dtype=float32) tf.Tensor(4.9986405, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10400 Loss 5.2409 Accuracy 0.1978 small step: 0.0040 big step: 0.0160
tf.Tensor(5.005619, shape=(), dtype=float32) tf.Tensor(5.0056276, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10450 Loss 5.2397 Accuracy 0.1979 small step: 0.0020 big step: 0.0080
tf.Tensor(4.9921317, shape=(), dtype=float32) tf.Tensor(4.9921117, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10500 Loss 5.2386 Accuracy 0.1980 small step: 0.0040 big step: 0.0160
tf.Tensor(5.0085707, shape=(), dtype=float32) tf.Tensor(5.00855, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10550 Loss 5.2374 Accuracy 0.1980 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9883375, shape=(), dtype=float32) tf.Tensor(4.9883075, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10600 Loss 5.2363 Accuracy 0.1981 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0092916, shape=(), dtype=float32) tf.Tensor(5.0094514, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10650 Loss 5.2352 Accuracy 0.1982 small step: 0.0080 big step: 0.0320
tf.Tensor(4.993128, shape=(), dtype=float32) tf.Tensor(4.9931154, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10700 Loss 5.2341 Accuracy 0.1982 small step: 0.0160 big step: 0.0640
tf.Tensor(5.0055757, shape=(), dtype=float32) tf.Tensor(5.0058293, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10750 Loss 5.2330 Accuracy 0.1983 small step: 0.0080 big step: 0.0320
tf.Tensor(4.995853, shape=(), dtype=float32) tf.Tensor(4.9958854, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10800 Loss 5.2319 Accuracy 0.1984 small step: 0.0040 big step: 0.0160
tf.Tensor(4.994312, shape=(), dtype=float32) tf.Tensor(4.9942756, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10850 Loss 5.2308 Accuracy 0.1984 small step: 0.0080 big step: 0.0320
tf.Tensor(4.990614, shape=(), dtype=float32) tf.Tensor(4.9905686, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 10900 Loss 5.2296 Accuracy 0.1985 small step: 0.0160 big step: 0.0640
tf.Tensor(4.980941, shape=(), dtype=float32) tf.Tensor(4.98127, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 10950 Loss 5.2285 Accuracy 0.1986 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9849257, shape=(), dtype=float32) tf.Tensor(4.9848695, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11000 Loss 5.2275 Accuracy 0.1986 small step: 0.0160 big step: 0.0640
tf.Tensor(5.00173, shape=(), dtype=float32) tf.Tensor(5.001872, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11050 Loss 5.2264 Accuracy 0.1987 small step: 0.0080 big step: 0.0320
tf.Tensor(4.989939, shape=(), dtype=float32) tf.Tensor(4.9898458, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11100 Loss 5.2252 Accuracy 0.1988 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9680643, shape=(), dtype=float32) tf.Tensor(4.968195, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11150 Loss 5.2242 Accuracy 0.1988 small step: 0.0080 big step: 0.0320
tf.Tensor(4.996476, shape=(), dtype=float32) tf.Tensor(4.996456, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11200 Loss 5.2231 Accuracy 0.1989 small step: 0.0160 big step: 0.0640
tf.Tensor(4.981444, shape=(), dtype=float32) tf.Tensor(4.9815927, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11250 Loss 5.2220 Accuracy 0.1990 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9703455, shape=(), dtype=float32) tf.Tensor(4.9703503, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11300 Loss 5.2210 Accuracy 0.1990 small step: 0.0040 big step: 0.0160
tf.Tensor(4.988981, shape=(), dtype=float32) tf.Tensor(4.9889717, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11350 Loss 5.2199 Accuracy 0.1991 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9868064, shape=(), dtype=float32) tf.Tensor(4.9867964, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11400 Loss 5.2189 Accuracy 0.1991 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9860277, shape=(), dtype=float32) tf.Tensor(4.9862585, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11450 Loss 5.2179 Accuracy 0.1992 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9875383, shape=(), dtype=float32) tf.Tensor(4.9876204, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11500 Loss 5.2169 Accuracy 0.1993 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9773784, shape=(), dtype=float32) tf.Tensor(4.9773536, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11550 Loss 5.2159 Accuracy 0.1993 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9889116, shape=(), dtype=float32) tf.Tensor(4.988959, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11600 Loss 5.2149 Accuracy 0.1994 small step: 0.0040 big step: 0.0160
tf.Tensor(4.99345, shape=(), dtype=float32) tf.Tensor(4.9933968, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11650 Loss 5.2139 Accuracy 0.1994 small step: 0.0080 big step: 0.0320
tf.Tensor(4.986264, shape=(), dtype=float32) tf.Tensor(4.986322, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11700 Loss 5.2130 Accuracy 0.1995 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9897323, shape=(), dtype=float32) tf.Tensor(4.9896903, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11750 Loss 5.2119 Accuracy 0.1996 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9725018, shape=(), dtype=float32) tf.Tensor(4.97254, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11800 Loss 5.2110 Accuracy 0.1996 small step: 0.0040 big step: 0.0160
tf.Tensor(4.995158, shape=(), dtype=float32) tf.Tensor(4.995154, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11850 Loss 5.2100 Accuracy 0.1997 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9736867, shape=(), dtype=float32) tf.Tensor(4.9736485, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 11900 Loss 5.2090 Accuracy 0.1998 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9748263, shape=(), dtype=float32) tf.Tensor(4.975114, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 11950 Loss 5.2081 Accuracy 0.1998 small step: 0.0080 big step: 0.0320
tf.Tensor(4.99483, shape=(), dtype=float32) tf.Tensor(4.9948163, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12000 Loss 5.2072 Accuracy 0.1999 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9823556, shape=(), dtype=float32) tf.Tensor(4.982615, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12050 Loss 5.2062 Accuracy 0.1999 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9722643, shape=(), dtype=float32) tf.Tensor(4.972309, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12100 Loss 5.2053 Accuracy 0.2000 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9770308, shape=(), dtype=float32) tf.Tensor(4.97697, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12150 Loss 5.2044 Accuracy 0.2000 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9850435, shape=(), dtype=float32) tf.Tensor(4.9850774, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12200 Loss 5.2034 Accuracy 0.2001 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9615593, shape=(), dtype=float32) tf.Tensor(4.9615307, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12250 Loss 5.2025 Accuracy 0.2001 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9849687, shape=(), dtype=float32) tf.Tensor(4.9849463, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12300 Loss 5.2016 Accuracy 0.2002 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9755907, shape=(), dtype=float32) tf.Tensor(4.975717, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12350 Loss 5.2007 Accuracy 0.2003 small step: 0.0080 big step: 0.0320
tf.Tensor(4.974744, shape=(), dtype=float32) tf.Tensor(4.974764, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12400 Loss 5.1997 Accuracy 0.2003 small step: 0.0040 big step: 0.0160
tf.Tensor(4.976384, shape=(), dtype=float32) tf.Tensor(4.9763417, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12450 Loss 5.1988 Accuracy 0.2004 small step: 0.0080 big step: 0.0320
tf.Tensor(4.969302, shape=(), dtype=float32) tf.Tensor(4.9693303, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12500 Loss 5.1979 Accuracy 0.2004 small step: 0.0040 big step: 0.0160
tf.Tensor(4.972756, shape=(), dtype=float32) tf.Tensor(4.972734, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12550 Loss 5.1971 Accuracy 0.2005 small step: 0.0080 big step: 0.0320
tf.Tensor(4.990546, shape=(), dtype=float32) tf.Tensor(4.99049, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12600 Loss 5.1963 Accuracy 0.2005 small step: 0.0160 big step: 0.0640
tf.Tensor(4.985711, shape=(), dtype=float32) tf.Tensor(4.9857726, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12650 Loss 5.1953 Accuracy 0.2006 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9650936, shape=(), dtype=float32) tf.Tensor(4.965078, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12700 Loss 5.1944 Accuracy 0.2006 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9628563, shape=(), dtype=float32) tf.Tensor(4.9631143, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12750 Loss 5.1936 Accuracy 0.2007 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9738965, shape=(), dtype=float32) tf.Tensor(4.973904, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12800 Loss 5.1928 Accuracy 0.2007 small step: 0.0040 big step: 0.0160
tf.Tensor(4.992209, shape=(), dtype=float32) tf.Tensor(4.992184, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12850 Loss 5.1920 Accuracy 0.2008 small step: 0.0080 big step: 0.0320
tf.Tensor(4.986647, shape=(), dtype=float32) tf.Tensor(4.98662, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 12900 Loss 5.1911 Accuracy 0.2008 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9732428, shape=(), dtype=float32) tf.Tensor(4.973396, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 12950 Loss 5.1902 Accuracy 0.2009 small step: 0.0080 big step: 0.0320
tf.Tensor(4.963374, shape=(), dtype=float32) tf.Tensor(4.9633927, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 13000 Loss 5.1894 Accuracy 0.2009 small step: 0.0040 big step: 0.0160
tf.Tensor(4.980155, shape=(), dtype=float32) tf.Tensor(4.980136, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 13050 Loss 5.1886 Accuracy 0.2010 small step: 0.0080 big step: 0.0320
tf.Tensor(4.970602, shape=(), dtype=float32) tf.Tensor(4.9706006, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 13100 Loss 5.1878 Accuracy 0.2010 small step: 0.0160 big step: 0.0640
tf.Tensor(4.9846873, shape=(), dtype=float32) tf.Tensor(4.984976, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 13150 Loss 5.1870 Accuracy 0.2011 small step: 0.0080 big step: 0.0320
tf.Tensor(4.982606, shape=(), dtype=float32) tf.Tensor(4.982685, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 13200 Loss 5.1862 Accuracy 0.2011 small step: 0.0040 big step: 0.0160
tf.Tensor(4.9715343, shape=(), dtype=float32) tf.Tensor(4.9714746, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 13250 Loss 5.1855 Accuracy 0.2012 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9846034, shape=(), dtype=float32) tf.Tensor(4.984691, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 13300 Loss 5.1846 Accuracy 0.2012 small step: 0.0040 big step: 0.0160
tf.Tensor(4.965639, shape=(), dtype=float32) tf.Tensor(4.9656296, shape=(), dtype=float32)
setting to big step
Epoch 1 Batch 13350 Loss 5.1838 Accuracy 0.2013 small step: 0.0080 big step: 0.0320
tf.Tensor(4.9715657, shape=(), dtype=float32) tf.Tensor(4.9716015, shape=(), dtype=float32)
setting to small step
Epoch 1 Batch 13400 Loss 5.1830 Accuracy 0.2013 small step: 0.0040 big step: 0.0160
tf.Tensor(4.958451, shape=(), dtype=float32) tf.Tensor(4.9584303, shape=(), dtype=float32)
setting to big step
Epoch 1 Loss 5.18295860 Accuracy 0.2013, small step: 0.0080 big step: 0.0320
Reseting lr
Time taken for 1 epoch: 6974.69 secs
0.00035 0.0014
small step: 3.5000 big step: 14.0000
Epoch 2 Batch 50 Loss 5.9826 Accuracy 0.1257 small step: 3.5000 big step: 14.0000
tf.Tensor(5.0566216, shape=(), dtype=float32) tf.Tensor(6.908589, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 100 Loss 5.5135 Accuracy 0.1645 small step: 1.7500 big step: 7.0000
tf.Tensor(4.9796495, shape=(), dtype=float32) tf.Tensor(5.090523, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 150 Loss 5.3297 Accuracy 0.1802 small step: 0.8750 big step: 3.5000
tf.Tensor(4.9450636, shape=(), dtype=float32) tf.Tensor(4.9717655, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 200 Loss 5.2252 Accuracy 0.1892 small step: 0.4375 big step: 1.7500
tf.Tensor(4.90371, shape=(), dtype=float32) tf.Tensor(4.915517, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 250 Loss 5.1584 Accuracy 0.1952 small step: 0.2187 big step: 0.8750
tf.Tensor(4.8882356, shape=(), dtype=float32) tf.Tensor(4.8914385, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 300 Loss 5.1106 Accuracy 0.1996 small step: 0.1094 big step: 0.4375
tf.Tensor(4.870462, shape=(), dtype=float32) tf.Tensor(4.870976, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 350 Loss 5.0785 Accuracy 0.2024 small step: 0.0547 big step: 0.2187
tf.Tensor(4.8848224, shape=(), dtype=float32) tf.Tensor(4.884744, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 400 Loss 5.0527 Accuracy 0.2048 small step: 0.1094 big step: 0.4375
tf.Tensor(4.870874, shape=(), dtype=float32) tf.Tensor(4.8730116, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 450 Loss 5.0321 Accuracy 0.2067 small step: 0.0547 big step: 0.2187
tf.Tensor(4.8663883, shape=(), dtype=float32) tf.Tensor(4.8667774, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 500 Loss 5.0134 Accuracy 0.2084 small step: 0.0273 big step: 0.1094
tf.Tensor(4.844754, shape=(), dtype=float32) tf.Tensor(4.8444443, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 550 Loss 4.9988 Accuracy 0.2096 small step: 0.0547 big step: 0.2187
tf.Tensor(4.852902, shape=(), dtype=float32) tf.Tensor(4.8534675, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 600 Loss 4.9861 Accuracy 0.2107 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8456187, shape=(), dtype=float32) tf.Tensor(4.8455973, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 650 Loss 4.9756 Accuracy 0.2116 small step: 0.0547 big step: 0.2187
tf.Tensor(4.8495283, shape=(), dtype=float32) tf.Tensor(4.8504705, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 700 Loss 4.9671 Accuracy 0.2124 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8560185, shape=(), dtype=float32) tf.Tensor(4.856017, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 750 Loss 4.9600 Accuracy 0.2130 small step: 0.0547 big step: 0.2187
tf.Tensor(4.8607483, shape=(), dtype=float32) tf.Tensor(4.861647, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 800 Loss 4.9520 Accuracy 0.2137 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8311214, shape=(), dtype=float32) tf.Tensor(4.8312373, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 850 Loss 4.9470 Accuracy 0.2141 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8666906, shape=(), dtype=float32) tf.Tensor(4.8665996, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 900 Loss 4.9411 Accuracy 0.2146 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8410273, shape=(), dtype=float32) tf.Tensor(4.8413653, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 950 Loss 4.9368 Accuracy 0.2150 small step: 0.0137 big step: 0.0547
tf.Tensor(4.858302, shape=(), dtype=float32) tf.Tensor(4.8582754, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1000 Loss 4.9327 Accuracy 0.2153 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8550606, shape=(), dtype=float32) tf.Tensor(4.8557153, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1050 Loss 4.9285 Accuracy 0.2156 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8449755, shape=(), dtype=float32) tf.Tensor(4.8448863, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1100 Loss 4.9243 Accuracy 0.2160 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8348217, shape=(), dtype=float32) tf.Tensor(4.835016, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1150 Loss 4.9215 Accuracy 0.2163 small step: 0.0137 big step: 0.0547
tf.Tensor(4.859586, shape=(), dtype=float32) tf.Tensor(4.85956, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1200 Loss 4.9179 Accuracy 0.2166 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8360643, shape=(), dtype=float32) tf.Tensor(4.8361845, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1250 Loss 4.9148 Accuracy 0.2168 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8401885, shape=(), dtype=float32) tf.Tensor(4.8400874, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1300 Loss 4.9118 Accuracy 0.2171 small step: 0.0273 big step: 0.1094
tf.Tensor(4.836466, shape=(), dtype=float32) tf.Tensor(4.836596, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1350 Loss 4.9094 Accuracy 0.2172 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8481603, shape=(), dtype=float32) tf.Tensor(4.848072, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1400 Loss 4.9067 Accuracy 0.2175 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8322763, shape=(), dtype=float32) tf.Tensor(4.832636, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1450 Loss 4.9048 Accuracy 0.2177 small step: 0.0137 big step: 0.0547
tf.Tensor(4.850663, shape=(), dtype=float32) tf.Tensor(4.8506794, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1500 Loss 4.9025 Accuracy 0.2179 small step: 0.0068 big step: 0.0273
tf.Tensor(4.837535, shape=(), dtype=float32) tf.Tensor(4.837417, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1550 Loss 4.9010 Accuracy 0.2181 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8558016, shape=(), dtype=float32) tf.Tensor(4.8559566, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1600 Loss 4.8988 Accuracy 0.2182 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8299656, shape=(), dtype=float32) tf.Tensor(4.8298526, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1650 Loss 4.8969 Accuracy 0.2184 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8353796, shape=(), dtype=float32) tf.Tensor(4.835395, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1700 Loss 4.8950 Accuracy 0.2186 small step: 0.0068 big step: 0.0273
tf.Tensor(4.831872, shape=(), dtype=float32) tf.Tensor(4.8318152, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1750 Loss 4.8930 Accuracy 0.2187 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8280168, shape=(), dtype=float32) tf.Tensor(4.828083, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1800 Loss 4.8918 Accuracy 0.2189 small step: 0.0068 big step: 0.0273
tf.Tensor(4.848401, shape=(), dtype=float32) tf.Tensor(4.8483357, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1850 Loss 4.8904 Accuracy 0.2190 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8384123, shape=(), dtype=float32) tf.Tensor(4.838571, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 1900 Loss 4.8891 Accuracy 0.2191 small step: 0.0068 big step: 0.0273
tf.Tensor(4.840583, shape=(), dtype=float32) tf.Tensor(4.840558, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 1950 Loss 4.8880 Accuracy 0.2192 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8460836, shape=(), dtype=float32) tf.Tensor(4.8461294, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2000 Loss 4.8867 Accuracy 0.2193 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8389516, shape=(), dtype=float32) tf.Tensor(4.838893, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2050 Loss 4.8856 Accuracy 0.2194 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8387604, shape=(), dtype=float32) tf.Tensor(4.838774, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2100 Loss 4.8842 Accuracy 0.2195 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8305583, shape=(), dtype=float32) tf.Tensor(4.8304853, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2150 Loss 4.8835 Accuracy 0.2195 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8512273, shape=(), dtype=float32) tf.Tensor(4.8513308, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2200 Loss 4.8823 Accuracy 0.2197 small step: 0.0068 big step: 0.0273
tf.Tensor(4.830035, shape=(), dtype=float32) tf.Tensor(4.830019, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2250 Loss 4.8815 Accuracy 0.2198 small step: 0.0137 big step: 0.0547
tf.Tensor(4.845805, shape=(), dtype=float32) tf.Tensor(4.845957, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2300 Loss 4.8806 Accuracy 0.2198 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8403416, shape=(), dtype=float32) tf.Tensor(4.8402343, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2350 Loss 4.8796 Accuracy 0.2199 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8355627, shape=(), dtype=float32) tf.Tensor(4.8354545, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2400 Loss 4.8787 Accuracy 0.2200 small step: 0.0273 big step: 0.1094
tf.Tensor(4.8378806, shape=(), dtype=float32) tf.Tensor(4.838473, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2450 Loss 4.8780 Accuracy 0.2201 small step: 0.0137 big step: 0.0547
tf.Tensor(4.84406, shape=(), dtype=float32) tf.Tensor(4.8441634, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2500 Loss 4.8768 Accuracy 0.2202 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8151836, shape=(), dtype=float32) tf.Tensor(4.8151503, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2550 Loss 4.8759 Accuracy 0.2203 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8317766, shape=(), dtype=float32) tf.Tensor(4.8319006, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2600 Loss 4.8752 Accuracy 0.2203 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8399343, shape=(), dtype=float32) tf.Tensor(4.839923, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2650 Loss 4.8745 Accuracy 0.2204 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8356676, shape=(), dtype=float32) tf.Tensor(4.8357506, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2700 Loss 4.8739 Accuracy 0.2204 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8418274, shape=(), dtype=float32) tf.Tensor(4.841845, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2750 Loss 4.8732 Accuracy 0.2205 small step: 0.0034 big step: 0.0137
tf.Tensor(4.839341, shape=(), dtype=float32) tf.Tensor(4.8393154, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2800 Loss 4.8722 Accuracy 0.2206 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8127623, shape=(), dtype=float32) tf.Tensor(4.8127613, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 2850 Loss 4.8712 Accuracy 0.2207 small step: 0.0137 big step: 0.0547
tf.Tensor(4.818183, shape=(), dtype=float32) tf.Tensor(4.818343, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2900 Loss 4.8704 Accuracy 0.2207 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8227954, shape=(), dtype=float32) tf.Tensor(4.822836, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 2950 Loss 4.8695 Accuracy 0.2208 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8179865, shape=(), dtype=float32) tf.Tensor(4.81791, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3000 Loss 4.8687 Accuracy 0.2209 small step: 0.0068 big step: 0.0273
tf.Tensor(4.821822, shape=(), dtype=float32) tf.Tensor(4.8218145, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3050 Loss 4.8682 Accuracy 0.2209 small step: 0.0137 big step: 0.0547
tf.Tensor(4.838146, shape=(), dtype=float32) tf.Tensor(4.838253, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3100 Loss 4.8674 Accuracy 0.2210 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8183193, shape=(), dtype=float32) tf.Tensor(4.818301, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3150 Loss 4.8666 Accuracy 0.2210 small step: 0.0137 big step: 0.0547
tf.Tensor(4.816984, shape=(), dtype=float32) tf.Tensor(4.8170524, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3200 Loss 4.8662 Accuracy 0.2211 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8389196, shape=(), dtype=float32) tf.Tensor(4.838907, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3250 Loss 4.8656 Accuracy 0.2211 small step: 0.0137 big step: 0.0547
tf.Tensor(4.831927, shape=(), dtype=float32) tf.Tensor(4.8320932, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3300 Loss 4.8651 Accuracy 0.2212 small step: 0.0068 big step: 0.0273
tf.Tensor(4.833053, shape=(), dtype=float32) tf.Tensor(4.833016, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3350 Loss 4.8645 Accuracy 0.2212 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8244715, shape=(), dtype=float32) tf.Tensor(4.824612, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3400 Loss 4.8640 Accuracy 0.2213 small step: 0.0068 big step: 0.0273
tf.Tensor(4.82683, shape=(), dtype=float32) tf.Tensor(4.826849, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3450 Loss 4.8634 Accuracy 0.2213 small step: 0.0034 big step: 0.0137
tf.Tensor(4.821609, shape=(), dtype=float32) tf.Tensor(4.821568, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3500 Loss 4.8629 Accuracy 0.2214 small step: 0.0068 big step: 0.0273
tf.Tensor(4.828855, shape=(), dtype=float32) tf.Tensor(4.828859, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3550 Loss 4.8623 Accuracy 0.2214 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8222237, shape=(), dtype=float32) tf.Tensor(4.822169, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3600 Loss 4.8617 Accuracy 0.2215 small step: 0.0068 big step: 0.0273
tf.Tensor(4.820958, shape=(), dtype=float32) tf.Tensor(4.820931, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3650 Loss 4.8613 Accuracy 0.2215 small step: 0.0137 big step: 0.0547
tf.Tensor(4.833453, shape=(), dtype=float32) tf.Tensor(4.8335447, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3700 Loss 4.8607 Accuracy 0.2216 small step: 0.0068 big step: 0.0273
tf.Tensor(4.814775, shape=(), dtype=float32) tf.Tensor(4.814773, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3750 Loss 4.8604 Accuracy 0.2216 small step: 0.0137 big step: 0.0547
tf.Tensor(4.835135, shape=(), dtype=float32) tf.Tensor(4.8354, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3800 Loss 4.8597 Accuracy 0.2217 small step: 0.0068 big step: 0.0273
tf.Tensor(4.811293, shape=(), dtype=float32) tf.Tensor(4.8112764, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 3850 Loss 4.8594 Accuracy 0.2217 small step: 0.0137 big step: 0.0547
tf.Tensor(4.834083, shape=(), dtype=float32) tf.Tensor(4.834257, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3900 Loss 4.8589 Accuracy 0.2217 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8241487, shape=(), dtype=float32) tf.Tensor(4.8241696, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 3950 Loss 4.8585 Accuracy 0.2218 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8216734, shape=(), dtype=float32) tf.Tensor(4.8216257, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4000 Loss 4.8580 Accuracy 0.2218 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8177953, shape=(), dtype=float32) tf.Tensor(4.8177786, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4050 Loss 4.8575 Accuracy 0.2219 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8211718, shape=(), dtype=float32) tf.Tensor(4.8213797, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4100 Loss 4.8572 Accuracy 0.2219 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8314066, shape=(), dtype=float32) tf.Tensor(4.8313475, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4150 Loss 4.8567 Accuracy 0.2219 small step: 0.0137 big step: 0.0547
tf.Tensor(4.819988, shape=(), dtype=float32) tf.Tensor(4.820128, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4200 Loss 4.8564 Accuracy 0.2220 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8269887, shape=(), dtype=float32) tf.Tensor(4.826978, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4250 Loss 4.8559 Accuracy 0.2220 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8180637, shape=(), dtype=float32) tf.Tensor(4.8181887, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4300 Loss 4.8556 Accuracy 0.2220 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8236256, shape=(), dtype=float32) tf.Tensor(4.823596, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4350 Loss 4.8551 Accuracy 0.2221 small step: 0.0137 big step: 0.0547
tf.Tensor(4.815709, shape=(), dtype=float32) tf.Tensor(4.8157988, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4400 Loss 4.8547 Accuracy 0.2221 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8222857, shape=(), dtype=float32) tf.Tensor(4.8222275, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4450 Loss 4.8542 Accuracy 0.2222 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8039794, shape=(), dtype=float32) tf.Tensor(4.804167, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4500 Loss 4.8538 Accuracy 0.2222 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8183775, shape=(), dtype=float32) tf.Tensor(4.8183684, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4550 Loss 4.8535 Accuracy 0.2222 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8260303, shape=(), dtype=float32) tf.Tensor(4.8261204, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4600 Loss 4.8531 Accuracy 0.2223 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8242254, shape=(), dtype=float32) tf.Tensor(4.824193, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4650 Loss 4.8527 Accuracy 0.2223 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8150144, shape=(), dtype=float32) tf.Tensor(4.815091, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4700 Loss 4.8521 Accuracy 0.2224 small step: 0.0068 big step: 0.0273
tf.Tensor(4.795209, shape=(), dtype=float32) tf.Tensor(4.795175, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4750 Loss 4.8516 Accuracy 0.2224 small step: 0.0137 big step: 0.0547
tf.Tensor(4.80384, shape=(), dtype=float32) tf.Tensor(4.8040504, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4800 Loss 4.8511 Accuracy 0.2225 small step: 0.0068 big step: 0.0273
tf.Tensor(4.798369, shape=(), dtype=float32) tf.Tensor(4.7983165, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4850 Loss 4.8506 Accuracy 0.2225 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8103147, shape=(), dtype=float32) tf.Tensor(4.8103895, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 4900 Loss 4.8504 Accuracy 0.2225 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8230295, shape=(), dtype=float32) tf.Tensor(4.8229737, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 4950 Loss 4.8501 Accuracy 0.2225 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8212523, shape=(), dtype=float32) tf.Tensor(4.8213387, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5000 Loss 4.8496 Accuracy 0.2226 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8079953, shape=(), dtype=float32) tf.Tensor(4.8079214, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5050 Loss 4.8492 Accuracy 0.2226 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8064213, shape=(), dtype=float32) tf.Tensor(4.806575, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5100 Loss 4.8489 Accuracy 0.2226 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8205504, shape=(), dtype=float32) tf.Tensor(4.8205566, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5150 Loss 4.8485 Accuracy 0.2227 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8061414, shape=(), dtype=float32) tf.Tensor(4.8060884, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5200 Loss 4.8482 Accuracy 0.2227 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8108196, shape=(), dtype=float32) tf.Tensor(4.8108525, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5250 Loss 4.8479 Accuracy 0.2227 small step: 0.0034 big step: 0.0137
tf.Tensor(4.818039, shape=(), dtype=float32) tf.Tensor(4.818004, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5300 Loss 4.8476 Accuracy 0.2227 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8155866, shape=(), dtype=float32) tf.Tensor(4.815636, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5350 Loss 4.8472 Accuracy 0.2228 small step: 0.0034 big step: 0.0137
tf.Tensor(4.812141, shape=(), dtype=float32) tf.Tensor(4.8120914, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5400 Loss 4.8469 Accuracy 0.2228 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8165817, shape=(), dtype=float32) tf.Tensor(4.816542, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5450 Loss 4.8465 Accuracy 0.2228 small step: 0.0137 big step: 0.0547
tf.Tensor(4.801719, shape=(), dtype=float32) tf.Tensor(4.802072, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5500 Loss 4.8461 Accuracy 0.2229 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8014755, shape=(), dtype=float32) tf.Tensor(4.801557, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5550 Loss 4.8457 Accuracy 0.2229 small step: 0.0034 big step: 0.0137
tf.Tensor(4.801903, shape=(), dtype=float32) tf.Tensor(4.8018937, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5600 Loss 4.8453 Accuracy 0.2229 small step: 0.0068 big step: 0.0273
tf.Tensor(4.803016, shape=(), dtype=float32) tf.Tensor(4.803037, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5650 Loss 4.8451 Accuracy 0.2230 small step: 0.0034 big step: 0.0137
tf.Tensor(4.81865, shape=(), dtype=float32) tf.Tensor(4.8185925, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5700 Loss 4.8449 Accuracy 0.2230 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8240776, shape=(), dtype=float32) tf.Tensor(4.824047, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5750 Loss 4.8444 Accuracy 0.2230 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7889285, shape=(), dtype=float32) tf.Tensor(4.7890706, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5800 Loss 4.8441 Accuracy 0.2231 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8068013, shape=(), dtype=float32) tf.Tensor(4.806836, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5850 Loss 4.8440 Accuracy 0.2231 small step: 0.0034 big step: 0.0137
tf.Tensor(4.825322, shape=(), dtype=float32) tf.Tensor(4.8252687, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 5900 Loss 4.8438 Accuracy 0.2231 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8255134, shape=(), dtype=float32) tf.Tensor(4.825528, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 5950 Loss 4.8434 Accuracy 0.2231 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7936773, shape=(), dtype=float32) tf.Tensor(4.7936344, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6000 Loss 4.8429 Accuracy 0.2232 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7803283, shape=(), dtype=float32) tf.Tensor(4.780306, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6050 Loss 4.8425 Accuracy 0.2232 small step: 0.0137 big step: 0.0547
tf.Tensor(4.804253, shape=(), dtype=float32) tf.Tensor(4.804571, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6100 Loss 4.8422 Accuracy 0.2233 small step: 0.0068 big step: 0.0273
tf.Tensor(4.803521, shape=(), dtype=float32) tf.Tensor(4.8035135, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6150 Loss 4.8418 Accuracy 0.2233 small step: 0.0137 big step: 0.0547
tf.Tensor(4.797098, shape=(), dtype=float32) tf.Tensor(4.7972245, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6200 Loss 4.8416 Accuracy 0.2233 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8067775, shape=(), dtype=float32) tf.Tensor(4.8067546, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6250 Loss 4.8413 Accuracy 0.2233 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8128123, shape=(), dtype=float32) tf.Tensor(4.813134, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6300 Loss 4.8410 Accuracy 0.2234 small step: 0.0068 big step: 0.0273
tf.Tensor(4.794663, shape=(), dtype=float32) tf.Tensor(4.7947016, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6350 Loss 4.8408 Accuracy 0.2234 small step: 0.0034 big step: 0.0137
tf.Tensor(4.814885, shape=(), dtype=float32) tf.Tensor(4.814806, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6400 Loss 4.8404 Accuracy 0.2234 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7886915, shape=(), dtype=float32) tf.Tensor(4.7886844, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6450 Loss 4.8400 Accuracy 0.2235 small step: 0.0137 big step: 0.0547
tf.Tensor(4.797736, shape=(), dtype=float32) tf.Tensor(4.7978544, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6500 Loss 4.8397 Accuracy 0.2235 small step: 0.0068 big step: 0.0273
tf.Tensor(4.798286, shape=(), dtype=float32) tf.Tensor(4.7982826, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6550 Loss 4.8396 Accuracy 0.2235 small step: 0.0137 big step: 0.0547
tf.Tensor(4.82137, shape=(), dtype=float32) tf.Tensor(4.8216033, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6600 Loss 4.8393 Accuracy 0.2235 small step: 0.0068 big step: 0.0273
tf.Tensor(4.809973, shape=(), dtype=float32) tf.Tensor(4.809949, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6650 Loss 4.8389 Accuracy 0.2236 small step: 0.0137 big step: 0.0547
tf.Tensor(4.786342, shape=(), dtype=float32) tf.Tensor(4.7865777, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6700 Loss 4.8387 Accuracy 0.2236 small step: 0.0068 big step: 0.0273
tf.Tensor(4.804751, shape=(), dtype=float32) tf.Tensor(4.8047657, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6750 Loss 4.8385 Accuracy 0.2236 small step: 0.0034 big step: 0.0137
tf.Tensor(4.807839, shape=(), dtype=float32) tf.Tensor(4.8078394, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6800 Loss 4.8382 Accuracy 0.2236 small step: 0.0017 big step: 0.0068
tf.Tensor(4.797651, shape=(), dtype=float32) tf.Tensor(4.797607, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6850 Loss 4.8378 Accuracy 0.2237 small step: 0.0034 big step: 0.0137
tf.Tensor(4.793405, shape=(), dtype=float32) tf.Tensor(4.7933908, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 6900 Loss 4.8375 Accuracy 0.2237 small step: 0.0068 big step: 0.0273
tf.Tensor(4.798452, shape=(), dtype=float32) tf.Tensor(4.7984824, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 6950 Loss 4.8372 Accuracy 0.2237 small step: 0.0034 big step: 0.0137
tf.Tensor(4.790421, shape=(), dtype=float32) tf.Tensor(4.7904115, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7000 Loss 4.8369 Accuracy 0.2237 small step: 0.0068 big step: 0.0273
tf.Tensor(4.801047, shape=(), dtype=float32) tf.Tensor(4.801065, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7050 Loss 4.8367 Accuracy 0.2238 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7965093, shape=(), dtype=float32) tf.Tensor(4.7964826, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7100 Loss 4.8365 Accuracy 0.2238 small step: 0.0068 big step: 0.0273
tf.Tensor(4.811073, shape=(), dtype=float32) tf.Tensor(4.8111324, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7150 Loss 4.8362 Accuracy 0.2238 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7974544, shape=(), dtype=float32) tf.Tensor(4.7974725, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7200 Loss 4.8360 Accuracy 0.2238 small step: 0.0017 big step: 0.0068
tf.Tensor(4.8072834, shape=(), dtype=float32) tf.Tensor(4.8072567, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7250 Loss 4.8358 Accuracy 0.2238 small step: 0.0034 big step: 0.0137
tf.Tensor(4.811517, shape=(), dtype=float32) tf.Tensor(4.8115053, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7300 Loss 4.8356 Accuracy 0.2238 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7968373, shape=(), dtype=float32) tf.Tensor(4.796903, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7350 Loss 4.8354 Accuracy 0.2239 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8186927, shape=(), dtype=float32) tf.Tensor(4.81866, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7400 Loss 4.8352 Accuracy 0.2239 small step: 0.0068 big step: 0.0273
tf.Tensor(4.79916, shape=(), dtype=float32) tf.Tensor(4.799149, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7450 Loss 4.8350 Accuracy 0.2239 small step: 0.0137 big step: 0.0547
tf.Tensor(4.807677, shape=(), dtype=float32) tf.Tensor(4.807826, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7500 Loss 4.8347 Accuracy 0.2239 small step: 0.0068 big step: 0.0273
tf.Tensor(4.79179, shape=(), dtype=float32) tf.Tensor(4.7918186, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7550 Loss 4.8344 Accuracy 0.2240 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7832394, shape=(), dtype=float32) tf.Tensor(4.783184, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7600 Loss 4.8341 Accuracy 0.2240 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7858315, shape=(), dtype=float32) tf.Tensor(4.785823, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7650 Loss 4.8338 Accuracy 0.2240 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7976637, shape=(), dtype=float32) tf.Tensor(4.7978745, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7700 Loss 4.8337 Accuracy 0.2240 small step: 0.0068 big step: 0.0273
tf.Tensor(4.806968, shape=(), dtype=float32) tf.Tensor(4.807046, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7750 Loss 4.8334 Accuracy 0.2240 small step: 0.0034 big step: 0.0137
tf.Tensor(4.789149, shape=(), dtype=float32) tf.Tensor(4.789145, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7800 Loss 4.8331 Accuracy 0.2241 small step: 0.0068 big step: 0.0273
tf.Tensor(4.784612, shape=(), dtype=float32) tf.Tensor(4.7846594, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7850 Loss 4.8329 Accuracy 0.2241 small step: 0.0034 big step: 0.0137
tf.Tensor(4.810474, shape=(), dtype=float32) tf.Tensor(4.810431, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 7900 Loss 4.8328 Accuracy 0.2241 small step: 0.0068 big step: 0.0273
tf.Tensor(4.814689, shape=(), dtype=float32) tf.Tensor(4.8147197, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 7950 Loss 4.8325 Accuracy 0.2241 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7917056, shape=(), dtype=float32) tf.Tensor(4.7917137, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8000 Loss 4.8323 Accuracy 0.2241 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7963123, shape=(), dtype=float32) tf.Tensor(4.796309, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8050 Loss 4.8321 Accuracy 0.2241 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7975836, shape=(), dtype=float32) tf.Tensor(4.797575, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8100 Loss 4.8318 Accuracy 0.2242 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7860374, shape=(), dtype=float32) tf.Tensor(4.7860045, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8150 Loss 4.8315 Accuracy 0.2242 small step: 0.0137 big step: 0.0547
tf.Tensor(4.782052, shape=(), dtype=float32) tf.Tensor(4.7823734, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8200 Loss 4.8313 Accuracy 0.2242 small step: 0.0068 big step: 0.0273
tf.Tensor(4.795112, shape=(), dtype=float32) tf.Tensor(4.795164, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8250 Loss 4.8310 Accuracy 0.2242 small step: 0.0034 big step: 0.0137
tf.Tensor(4.78675, shape=(), dtype=float32) tf.Tensor(4.7867546, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8300 Loss 4.8308 Accuracy 0.2242 small step: 0.0017 big step: 0.0068
tf.Tensor(4.788347, shape=(), dtype=float32) tf.Tensor(4.7883015, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8350 Loss 4.8306 Accuracy 0.2243 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7991753, shape=(), dtype=float32) tf.Tensor(4.7991624, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8400 Loss 4.8303 Accuracy 0.2243 small step: 0.0068 big step: 0.0273
tf.Tensor(4.79052, shape=(), dtype=float32) tf.Tensor(4.7905617, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8450 Loss 4.8302 Accuracy 0.2243 small step: 0.0034 big step: 0.0137
tf.Tensor(4.808139, shape=(), dtype=float32) tf.Tensor(4.808099, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8500 Loss 4.8299 Accuracy 0.2243 small step: 0.0068 big step: 0.0273
tf.Tensor(4.784459, shape=(), dtype=float32) tf.Tensor(4.784491, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8550 Loss 4.8297 Accuracy 0.2243 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7934494, shape=(), dtype=float32) tf.Tensor(4.7934027, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8600 Loss 4.8296 Accuracy 0.2243 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8069324, shape=(), dtype=float32) tf.Tensor(4.806915, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8650 Loss 4.8293 Accuracy 0.2244 small step: 0.0137 big step: 0.0547
tf.Tensor(4.778311, shape=(), dtype=float32) tf.Tensor(4.7784214, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8700 Loss 4.8289 Accuracy 0.2244 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7712793, shape=(), dtype=float32) tf.Tensor(4.7712946, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8750 Loss 4.8288 Accuracy 0.2244 small step: 0.0034 big step: 0.0137
tf.Tensor(4.805596, shape=(), dtype=float32) tf.Tensor(4.805546, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8800 Loss 4.8286 Accuracy 0.2244 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7968035, shape=(), dtype=float32) tf.Tensor(4.7967763, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8850 Loss 4.8285 Accuracy 0.2244 small step: 0.0137 big step: 0.0547
tf.Tensor(4.802598, shape=(), dtype=float32) tf.Tensor(4.802685, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 8900 Loss 4.8283 Accuracy 0.2245 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7915516, shape=(), dtype=float32) tf.Tensor(4.791521, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 8950 Loss 4.8281 Accuracy 0.2245 small step: 0.0137 big step: 0.0547
tf.Tensor(4.8014426, shape=(), dtype=float32) tf.Tensor(4.8017287, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9000 Loss 4.8279 Accuracy 0.2245 small step: 0.0068 big step: 0.0273
tf.Tensor(4.782612, shape=(), dtype=float32) tf.Tensor(4.7826576, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9050 Loss 4.8276 Accuracy 0.2245 small step: 0.0034 big step: 0.0137
tf.Tensor(4.780699, shape=(), dtype=float32) tf.Tensor(4.7806687, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9100 Loss 4.8275 Accuracy 0.2245 small step: 0.0068 big step: 0.0273
tf.Tensor(4.8138776, shape=(), dtype=float32) tf.Tensor(4.8138847, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9150 Loss 4.8273 Accuracy 0.2245 small step: 0.0034 big step: 0.0137
tf.Tensor(4.782875, shape=(), dtype=float32) tf.Tensor(4.7828865, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9200 Loss 4.8271 Accuracy 0.2246 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7818418, shape=(), dtype=float32) tf.Tensor(4.7818236, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9250 Loss 4.8269 Accuracy 0.2246 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7984686, shape=(), dtype=float32) tf.Tensor(4.798457, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9300 Loss 4.8267 Accuracy 0.2246 small step: 0.0068 big step: 0.0273
tf.Tensor(4.784046, shape=(), dtype=float32) tf.Tensor(4.78409, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9350 Loss 4.8266 Accuracy 0.2246 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8132787, shape=(), dtype=float32) tf.Tensor(4.8132815, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9400 Loss 4.8264 Accuracy 0.2246 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7917814, shape=(), dtype=float32) tf.Tensor(4.791783, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9450 Loss 4.8262 Accuracy 0.2246 small step: 0.0009 big step: 0.0034
tf.Tensor(4.787091, shape=(), dtype=float32) tf.Tensor(4.7870607, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9500 Loss 4.8260 Accuracy 0.2247 small step: 0.0017 big step: 0.0068
tf.Tensor(4.779155, shape=(), dtype=float32) tf.Tensor(4.779136, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9550 Loss 4.8258 Accuracy 0.2247 small step: 0.0034 big step: 0.0137
tf.Tensor(4.789244, shape=(), dtype=float32) tf.Tensor(4.7892475, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9600 Loss 4.8256 Accuracy 0.2247 small step: 0.0017 big step: 0.0068
tf.Tensor(4.792694, shape=(), dtype=float32) tf.Tensor(4.792658, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9650 Loss 4.8254 Accuracy 0.2247 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7981935, shape=(), dtype=float32) tf.Tensor(4.798219, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9700 Loss 4.8254 Accuracy 0.2247 small step: 0.0017 big step: 0.0068
tf.Tensor(4.8079343, shape=(), dtype=float32) tf.Tensor(4.8079104, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9750 Loss 4.8252 Accuracy 0.2247 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7884626, shape=(), dtype=float32) tf.Tensor(4.7884593, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9800 Loss 4.8250 Accuracy 0.2248 small step: 0.0068 big step: 0.0273
tf.Tensor(4.783654, shape=(), dtype=float32) tf.Tensor(4.7836895, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9850 Loss 4.8247 Accuracy 0.2248 small step: 0.0034 big step: 0.0137
tf.Tensor(4.780162, shape=(), dtype=float32) tf.Tensor(4.780136, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 9900 Loss 4.8246 Accuracy 0.2248 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7932844, shape=(), dtype=float32) tf.Tensor(4.7934184, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 9950 Loss 4.8244 Accuracy 0.2248 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7911515, shape=(), dtype=float32) tf.Tensor(4.7910905, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10000 Loss 4.8242 Accuracy 0.2248 small step: 0.0068 big step: 0.0273
tf.Tensor(4.782796, shape=(), dtype=float32) tf.Tensor(4.782784, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10050 Loss 4.8240 Accuracy 0.2249 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7745953, shape=(), dtype=float32) tf.Tensor(4.774858, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10100 Loss 4.8237 Accuracy 0.2249 small step: 0.0068 big step: 0.0273
tf.Tensor(4.772514, shape=(), dtype=float32) tf.Tensor(4.772549, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10150 Loss 4.8235 Accuracy 0.2249 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7857566, shape=(), dtype=float32) tf.Tensor(4.785728, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10200 Loss 4.8233 Accuracy 0.2249 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7794285, shape=(), dtype=float32) tf.Tensor(4.7795024, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10250 Loss 4.8232 Accuracy 0.2249 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8049254, shape=(), dtype=float32) tf.Tensor(4.80491, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10300 Loss 4.8230 Accuracy 0.2249 small step: 0.0068 big step: 0.0273
tf.Tensor(4.778982, shape=(), dtype=float32) tf.Tensor(4.779074, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10350 Loss 4.8229 Accuracy 0.2249 small step: 0.0034 big step: 0.0137
tf.Tensor(4.800226, shape=(), dtype=float32) tf.Tensor(4.8002143, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10400 Loss 4.8227 Accuracy 0.2250 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7835064, shape=(), dtype=float32) tf.Tensor(4.783565, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10450 Loss 4.8226 Accuracy 0.2250 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7922072, shape=(), dtype=float32) tf.Tensor(4.792205, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10500 Loss 4.8224 Accuracy 0.2250 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7940254, shape=(), dtype=float32) tf.Tensor(4.7940555, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10550 Loss 4.8222 Accuracy 0.2250 small step: 0.0034 big step: 0.0137
tf.Tensor(4.784931, shape=(), dtype=float32) tf.Tensor(4.784853, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10600 Loss 4.8221 Accuracy 0.2250 small step: 0.0068 big step: 0.0273
tf.Tensor(4.791655, shape=(), dtype=float32) tf.Tensor(4.791685, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10650 Loss 4.8219 Accuracy 0.2250 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7858143, shape=(), dtype=float32) tf.Tensor(4.785776, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10700 Loss 4.8217 Accuracy 0.2250 small step: 0.0068 big step: 0.0273
tf.Tensor(4.78041, shape=(), dtype=float32) tf.Tensor(4.7804213, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10750 Loss 4.8215 Accuracy 0.2250 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7804127, shape=(), dtype=float32) tf.Tensor(4.7803984, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10800 Loss 4.8214 Accuracy 0.2251 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7921586, shape=(), dtype=float32) tf.Tensor(4.792185, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10850 Loss 4.8213 Accuracy 0.2251 small step: 0.0034 big step: 0.0137
tf.Tensor(4.8020954, shape=(), dtype=float32) tf.Tensor(4.802056, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 10900 Loss 4.8211 Accuracy 0.2251 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7845407, shape=(), dtype=float32) tf.Tensor(4.7845592, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 10950 Loss 4.8210 Accuracy 0.2251 small step: 0.0034 big step: 0.0137
tf.Tensor(4.779216, shape=(), dtype=float32) tf.Tensor(4.7791376, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11000 Loss 4.8208 Accuracy 0.2251 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7874184, shape=(), dtype=float32) tf.Tensor(4.7874265, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11050 Loss 4.8206 Accuracy 0.2251 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7801247, shape=(), dtype=float32) tf.Tensor(4.78008, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11100 Loss 4.8205 Accuracy 0.2251 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7940693, shape=(), dtype=float32) tf.Tensor(4.794086, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11150 Loss 4.8203 Accuracy 0.2251 small step: 0.0034 big step: 0.0137
tf.Tensor(4.783692, shape=(), dtype=float32) tf.Tensor(4.783606, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11200 Loss 4.8202 Accuracy 0.2251 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7931576, shape=(), dtype=float32) tf.Tensor(4.7931385, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11250 Loss 4.8200 Accuracy 0.2252 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7727427, shape=(), dtype=float32) tf.Tensor(4.7728434, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11300 Loss 4.8198 Accuracy 0.2252 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7817736, shape=(), dtype=float32) tf.Tensor(4.7817726, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11350 Loss 4.8196 Accuracy 0.2252 small step: 0.0137 big step: 0.0547
tf.Tensor(4.77739, shape=(), dtype=float32) tf.Tensor(4.7775764, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11400 Loss 4.8195 Accuracy 0.2252 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7834206, shape=(), dtype=float32) tf.Tensor(4.783446, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11450 Loss 4.8193 Accuracy 0.2252 small step: 0.0034 big step: 0.0137
tf.Tensor(4.772201, shape=(), dtype=float32) tf.Tensor(4.772203, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11500 Loss 4.8192 Accuracy 0.2252 small step: 0.0017 big step: 0.0068
tf.Tensor(4.792224, shape=(), dtype=float32) tf.Tensor(4.7922072, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11550 Loss 4.8190 Accuracy 0.2253 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7745976, shape=(), dtype=float32) tf.Tensor(4.774543, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11600 Loss 4.8188 Accuracy 0.2253 small step: 0.0068 big step: 0.0273
tf.Tensor(4.77632, shape=(), dtype=float32) tf.Tensor(4.7763352, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11650 Loss 4.8186 Accuracy 0.2253 small step: 0.0034 big step: 0.0137
tf.Tensor(4.772041, shape=(), dtype=float32) tf.Tensor(4.7720613, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11700 Loss 4.8184 Accuracy 0.2253 small step: 0.0017 big step: 0.0068
tf.Tensor(4.772247, shape=(), dtype=float32) tf.Tensor(4.772221, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11750 Loss 4.8182 Accuracy 0.2253 small step: 0.0034 big step: 0.0137
tf.Tensor(4.782817, shape=(), dtype=float32) tf.Tensor(4.782766, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11800 Loss 4.8182 Accuracy 0.2253 small step: 0.0068 big step: 0.0273
tf.Tensor(4.800817, shape=(), dtype=float32) tf.Tensor(4.8008585, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11850 Loss 4.8180 Accuracy 0.2253 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7829204, shape=(), dtype=float32) tf.Tensor(4.782919, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 11900 Loss 4.8179 Accuracy 0.2253 small step: 0.0068 big step: 0.0273
tf.Tensor(4.783202, shape=(), dtype=float32) tf.Tensor(4.7832904, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 11950 Loss 4.8177 Accuracy 0.2254 small step: 0.0034 big step: 0.0137
tf.Tensor(4.774165, shape=(), dtype=float32) tf.Tensor(4.7741203, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12000 Loss 4.8175 Accuracy 0.2254 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7830286, shape=(), dtype=float32) tf.Tensor(4.783037, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12050 Loss 4.8174 Accuracy 0.2254 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7802553, shape=(), dtype=float32) tf.Tensor(4.7802515, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12100 Loss 4.8173 Accuracy 0.2254 small step: 0.0068 big step: 0.0273
tf.Tensor(4.792287, shape=(), dtype=float32) tf.Tensor(4.7923293, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12150 Loss 4.8171 Accuracy 0.2254 small step: 0.0034 big step: 0.0137
tf.Tensor(4.76738, shape=(), dtype=float32) tf.Tensor(4.7673664, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12200 Loss 4.8169 Accuracy 0.2254 small step: 0.0068 big step: 0.0273
tf.Tensor(4.78377, shape=(), dtype=float32) tf.Tensor(4.7837954, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12250 Loss 4.8168 Accuracy 0.2254 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7773476, shape=(), dtype=float32) tf.Tensor(4.7773385, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12300 Loss 4.8167 Accuracy 0.2254 small step: 0.0068 big step: 0.0273
tf.Tensor(4.786998, shape=(), dtype=float32) tf.Tensor(4.787019, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12350 Loss 4.8165 Accuracy 0.2255 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7832727, shape=(), dtype=float32) tf.Tensor(4.7832847, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12400 Loss 4.8163 Accuracy 0.2255 small step: 0.0017 big step: 0.0068
tf.Tensor(4.762286, shape=(), dtype=float32) tf.Tensor(4.7622657, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12450 Loss 4.8162 Accuracy 0.2255 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7794204, shape=(), dtype=float32) tf.Tensor(4.7794447, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12500 Loss 4.8160 Accuracy 0.2255 small step: 0.0017 big step: 0.0068
tf.Tensor(4.776667, shape=(), dtype=float32) tf.Tensor(4.7766323, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12550 Loss 4.8158 Accuracy 0.2255 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7685213, shape=(), dtype=float32) tf.Tensor(4.768518, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12600 Loss 4.8157 Accuracy 0.2255 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7925243, shape=(), dtype=float32) tf.Tensor(4.7926235, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12650 Loss 4.8156 Accuracy 0.2255 small step: 0.0034 big step: 0.0137
tf.Tensor(4.785679, shape=(), dtype=float32) tf.Tensor(4.7856846, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12700 Loss 4.8155 Accuracy 0.2255 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7890115, shape=(), dtype=float32) tf.Tensor(4.7890034, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12750 Loss 4.8153 Accuracy 0.2256 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7754035, shape=(), dtype=float32) tf.Tensor(4.775398, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12800 Loss 4.8151 Accuracy 0.2256 small step: 0.0068 big step: 0.0273
tf.Tensor(4.7600803, shape=(), dtype=float32) tf.Tensor(4.76012, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12850 Loss 4.8150 Accuracy 0.2256 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7943873, shape=(), dtype=float32) tf.Tensor(4.7943964, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 12900 Loss 4.8148 Accuracy 0.2256 small step: 0.0017 big step: 0.0068
tf.Tensor(4.756615, shape=(), dtype=float32) tf.Tensor(4.7566075, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 12950 Loss 4.8147 Accuracy 0.2256 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7735033, shape=(), dtype=float32) tf.Tensor(4.7735395, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 13000 Loss 4.8144 Accuracy 0.2256 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7512813, shape=(), dtype=float32) tf.Tensor(4.7512465, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 13050 Loss 4.8143 Accuracy 0.2256 small step: 0.0034 big step: 0.0137
tf.Tensor(4.7854404, shape=(), dtype=float32) tf.Tensor(4.7854543, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 13100 Loss 4.8142 Accuracy 0.2257 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7829666, shape=(), dtype=float32) tf.Tensor(4.7829666, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 13150 Loss 4.8141 Accuracy 0.2257 small step: 0.0009 big step: 0.0034
tf.Tensor(4.779581, shape=(), dtype=float32) tf.Tensor(4.779559, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 13200 Loss 4.8139 Accuracy 0.2257 small step: 0.0017 big step: 0.0068
tf.Tensor(4.7849245, shape=(), dtype=float32) tf.Tensor(4.7849097, shape=(), dtype=float32)
setting to big step
Epoch 2 Batch 13250 Loss 4.8138 Accuracy 0.2257 small step: 0.0034 big step: 0.0137
tf.Tensor(4.783033, shape=(), dtype=float32) tf.Tensor(4.7830443, shape=(), dtype=float32)
setting to small step
Epoch 2 Batch 13300 Loss 4.8137 Accuracy 0.2257 small step: 0.0017 big step: 0.0068
tf.Tensor(4.77484, shape=(), dtype=float32) tf.Tensor(4.774814, shape=(), dtype=float32)
setting to big step
Epoch 2 Loss 4.81355047 Accuracy 0.2257, small step: 0.0034 big step: 0.0137
Reseting lr
0.00035 0.0014
small step: 3.5000 big step: 14.0000
Epoch 3 Batch 50 Loss 5.8681 Accuracy 0.1348 small step: 3.5000 big step: 14.0000
tf.Tensor(4.8348694, shape=(), dtype=float32) tf.Tensor(6.9012976, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 100 Loss 5.3712 Accuracy 0.1750 small step: 1.7500 big step: 7.0000
tf.Tensor(4.8032055, shape=(), dtype=float32) tf.Tensor(4.925502, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 150 Loss 5.1712 Accuracy 0.1919 small step: 0.8750 big step: 3.5000
tf.Tensor(4.749317, shape=(), dtype=float32) tf.Tensor(4.785304, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 200 Loss 5.0636 Accuracy 0.2015 small step: 0.4375 big step: 1.7500
tf.Tensor(4.731726, shape=(), dtype=float32) tf.Tensor(4.745377, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 250 Loss 4.9993 Accuracy 0.2074 small step: 0.2187 big step: 0.8750
tf.Tensor(4.7381477, shape=(), dtype=float32) tf.Tensor(4.743386, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 300 Loss 4.9547 Accuracy 0.2112 small step: 0.1094 big step: 0.4375
tf.Tensor(4.729667, shape=(), dtype=float32) tf.Tensor(4.7318034, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 350 Loss 4.9196 Accuracy 0.2144 small step: 0.0547 big step: 0.2187
tf.Tensor(4.70787, shape=(), dtype=float32) tf.Tensor(4.708704, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 400 Loss 4.8924 Accuracy 0.2170 small step: 0.0273 big step: 0.1094
tf.Tensor(4.701617, shape=(), dtype=float32) tf.Tensor(4.7014613, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 450 Loss 4.8707 Accuracy 0.2190 small step: 0.0547 big step: 0.2187
tf.Tensor(4.6964107, shape=(), dtype=float32) tf.Tensor(4.697193, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 500 Loss 4.8533 Accuracy 0.2206 small step: 0.0273 big step: 0.1094
tf.Tensor(4.6966643, shape=(), dtype=float32) tf.Tensor(4.6966815, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 550 Loss 4.8391 Accuracy 0.2218 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6960826, shape=(), dtype=float32) tf.Tensor(4.6960053, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 600 Loss 4.8284 Accuracy 0.2227 small step: 0.0273 big step: 0.1094
tf.Tensor(4.71076, shape=(), dtype=float32) tf.Tensor(4.7109685, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 650 Loss 4.8189 Accuracy 0.2236 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7043552, shape=(), dtype=float32) tf.Tensor(4.7043147, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 700 Loss 4.8105 Accuracy 0.2244 small step: 0.0273 big step: 0.1094
tf.Tensor(4.701142, shape=(), dtype=float32) tf.Tensor(4.7013307, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 750 Loss 4.8029 Accuracy 0.2251 small step: 0.0137 big step: 0.0547
tf.Tensor(4.696851, shape=(), dtype=float32) tf.Tensor(4.696727, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 800 Loss 4.7955 Accuracy 0.2258 small step: 0.0273 big step: 0.1094
tf.Tensor(4.683865, shape=(), dtype=float32) tf.Tensor(4.684219, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 850 Loss 4.7898 Accuracy 0.2263 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6986637, shape=(), dtype=float32) tf.Tensor(4.6984434, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 900 Loss 4.7837 Accuracy 0.2268 small step: 0.0273 big step: 0.1094
tf.Tensor(4.6792874, shape=(), dtype=float32) tf.Tensor(4.679394, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 950 Loss 4.7781 Accuracy 0.2273 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6787076, shape=(), dtype=float32) tf.Tensor(4.6786394, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1000 Loss 4.7750 Accuracy 0.2276 small step: 0.0273 big step: 0.1094
tf.Tensor(4.715207, shape=(), dtype=float32) tf.Tensor(4.715579, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1050 Loss 4.7717 Accuracy 0.2278 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7051964, shape=(), dtype=float32) tf.Tensor(4.7052827, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1100 Loss 4.7677 Accuracy 0.2282 small step: 0.0068 big step: 0.0273
tf.Tensor(4.684511, shape=(), dtype=float32) tf.Tensor(4.6843767, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1150 Loss 4.7652 Accuracy 0.2285 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7089677, shape=(), dtype=float32) tf.Tensor(4.708998, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1200 Loss 4.7617 Accuracy 0.2288 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6808314, shape=(), dtype=float32) tf.Tensor(4.6807604, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1250 Loss 4.7593 Accuracy 0.2291 small step: 0.0137 big step: 0.0547
tf.Tensor(4.702438, shape=(), dtype=float32) tf.Tensor(4.702417, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1300 Loss 4.7563 Accuracy 0.2293 small step: 0.0273 big step: 0.1094
tf.Tensor(4.6807923, shape=(), dtype=float32) tf.Tensor(4.6811476, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1350 Loss 4.7547 Accuracy 0.2295 small step: 0.0137 big step: 0.0547
tf.Tensor(4.713797, shape=(), dtype=float32) tf.Tensor(4.7138634, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1400 Loss 4.7524 Accuracy 0.2297 small step: 0.0068 big step: 0.0273
tf.Tensor(4.688714, shape=(), dtype=float32) tf.Tensor(4.6886387, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1450 Loss 4.7506 Accuracy 0.2298 small step: 0.0137 big step: 0.0547
tf.Tensor(4.700779, shape=(), dtype=float32) tf.Tensor(4.7008195, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1500 Loss 4.7486 Accuracy 0.2300 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6919456, shape=(), dtype=float32) tf.Tensor(4.6918263, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1550 Loss 4.7464 Accuracy 0.2302 small step: 0.0137 big step: 0.0547
tf.Tensor(4.680427, shape=(), dtype=float32) tf.Tensor(4.6805315, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1600 Loss 4.7445 Accuracy 0.2304 small step: 0.0068 big step: 0.0273
tf.Tensor(4.686231, shape=(), dtype=float32) tf.Tensor(4.686158, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1650 Loss 4.7427 Accuracy 0.2306 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6824017, shape=(), dtype=float32) tf.Tensor(4.682392, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1700 Loss 4.7411 Accuracy 0.2308 small step: 0.0273 big step: 0.1094
tf.Tensor(4.6892424, shape=(), dtype=float32) tf.Tensor(4.689738, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1750 Loss 4.7393 Accuracy 0.2310 small step: 0.0137 big step: 0.0547
tf.Tensor(4.679371, shape=(), dtype=float32) tf.Tensor(4.6794233, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1800 Loss 4.7384 Accuracy 0.2310 small step: 0.0068 big step: 0.0273
tf.Tensor(4.704617, shape=(), dtype=float32) tf.Tensor(4.7045226, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1850 Loss 4.7369 Accuracy 0.2312 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6846027, shape=(), dtype=float32) tf.Tensor(4.684601, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 1900 Loss 4.7356 Accuracy 0.2313 small step: 0.0273 big step: 0.1094
tf.Tensor(4.6867695, shape=(), dtype=float32) tf.Tensor(4.687647, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 1950 Loss 4.7341 Accuracy 0.2314 small step: 0.0137 big step: 0.0547
tf.Tensor(4.675682, shape=(), dtype=float32) tf.Tensor(4.675714, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2000 Loss 4.7327 Accuracy 0.2315 small step: 0.0068 big step: 0.0273
tf.Tensor(4.678682, shape=(), dtype=float32) tf.Tensor(4.678723, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2050 Loss 4.7316 Accuracy 0.2316 small step: 0.0034 big step: 0.0137
tf.Tensor(4.686874, shape=(), dtype=float32) tf.Tensor(4.686818, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2100 Loss 4.7305 Accuracy 0.2317 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6860847, shape=(), dtype=float32) tf.Tensor(4.686042, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2150 Loss 4.7294 Accuracy 0.2318 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6838713, shape=(), dtype=float32) tf.Tensor(4.684001, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2200 Loss 4.7283 Accuracy 0.2319 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6812124, shape=(), dtype=float32) tf.Tensor(4.681224, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2250 Loss 4.7269 Accuracy 0.2321 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6643834, shape=(), dtype=float32) tf.Tensor(4.6643305, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2300 Loss 4.7258 Accuracy 0.2321 small step: 0.0068 big step: 0.0273
tf.Tensor(4.677668, shape=(), dtype=float32) tf.Tensor(4.6776724, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2350 Loss 4.7246 Accuracy 0.2323 small step: 0.0034 big step: 0.0137
tf.Tensor(4.667724, shape=(), dtype=float32) tf.Tensor(4.667709, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2400 Loss 4.7234 Accuracy 0.2324 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6698027, shape=(), dtype=float32) tf.Tensor(4.6698318, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2450 Loss 4.7226 Accuracy 0.2325 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6808047, shape=(), dtype=float32) tf.Tensor(4.6807356, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2500 Loss 4.7218 Accuracy 0.2325 small step: 0.0068 big step: 0.0273
tf.Tensor(4.682475, shape=(), dtype=float32) tf.Tensor(4.6824193, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2550 Loss 4.7210 Accuracy 0.2326 small step: 0.0137 big step: 0.0547
tf.Tensor(4.683266, shape=(), dtype=float32) tf.Tensor(4.6834173, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2600 Loss 4.7200 Accuracy 0.2326 small step: 0.0068 big step: 0.0273
tf.Tensor(4.670649, shape=(), dtype=float32) tf.Tensor(4.670621, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2650 Loss 4.7197 Accuracy 0.2326 small step: 0.0137 big step: 0.0547
tf.Tensor(4.7039723, shape=(), dtype=float32) tf.Tensor(4.7041836, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2700 Loss 4.7191 Accuracy 0.2327 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6858845, shape=(), dtype=float32) tf.Tensor(4.6858826, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2750 Loss 4.7188 Accuracy 0.2327 small step: 0.0137 big step: 0.0547
tf.Tensor(4.702974, shape=(), dtype=float32) tf.Tensor(4.7031074, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2800 Loss 4.7183 Accuracy 0.2328 small step: 0.0068 big step: 0.0273
tf.Tensor(4.689946, shape=(), dtype=float32) tf.Tensor(4.6899276, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2850 Loss 4.7176 Accuracy 0.2328 small step: 0.0137 big step: 0.0547
tf.Tensor(4.678581, shape=(), dtype=float32) tf.Tensor(4.678588, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 2900 Loss 4.7168 Accuracy 0.2329 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6682663, shape=(), dtype=float32) tf.Tensor(4.6682334, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 2950 Loss 4.7163 Accuracy 0.2329 small step: 0.0137 big step: 0.0547
tf.Tensor(4.68997, shape=(), dtype=float32) tf.Tensor(4.6900444, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3000 Loss 4.7155 Accuracy 0.2330 small step: 0.0068 big step: 0.0273
tf.Tensor(4.670138, shape=(), dtype=float32) tf.Tensor(4.670071, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3050 Loss 4.7148 Accuracy 0.2331 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6685777, shape=(), dtype=float32) tf.Tensor(4.6686883, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3100 Loss 4.7137 Accuracy 0.2332 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6491103, shape=(), dtype=float32) tf.Tensor(4.649127, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3150 Loss 4.7129 Accuracy 0.2333 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6641917, shape=(), dtype=float32) tf.Tensor(4.6641707, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3200 Loss 4.7124 Accuracy 0.2333 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6809645, shape=(), dtype=float32) tf.Tensor(4.68093, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3250 Loss 4.7119 Accuracy 0.2334 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6762733, shape=(), dtype=float32) tf.Tensor(4.6764064, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3300 Loss 4.7114 Accuracy 0.2334 small step: 0.0068 big step: 0.0273
tf.Tensor(4.677654, shape=(), dtype=float32) tf.Tensor(4.6777, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3350 Loss 4.7110 Accuracy 0.2334 small step: 0.0034 big step: 0.0137
tf.Tensor(4.688243, shape=(), dtype=float32) tf.Tensor(4.688267, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3400 Loss 4.7104 Accuracy 0.2335 small step: 0.0017 big step: 0.0068
tf.Tensor(4.6672397, shape=(), dtype=float32) tf.Tensor(4.667188, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3450 Loss 4.7100 Accuracy 0.2335 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6854563, shape=(), dtype=float32) tf.Tensor(4.6854343, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3500 Loss 4.7092 Accuracy 0.2336 small step: 0.0068 big step: 0.0273
tf.Tensor(4.650397, shape=(), dtype=float32) tf.Tensor(4.650412, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3550 Loss 4.7087 Accuracy 0.2337 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6755605, shape=(), dtype=float32) tf.Tensor(4.675567, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3600 Loss 4.7082 Accuracy 0.2337 small step: 0.0017 big step: 0.0068
tf.Tensor(4.6763334, shape=(), dtype=float32) tf.Tensor(4.67631, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3650 Loss 4.7079 Accuracy 0.2338 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6827025, shape=(), dtype=float32) tf.Tensor(4.6826468, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3700 Loss 4.7074 Accuracy 0.2338 small step: 0.0068 big step: 0.0273
tf.Tensor(4.674656, shape=(), dtype=float32) tf.Tensor(4.674685, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3750 Loss 4.7069 Accuracy 0.2339 small step: 0.0034 big step: 0.0137
tf.Tensor(4.666444, shape=(), dtype=float32) tf.Tensor(4.666426, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3800 Loss 4.7063 Accuracy 0.2339 small step: 0.0068 big step: 0.0273
tf.Tensor(4.66142, shape=(), dtype=float32) tf.Tensor(4.6614857, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3850 Loss 4.7060 Accuracy 0.2339 small step: 0.0034 big step: 0.0137
tf.Tensor(4.686152, shape=(), dtype=float32) tf.Tensor(4.6861057, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 3900 Loss 4.7058 Accuracy 0.2339 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6876297, shape=(), dtype=float32) tf.Tensor(4.687687, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 3950 Loss 4.7056 Accuracy 0.2339 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6892934, shape=(), dtype=float32) tf.Tensor(4.6892676, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4000 Loss 4.7053 Accuracy 0.2340 small step: 0.0068 big step: 0.0273
tf.Tensor(4.683277, shape=(), dtype=float32) tf.Tensor(4.6832604, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4050 Loss 4.7049 Accuracy 0.2340 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6688495, shape=(), dtype=float32) tf.Tensor(4.669089, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4100 Loss 4.7045 Accuracy 0.2340 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6734138, shape=(), dtype=float32) tf.Tensor(4.673445, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4150 Loss 4.7041 Accuracy 0.2341 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6739693, shape=(), dtype=float32) tf.Tensor(4.6739664, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4200 Loss 4.7037 Accuracy 0.2341 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6690264, shape=(), dtype=float32) tf.Tensor(4.6690536, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4250 Loss 4.7033 Accuracy 0.2341 small step: 0.0034 big step: 0.0137
tf.Tensor(4.669245, shape=(), dtype=float32) tf.Tensor(4.6691556, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4300 Loss 4.7030 Accuracy 0.2342 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6787395, shape=(), dtype=float32) tf.Tensor(4.678798, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4350 Loss 4.7026 Accuracy 0.2342 small step: 0.0034 big step: 0.0137
tf.Tensor(4.669219, shape=(), dtype=float32) tf.Tensor(4.669215, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4400 Loss 4.7021 Accuracy 0.2342 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6587834, shape=(), dtype=float32) tf.Tensor(4.6587844, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4450 Loss 4.7020 Accuracy 0.2343 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6888514, shape=(), dtype=float32) tf.Tensor(4.6888175, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4500 Loss 4.7018 Accuracy 0.2343 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6827703, shape=(), dtype=float32) tf.Tensor(4.68289, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4550 Loss 4.7014 Accuracy 0.2343 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6672564, shape=(), dtype=float32) tf.Tensor(4.667214, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4600 Loss 4.7010 Accuracy 0.2343 small step: 0.0068 big step: 0.0273
tf.Tensor(4.664488, shape=(), dtype=float32) tf.Tensor(4.6645074, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4650 Loss 4.7004 Accuracy 0.2344 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6460204, shape=(), dtype=float32) tf.Tensor(4.6460094, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4700 Loss 4.7001 Accuracy 0.2344 small step: 0.0068 big step: 0.0273
tf.Tensor(4.671319, shape=(), dtype=float32) tf.Tensor(4.6713424, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4750 Loss 4.6996 Accuracy 0.2345 small step: 0.0034 big step: 0.0137
tf.Tensor(4.657789, shape=(), dtype=float32) tf.Tensor(4.657761, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4800 Loss 4.6992 Accuracy 0.2345 small step: 0.0068 big step: 0.0273
tf.Tensor(4.656815, shape=(), dtype=float32) tf.Tensor(4.65688, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4850 Loss 4.6990 Accuracy 0.2345 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6830287, shape=(), dtype=float32) tf.Tensor(4.68301, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 4900 Loss 4.6988 Accuracy 0.2346 small step: 0.0068 big step: 0.0273
tf.Tensor(4.67508, shape=(), dtype=float32) tf.Tensor(4.6751013, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 4950 Loss 4.6984 Accuracy 0.2346 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6636314, shape=(), dtype=float32) tf.Tensor(4.6635747, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5000 Loss 4.6981 Accuracy 0.2346 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6633787, shape=(), dtype=float32) tf.Tensor(4.663421, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5050 Loss 4.6976 Accuracy 0.2347 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6498737, shape=(), dtype=float32) tf.Tensor(4.6498647, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5100 Loss 4.6973 Accuracy 0.2347 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6710014, shape=(), dtype=float32) tf.Tensor(4.6710777, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5150 Loss 4.6970 Accuracy 0.2347 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6633544, shape=(), dtype=float32) tf.Tensor(4.663354, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5200 Loss 4.6968 Accuracy 0.2348 small step: 0.0068 big step: 0.0273
tf.Tensor(4.671032, shape=(), dtype=float32) tf.Tensor(4.6710644, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5250 Loss 4.6965 Accuracy 0.2348 small step: 0.0034 big step: 0.0137
tf.Tensor(4.666189, shape=(), dtype=float32) tf.Tensor(4.6661315, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5300 Loss 4.6962 Accuracy 0.2348 small step: 0.0068 big step: 0.0273
tf.Tensor(4.664159, shape=(), dtype=float32) tf.Tensor(4.6641874, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5350 Loss 4.6959 Accuracy 0.2348 small step: 0.0034 big step: 0.0137
tf.Tensor(4.672381, shape=(), dtype=float32) tf.Tensor(4.6722975, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5400 Loss 4.6957 Accuracy 0.2348 small step: 0.0068 big step: 0.0273
tf.Tensor(4.670421, shape=(), dtype=float32) tf.Tensor(4.6704917, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5450 Loss 4.6956 Accuracy 0.2348 small step: 0.0034 big step: 0.0137
tf.Tensor(4.681604, shape=(), dtype=float32) tf.Tensor(4.6815653, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5500 Loss 4.6952 Accuracy 0.2349 small step: 0.0068 big step: 0.0273
tf.Tensor(4.658725, shape=(), dtype=float32) tf.Tensor(4.658716, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5550 Loss 4.6950 Accuracy 0.2349 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6631093, shape=(), dtype=float32) tf.Tensor(4.663274, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5600 Loss 4.6947 Accuracy 0.2349 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6692486, shape=(), dtype=float32) tf.Tensor(4.669257, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5650 Loss 4.6944 Accuracy 0.2350 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6603127, shape=(), dtype=float32) tf.Tensor(4.660259, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5700 Loss 4.6942 Accuracy 0.2350 small step: 0.0068 big step: 0.0273
tf.Tensor(4.675012, shape=(), dtype=float32) tf.Tensor(4.6749887, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5750 Loss 4.6939 Accuracy 0.2350 small step: 0.0137 big step: 0.0547
tf.Tensor(4.651052, shape=(), dtype=float32) tf.Tensor(4.6511703, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5800 Loss 4.6936 Accuracy 0.2350 small step: 0.0068 big step: 0.0273
tf.Tensor(4.665543, shape=(), dtype=float32) tf.Tensor(4.6656337, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5850 Loss 4.6934 Accuracy 0.2351 small step: 0.0034 big step: 0.0137
tf.Tensor(4.663502, shape=(), dtype=float32) tf.Tensor(4.6634865, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 5900 Loss 4.6931 Accuracy 0.2351 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6638484, shape=(), dtype=float32) tf.Tensor(4.663893, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 5950 Loss 4.6929 Accuracy 0.2351 small step: 0.0034 big step: 0.0137
tf.Tensor(4.66194, shape=(), dtype=float32) tf.Tensor(4.66193, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6000 Loss 4.6925 Accuracy 0.2351 small step: 0.0068 big step: 0.0273
tf.Tensor(4.647204, shape=(), dtype=float32) tf.Tensor(4.6473026, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6050 Loss 4.6923 Accuracy 0.2351 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6711946, shape=(), dtype=float32) tf.Tensor(4.671138, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6100 Loss 4.6920 Accuracy 0.2352 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6515737, shape=(), dtype=float32) tf.Tensor(4.65163, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6150 Loss 4.6918 Accuracy 0.2352 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6669908, shape=(), dtype=float32) tf.Tensor(4.666965, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6200 Loss 4.6916 Accuracy 0.2352 small step: 0.0068 big step: 0.0273
tf.Tensor(4.675008, shape=(), dtype=float32) tf.Tensor(4.6750875, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6250 Loss 4.6916 Accuracy 0.2352 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6833725, shape=(), dtype=float32) tf.Tensor(4.6833434, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6300 Loss 4.6913 Accuracy 0.2353 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6547184, shape=(), dtype=float32) tf.Tensor(4.6547427, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6350 Loss 4.6912 Accuracy 0.2353 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6790547, shape=(), dtype=float32) tf.Tensor(4.6790285, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6400 Loss 4.6910 Accuracy 0.2353 small step: 0.0068 big step: 0.0273
tf.Tensor(4.662042, shape=(), dtype=float32) tf.Tensor(4.6620803, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6450 Loss 4.6907 Accuracy 0.2353 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6638427, shape=(), dtype=float32) tf.Tensor(4.663782, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6500 Loss 4.6904 Accuracy 0.2354 small step: 0.0068 big step: 0.0273
tf.Tensor(4.650055, shape=(), dtype=float32) tf.Tensor(4.6499968, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6550 Loss 4.6903 Accuracy 0.2354 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6787567, shape=(), dtype=float32) tf.Tensor(4.6789856, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6600 Loss 4.6901 Accuracy 0.2354 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6592736, shape=(), dtype=float32) tf.Tensor(4.6592393, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6650 Loss 4.6899 Accuracy 0.2354 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6630487, shape=(), dtype=float32) tf.Tensor(4.6631927, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6700 Loss 4.6897 Accuracy 0.2354 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6601295, shape=(), dtype=float32) tf.Tensor(4.6600866, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6750 Loss 4.6895 Accuracy 0.2354 small step: 0.0137 big step: 0.0547
tf.Tensor(4.670907, shape=(), dtype=float32) tf.Tensor(4.671115, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6800 Loss 4.6895 Accuracy 0.2354 small step: 0.0068 big step: 0.0273
tf.Tensor(4.678942, shape=(), dtype=float32) tf.Tensor(4.679035, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6850 Loss 4.6891 Accuracy 0.2355 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6430006, shape=(), dtype=float32) tf.Tensor(4.6429667, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 6900 Loss 4.6891 Accuracy 0.2355 small step: 0.0068 big step: 0.0273
tf.Tensor(4.678743, shape=(), dtype=float32) tf.Tensor(4.6787925, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 6950 Loss 4.6887 Accuracy 0.2355 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6456337, shape=(), dtype=float32) tf.Tensor(4.645602, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7000 Loss 4.6883 Accuracy 0.2356 small step: 0.0068 big step: 0.0273
tf.Tensor(4.631684, shape=(), dtype=float32) tf.Tensor(4.631721, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7050 Loss 4.6882 Accuracy 0.2356 small step: 0.0034 big step: 0.0137
tf.Tensor(4.670744, shape=(), dtype=float32) tf.Tensor(4.6707387, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7100 Loss 4.6881 Accuracy 0.2356 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6688523, shape=(), dtype=float32) tf.Tensor(4.6687965, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7150 Loss 4.6880 Accuracy 0.2356 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6785207, shape=(), dtype=float32) tf.Tensor(4.6787987, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7200 Loss 4.6879 Accuracy 0.2356 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6768904, shape=(), dtype=float32) tf.Tensor(4.6768475, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7250 Loss 4.6877 Accuracy 0.2356 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6521015, shape=(), dtype=float32) tf.Tensor(4.652296, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7300 Loss 4.6875 Accuracy 0.2356 small step: 0.0068 big step: 0.0273
tf.Tensor(4.655975, shape=(), dtype=float32) tf.Tensor(4.6559496, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7350 Loss 4.6872 Accuracy 0.2356 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6500754, shape=(), dtype=float32) tf.Tensor(4.650232, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7400 Loss 4.6869 Accuracy 0.2357 small step: 0.0068 big step: 0.0273
tf.Tensor(4.647707, shape=(), dtype=float32) tf.Tensor(4.6477385, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7450 Loss 4.6869 Accuracy 0.2357 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6847315, shape=(), dtype=float32) tf.Tensor(4.6847477, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7500 Loss 4.6867 Accuracy 0.2357 small step: 0.0017 big step: 0.0068
tf.Tensor(4.648911, shape=(), dtype=float32) tf.Tensor(4.648884, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7550 Loss 4.6865 Accuracy 0.2357 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6596975, shape=(), dtype=float32) tf.Tensor(4.6596794, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7600 Loss 4.6862 Accuracy 0.2357 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6409435, shape=(), dtype=float32) tf.Tensor(4.640954, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7650 Loss 4.6858 Accuracy 0.2358 small step: 0.0034 big step: 0.0137
tf.Tensor(4.631267, shape=(), dtype=float32) tf.Tensor(4.6312556, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7700 Loss 4.6857 Accuracy 0.2358 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6582747, shape=(), dtype=float32) tf.Tensor(4.658231, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7750 Loss 4.6854 Accuracy 0.2358 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6495123, shape=(), dtype=float32) tf.Tensor(4.6496825, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7800 Loss 4.6852 Accuracy 0.2358 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6576366, shape=(), dtype=float32) tf.Tensor(4.6576157, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 7850 Loss 4.6850 Accuracy 0.2358 small step: 0.0137 big step: 0.0547
tf.Tensor(4.646396, shape=(), dtype=float32) tf.Tensor(4.646636, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7900 Loss 4.6848 Accuracy 0.2359 small step: 0.0068 big step: 0.0273
tf.Tensor(4.650385, shape=(), dtype=float32) tf.Tensor(4.650428, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 7950 Loss 4.6846 Accuracy 0.2359 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6559615, shape=(), dtype=float32) tf.Tensor(4.6559706, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8000 Loss 4.6844 Accuracy 0.2359 small step: 0.0017 big step: 0.0068
tf.Tensor(4.6503468, shape=(), dtype=float32) tf.Tensor(4.6503124, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8050 Loss 4.6842 Accuracy 0.2359 small step: 0.0034 big step: 0.0137
tf.Tensor(4.660478, shape=(), dtype=float32) tf.Tensor(4.66044, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8100 Loss 4.6840 Accuracy 0.2359 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6425357, shape=(), dtype=float32) tf.Tensor(4.6424513, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8150 Loss 4.6836 Accuracy 0.2360 small step: 0.0137 big step: 0.0547
tf.Tensor(4.618731, shape=(), dtype=float32) tf.Tensor(4.6189594, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8200 Loss 4.6833 Accuracy 0.2360 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6439013, shape=(), dtype=float32) tf.Tensor(4.643888, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8250 Loss 4.6831 Accuracy 0.2360 small step: 0.0137 big step: 0.0547
tf.Tensor(4.640271, shape=(), dtype=float32) tf.Tensor(4.64036, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8300 Loss 4.6829 Accuracy 0.2360 small step: 0.0068 big step: 0.0273
tf.Tensor(4.660367, shape=(), dtype=float32) tf.Tensor(4.660324, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8350 Loss 4.6828 Accuracy 0.2360 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6646256, shape=(), dtype=float32) tf.Tensor(4.6647744, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8400 Loss 4.6827 Accuracy 0.2361 small step: 0.0068 big step: 0.0273
tf.Tensor(4.659499, shape=(), dtype=float32) tf.Tensor(4.6594877, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8450 Loss 4.6824 Accuracy 0.2361 small step: 0.0137 big step: 0.0547
tf.Tensor(4.64044, shape=(), dtype=float32) tf.Tensor(4.640527, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8500 Loss 4.6823 Accuracy 0.2361 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6556587, shape=(), dtype=float32) tf.Tensor(4.65569, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8550 Loss 4.6820 Accuracy 0.2361 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6392097, shape=(), dtype=float32) tf.Tensor(4.6391516, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8600 Loss 4.6817 Accuracy 0.2362 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6329036, shape=(), dtype=float32) tf.Tensor(4.632895, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8650 Loss 4.6815 Accuracy 0.2362 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6352787, shape=(), dtype=float32) tf.Tensor(4.635361, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8700 Loss 4.6813 Accuracy 0.2362 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6524487, shape=(), dtype=float32) tf.Tensor(4.6524153, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8750 Loss 4.6813 Accuracy 0.2362 small step: 0.0137 big step: 0.0547
tf.Tensor(4.680407, shape=(), dtype=float32) tf.Tensor(4.6805387, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8800 Loss 4.6811 Accuracy 0.2362 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6413436, shape=(), dtype=float32) tf.Tensor(4.641296, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 8850 Loss 4.6808 Accuracy 0.2363 small step: 0.0137 big step: 0.0547
tf.Tensor(4.63035, shape=(), dtype=float32) tf.Tensor(4.630548, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8900 Loss 4.6807 Accuracy 0.2363 small step: 0.0068 big step: 0.0273
tf.Tensor(4.660098, shape=(), dtype=float32) tf.Tensor(4.6601024, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 8950 Loss 4.6805 Accuracy 0.2363 small step: 0.0034 big step: 0.0137
tf.Tensor(4.645622, shape=(), dtype=float32) tf.Tensor(4.64566, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9000 Loss 4.6803 Accuracy 0.2363 small step: 0.0017 big step: 0.0068
tf.Tensor(4.646435, shape=(), dtype=float32) tf.Tensor(4.646414, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9050 Loss 4.6802 Accuracy 0.2363 small step: 0.0034 big step: 0.0137
tf.Tensor(4.666207, shape=(), dtype=float32) tf.Tensor(4.6661754, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9100 Loss 4.6800 Accuracy 0.2363 small step: 0.0068 big step: 0.0273
tf.Tensor(4.643627, shape=(), dtype=float32) tf.Tensor(4.643677, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9150 Loss 4.6800 Accuracy 0.2363 small step: 0.0034 big step: 0.0137
tf.Tensor(4.679369, shape=(), dtype=float32) tf.Tensor(4.679341, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9200 Loss 4.6798 Accuracy 0.2364 small step: 0.0068 big step: 0.0273
tf.Tensor(4.644063, shape=(), dtype=float32) tf.Tensor(4.644129, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9250 Loss 4.6796 Accuracy 0.2364 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6463, shape=(), dtype=float32) tf.Tensor(4.646268, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9300 Loss 4.6795 Accuracy 0.2364 small step: 0.0068 big step: 0.0273
tf.Tensor(4.6515474, shape=(), dtype=float32) tf.Tensor(4.6515093, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9350 Loss 4.6792 Accuracy 0.2364 small step: 0.0137 big step: 0.0547
tf.Tensor(4.634052, shape=(), dtype=float32) tf.Tensor(4.6342278, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9400 Loss 4.6791 Accuracy 0.2364 small step: 0.0068 big step: 0.0273
tf.Tensor(4.658512, shape=(), dtype=float32) tf.Tensor(4.6585217, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9450 Loss 4.6789 Accuracy 0.2364 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6408134, shape=(), dtype=float32) tf.Tensor(4.640816, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9500 Loss 4.6789 Accuracy 0.2364 small step: 0.0017 big step: 0.0068
tf.Tensor(4.6701035, shape=(), dtype=float32) tf.Tensor(4.670069, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9550 Loss 4.6787 Accuracy 0.2365 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6446056, shape=(), dtype=float32) tf.Tensor(4.644585, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9600 Loss 4.6785 Accuracy 0.2365 small step: 0.0068 big step: 0.0273
tf.Tensor(4.648972, shape=(), dtype=float32) tf.Tensor(4.6489725, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9650 Loss 4.6783 Accuracy 0.2365 small step: 0.0034 big step: 0.0137
tf.Tensor(4.6330585, shape=(), dtype=float32) tf.Tensor(4.633052, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9700 Loss 4.6782 Accuracy 0.2365 small step: 0.0068 big step: 0.0273
tf.Tensor(4.660383, shape=(), dtype=float32) tf.Tensor(4.6603703, shape=(), dtype=float32)
setting to big step
Epoch 3 Batch 9750 Loss 4.6780 Accuracy 0.2365 small step: 0.0137 big step: 0.0547
tf.Tensor(4.6364923, shape=(), dtype=float32) tf.Tensor(4.6366405, shape=(), dtype=float32)
setting to small step
Epoch 3 Batch 9800 Loss 4.6778 Accuracy 0.2365 small step: 0.0068 big step: 0.0273
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment