loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 332 1006 train Loss: 0.0996 Acc: 0.3300 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 92 236 test Loss: 0.0958 Acc: 0.3898 ('new best accuracy = ', 0.3898305084745763) Epoch 1/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 479 1006 train Loss: 0.0638 Acc: 0.4761 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 156 236 test Loss: 0.0334 Acc: 0.6610 ('new best accuracy = ', 0.6610169491525424) Epoch 2/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 587 1006 train Loss: 0.0218 Acc: 0.5835 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 171 236 test Loss: 0.0127 Acc: 0.7246 ('new best accuracy = ', 0.7245762711864406) Epoch 3/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 701 1006 train Loss: 0.0100 Acc: 0.6968 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 196 236 test Loss: 0.0074 Acc: 0.8305 ('new best accuracy = ', 0.8305084745762712) Epoch 4/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 799 1006 train Loss: 0.0061 Acc: 0.7942 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 215 236 test Loss: 0.0041 Acc: 0.9110 ('new best accuracy = ', 0.9110169491525424) Epoch 5/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 859 1006 train Loss: 0.0042 Acc: 0.8539 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 206 236 test Loss: 0.0041 Acc: 0.8729 Epoch 6/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 882 1006 train Loss: 0.0034 Acc: 0.8767 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 210 236 test Loss: 0.0034 Acc: 0.8898 Epoch 7/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 923 1006 train Loss: 0.0025 Acc: 0.9175 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 227 236 test Loss: 0.0025 Acc: 0.9619 ('new best accuracy = ', 0.961864406779661) Epoch 8/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 953 1006 train Loss: 0.0019 Acc: 0.9473 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 224 236 test Loss: 0.0016 Acc: 0.9492 Epoch 9/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 965 1006 train Loss: 0.0015 Acc: 0.9592 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 224 236 test Loss: 0.0018 Acc: 0.9492 Epoch 10/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 962 1006 train Loss: 0.0014 Acc: 0.9563 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0011 Acc: 0.9958 ('new best accuracy = ', 0.9957627118644068) Epoch 11/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 968 1006 train Loss: 0.0012 Acc: 0.9622 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 230 236 test Loss: 0.0012 Acc: 0.9746 Epoch 12/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 984 1006 train Loss: 0.0010 Acc: 0.9781 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 221 236 test Loss: 0.0021 Acc: 0.9364 Epoch 13/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 956 1006 train Loss: 0.0014 Acc: 0.9503 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 231 236 test Loss: 0.0011 Acc: 0.9788 Epoch 14/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 984 1006 train Loss: 0.0009 Acc: 0.9781 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0007 Acc: 0.9958 Epoch 15/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 996 1006 train Loss: 0.0006 Acc: 0.9901 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0006 Acc: 0.9958 Epoch 16/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 999 1006 train Loss: 0.0004 Acc: 0.9930 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0005 Acc: 0.9958 Epoch 17/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1000 1006 train Loss: 0.0004 Acc: 0.9940 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0005 Acc: 1.0000 ('new best accuracy = ', 1.0) Epoch 18/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 992 1006 train Loss: 0.0005 Acc: 0.9861 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0006 Acc: 0.9958 Epoch 19/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 997 1006 train Loss: 0.0004 Acc: 0.9911 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0004 Acc: 1.0000 Epoch 20/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 990 1006 train Loss: 0.0005 Acc: 0.9841 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 229 236 test Loss: 0.0024 Acc: 0.9703 Epoch 21/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 867 1006 train Loss: 0.0058 Acc: 0.8618 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 222 236 test Loss: 0.0037 Acc: 0.9407 Epoch 22/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 963 1006 train Loss: 0.0026 Acc: 0.9573 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 233 236 test Loss: 0.0011 Acc: 0.9873 Epoch 23/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 998 1006 train Loss: 0.0005 Acc: 0.9920 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0004 Acc: 0.9958 Epoch 24/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1002 1006 train Loss: 0.0003 Acc: 0.9960 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0004 Acc: 0.9958 Epoch 25/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1003 1006 train Loss: 0.0002 Acc: 0.9970 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 233 236 test Loss: 0.0005 Acc: 0.9873 Epoch 26/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1002 1006 train Loss: 0.0002 Acc: 0.9960 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0003 Acc: 0.9958 Epoch 27/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0002 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0003 Acc: 0.9958 Epoch 28/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 997 1006 train Loss: 0.0005 Acc: 0.9911 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 228 236 test Loss: 0.0016 Acc: 0.9661 Epoch 29/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 975 1006 train Loss: 0.0015 Acc: 0.9692 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 227 236 test Loss: 0.0021 Acc: 0.9619 Epoch 30/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 973 1006 train Loss: 0.0022 Acc: 0.9672 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 226 236 test Loss: 0.0018 Acc: 0.9576 Epoch 31/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 996 1006 train Loss: 0.0007 Acc: 0.9901 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0004 Acc: 0.9958 Epoch 32/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0002 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0003 Acc: 1.0000 Epoch 33/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0001 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0004 Acc: 0.9958 Epoch 34/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1003 1006 train Loss: 0.0001 Acc: 0.9970 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0003 Acc: 0.9958 Epoch 35/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0001 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0003 Acc: 1.0000 Epoch 36/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0001 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0002 Acc: 1.0000 Epoch 37/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 965 1006 train Loss: 0.0015 Acc: 0.9592 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 224 236 test Loss: 0.0040 Acc: 0.9492 Epoch 38/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 964 1006 train Loss: 0.0027 Acc: 0.9583 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 233 236 test Loss: 0.0008 Acc: 0.9873 Epoch 39/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 998 1006 train Loss: 0.0005 Acc: 0.9920 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0005 Acc: 1.0000 Epoch 40/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1003 1006 train Loss: 0.0002 Acc: 0.9970 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0002 Acc: 1.0000 Epoch 41/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1003 1006 train Loss: 0.0001 Acc: 0.9970 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0002 Acc: 1.0000 Epoch 42/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1005 1006 train Loss: 0.0001 Acc: 0.9990 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0003 Acc: 0.9958 Epoch 43/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0001 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0002 Acc: 0.9958 Epoch 44/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1005 1006 train Loss: 0.0001 Acc: 0.9990 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0004 Acc: 1.0000 Epoch 45/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 999 1006 train Loss: 0.0006 Acc: 0.9930 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 227 236 test Loss: 0.0020 Acc: 0.9619 Epoch 46/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 942 1006 train Loss: 0.0043 Acc: 0.9364 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 213 236 test Loss: 0.0045 Acc: 0.9025 Epoch 47/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 990 1006 train Loss: 0.0013 Acc: 0.9841 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0004 Acc: 1.0000 Epoch 48/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1003 1006 train Loss: 0.0002 Acc: 0.9970 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 235 236 test Loss: 0.0004 Acc: 0.9958 Epoch 49/49 ---------- TRAINING STARTED loss done ('Reached iteration ', 0) loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([64]) torch.Size([64, 19]) loss done loss backward done loss backward done optim torch.Size([46]) torch.Size([46, 19]) trying epoch loss train 1004 1006 train Loss: 0.0001 Acc: 0.9980 TESTING STARTED loss done ('Reached iteration ', 0) torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([64]) torch.Size([64, 19]) loss done torch.Size([44]) torch.Size([44, 19]) trying epoch loss test 236 236 test Loss: 0.0003 Acc: 1.0000 Training complete in 35m 4s Best val Acc: 1.000000 returning and looping back