results_clamping_cifar100_fp32.txt

The following are for full precision (fp32) original resnset18:

cifar100 L2 1e-4 - top5 accuracy

unclamped => 0.77

threshold = 1e-08 => 0.77
threshold = 1e-07 => 0.77
threshold = 1e-06 => 0.77
threshold = 1e-05 => 0.77
threshold = 0.0001 => 0.77
threshold = 0.001 => 0.77
threshold = 0.01 => 0.77
threshold = 0.1 => 0.692
threshold = 0.2 => 0.628
threshold = 0.5 => 0.532

cifar100 L1 5e-5 - top5 accuracy

unclamped => 1

threshold = 1e-08 => 0.803
threshold = 1e-07 => 0.803
threshold = 1e-06 => 0.803
threshold = 1e-05 => 0.803
threshold = 0.0001 => 0.803
threshold = 0.001 => 0.803
threshold = 0.01 => 0.803
threshold = 0.1 => 0.749
threshold = 0.2 => 0.68
threshold = 0.5 => 0.623