Skip to content

Instantly share code, notes, and snippets.

@jrzaurin

jrzaurin/adult_tabmlp.csv

Last active June 13, 2021 22:04
Show Gist options
  • Save jrzaurin/0695d00e6a215b543e77dd9015ebc10c to your computer and use it in GitHub Desktop.
Save jrzaurin/0695d00e6a215b543e77dd9015ebc10c to your computer and use it in GitHub Desktop.
Download ZIP
Results for the Adult Census dataset with TabMlp
Raw
adult_tabmlp.csv
mlp_hidden_dims mlp_activation mlp_dropout mlp_batchnorm mlp_batchnorm_last mlp_linear_first embed_dropout lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
[400,200] relu 0.5 False False False 0.1 0.001 128 0.0 AdamW ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2857
[400,200] relu 0.5 False False False 0.0 0.0005 128 0.0 Adam CyclicLR 0.0005 0.01 25 10000.0 10.0 0.2860
[100,50] relu 0.2 False False False 0.0 0.0004 128 0.0 Adam OneCycleLR 0.001 0.01 25 1000.0 5.0 0.2860
[400,200] relu 0.5 False False False 0.1 0.001 128 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2861
[400,200] relu 0.5 False False False 0.0 0.0005 128 0.0 RAdam CyclicLR 0.0005 0.01 25 10000.0 10.0 0.2862
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment