Skip to content

Instantly share code, notes, and snippets.

@jrzaurin

jrzaurin/adult_tabtransformer.csv

Last active June 13, 2021 09:13
Show Gist options
  • Save jrzaurin/b5e9ee953d64c18ef2c75dcc563ddaec to your computer and use it in GitHub Desktop.
Save jrzaurin/b5e9ee953d64c18ef2c75dcc563ddaec to your computer and use it in GitHub Desktop.
Download ZIP
Results for the Adult Census dataset with TabTransformer
Raw
adult_tabtransformer.csv
embed_dropout full_embed_dropout shared_embed add_shared_embed frac_shared_embed input_dim n_heads n_blocks dropout ff_hidden_dim transformer_activation mlp_hidden_dims mlp_activation mlp_batchnorm mlp_batchnorm_last mlp_linear_first with_wide lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
0.0 False False False 8 16 4 4 0.1 relu None relu False False False False 0.01 128 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2879
0.0 False False False 8 16 4 4 0.1 relu same relu False False False False 0.01 128 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2884
0.0 False False False 8 16 4 4 0.1 relu None relu False False False True 0.01 128 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2888
0.0 False False False 8 16 4 8 0.2 relu None relu False False False True 0.001 128 0.0 AdamW ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2892
0.0 False False False 8 16 2 4 0.1 relu None relu False False False False 0.01 128 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2894
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment