Skip to content

Instantly share code, notes, and snippets.

@jrzaurin

jrzaurin/bank_marketing_tabtransformer.csv

Last active June 13, 2021 09:15
Show Gist options
  • Save jrzaurin/51fdfc02732575969a6e72eac04c206a to your computer and use it in GitHub Desktop.
Save jrzaurin/51fdfc02732575969a6e72eac04c206a to your computer and use it in GitHub Desktop.
Download ZIP
Results for the Bank Marketing dataset with TabTransformer
Raw
bank_marketing_tabtransformer.csv
embed_dropout full_embed_dropout shared_embed add_shared_embed frac_shared_embed input_dim n_heads n_blocks dropout ff_hidden_dim transformer_activation mlp_hidden_dims mlp_activation mlp_batchnorm mlp_batchnorm_last mlp_linear_first with_wide lr batch_size weight_decay optimizer lr_scheduler base_lr max_lr div_factor final_div_factor n_cycles val_loss_or_metric
0.0 False False False 8 32 8 6 0.1 relu None relu False False False False 0.001 512 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2646
0.0 False False False 8 32 8 6 0.1 relu None relu False False False False 0.001 512 0.0 AdamW ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2647
0.0 False True False 4 16 4 6 0.1 relu None relu False False False False 0.01 128 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2668
0.0 False False False 8 32 8 6 0.1 relu None relu False False False False 0.01 1024 0.0 RAdam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2672
0.0 False False False 8 32 8 6 0.1 relu None relu False False False False 0.001 1024 0.0 Adam ReduceLROnPlateau 0.001 0.01 25 10000.0 5.0 0.2672
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment