Skip to content

Instantly share code, notes, and snippets.

@sato-cloudian
Created December 17, 2015 06:10
Show Gist options
  • Select an option

  • Save sato-cloudian/8f7074ffc0e4fd0d7295 to your computer and use it in GitHub Desktop.

Select an option

Save sato-cloudian/8f7074ffc0e4fd0d7295 to your computer and use it in GitHub Desktop.
Scores vs. iteration
1. See if "Scores vs. iteration" decends quickly, and gets flat as iterations increase
2. If it becomes flat too early like above 1.0, that means it would have some rooms of tuning.
Model/Gradient
1. See if they show a normal distribution because weights&biases are converged on certain values
2. Note that a distributions may not look good if you have few samples like Iris
Mean Magnitudes: Parameters and Updates
1. Parameter Mean Magnitudes shows an ascend, and gets flat as those values are converges on certain values
2. Update/Gradient Mean Magnitudes shows a decend, and get flat as those values are converges on certain values
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment