Skip to content

Instantly share code, notes, and snippets.

@kemingy

kemingy/compare_mlp_monitor&reproduer.md

Last active April 26, 2019 07:33
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save kemingy/66091f6673e066e366fcd6df9bbf42b5 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save kemingy/66091f6673e066e366fcd6df9bbf42b5 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
compare_mlp_monitor&reproduer.md

MLflow

https://github.com/mlflow/mlflow

Pros

  • UI (tracking and comparing)
  • Run ML projects with different parameters
  • Serving
  • reproduce with conda config file

Cons

  • weak store (store in local file, slow to load)
  • ugly code
  • do not support save artifacts to user server
  • model serving is weak

Polyaxon

https://github.com/polyaxon/polyaxon

Pros

  • use Docker
  • UI
  • Notebook plugins
  • Tensorboard
  • Hyperparameters tuning

Cons

  • coupled to k8s
  • hard to deploy and debug

DVC

https://dvc.org/

Pros

  • built for large data version control
  • data saved in cloud or local or HDFS
  • support reproduce experiments with user histroy

Cons

  • not easy to use when user want to record the experiments
  • beta
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment