Skip to content

Instantly share code, notes, and snippets.

@ywolff
Created February 14, 2022 20:06
Show Gist options
  • Save ywolff/7ba56735aca944b154e74370e15378cf to your computer and use it in GitHub Desktop.
Save ywolff/7ba56735aca944b154e74370e15378cf to your computer and use it in GitHub Desktop.
stages:
preprocess_data:
foreach:
- train
- val
- test
do:
cmd: python scripts/preprocess_data.py --input-folder datasets/raw/${item} --output-folder datasets/preprocessed/${item}
deps:
- scripts/preprocess_data.py
- datasets/raw/${item}
outs:
- datasets/preprocessed/${item}
train_model:
cmd: python scripts/train_model.py
deps:
- scripts/train_model.py
- src/model.py
- models/initial_weights.h5
- datasets/preprocessed/train
- datasets/preprocessed/val
outs:
- models/trained_model.h5
compute_model_predictions:
cmd: python scripts/compute_model_predictions.py
deps:
- scripts/compute_model_predictions.py
- src/model.py
- models/trained_model.h5
- datasets/preprocessed/test
outs:
- predictions/test/model_predictions.csv
match_predictions_with_ground_truths:
...
compute_mean_average_precision:
...
compute_confusion_matrix:
...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment