Two main types of files exist for notebooks:
ipynbused by Jupyter.pyfiles used by marimo
This analysis focuses on the ipynb files.
ipynb files are json files that contain the code and data for a notebook.
They also contain the metadata for the notebook as well as the output of the cells.
Tools like nbstripout can be used to remove output from ipynb files.
Tools like nbconvert can be used to convert ipynb files to .py files.
Tools like papermill can be used to run notebooks with parameters.
| Data Flow | Source | Destination | Encrypted? | Logged? | Priority |
|---|---|---|---|---|---|
| User input | Notebook app | ipynb | No | ? | Low |
| Notebook metadata | Notebook app | ipynb | No | ? | Medium |
| Notebook output | Notebook app | ipynb | No | ? | High |
| Shared ipynb notebook | People, example repos | computer | No | ? | High |
| Pairing with LLMs | Notebook app and LLM | ipynb | No | ? | High |
| Storing the notebook | Notebook | data store, GitHub | No | ? | High |