Since I don't know how computers work... I'm always running into issues and for some reason I tend to never read the errors or logs.
NOT TODAY!
I just thought about it for a few moments, but I was trying to figure out how to get ncu to run (Nsight Compute CLI)
ncu --set full -o output python3 prof.py
| # Copyright (c) 2019-present, Thomas Wolf. | |
| # All rights reserved. This source code is licensed under the MIT-style license. | |
| """ A very small and self-contained gist to train a GPT-2 transformer model on wikitext-103 """ | |
| import os | |
| from collections import namedtuple | |
| from tqdm import tqdm | |
| import torch | |
| import torch.nn as nn | |
| from torch.utils.data import DataLoader | |
| from ignite.engine import Engine, Events |