Credit for this goes to the Stack Overflow user Statistic Dean for his post on this question
(base)$ conda install -c conda-forge nb_conda_kernels
(base)$ conda activate my-env
(my-env)$ conda install ipykernel
(my-env)$ conda deactivate
my-env
is now available to use whenever you run Jupyter Lab (from your base env)