Using MSYS2 with Visual Studio Code is extremely easy now thanks to the Shell Launcher extension by Tyriar.
First, install the extension and reload Visual Studio Code.
Then, open the settings.json to edit your settings.
Add the field shellLauncher.shells.windows. I recommend using autocompletion here so that all the default shells are added.
You should having something like this now: