Here's instructions to add a "Open with Git Bash" option to your context menu using the Git Bash that comes with GitHub for Windows.
Here's the registry script to add the option in. Because the installation paths for GitHub for Windows varies from user to user, I will go over which lines to change so that this script works for you.
Copy this script into your favorite text editor.
Windows Registry Editor Version 5.00