Getting Jekyll installed on Windows can be more complicated than on, say, OSX and Ubuntu, but not by much. This outlines the steps I use.
I have similar guidance (plus extra steps for my publishing tools) for OSX written up here.
Because each of the pieces that make Jekyll work is fussy, especially on Windows, which the developers of those pieces rarely use.