Obviously getting the NMS is a pain and the way that I have obtained it is by opening the bootstrap spigot (the one you use to run your spigot server) as a zip. Once opened go to META-INF/libraries and extract the spigot-api-..-R.-SNAPSHOT.jar, and the spigot-..-R*.*-SNAPSHOT.jar. Also extract all of the netty libraries from the same path. Use these extracted jars as libraries in your plugin.
With all of that you should be able to listen for incoming packets with spigot.