Dependency management is a bit hellish on Jetson.
I tried to build up the dev env natively (apt + pip on Jetson host, without docker),
then there was constant dependency mismatch on numpy, matplotlib, pytorch...
Isaac ROS is shipped in Docker favor (which is recommended by NVIDIA official), plus they have some good looking demoes.
Therefore I represent you my ways of setting up the Isaac ROS, to prevent you from falling into the hurdles.