KhaosT

Displaying HDMI sources on Apple Vision Pro

While it's possible to stream most content to Apple Vision Pro directly over the internet, having the ability to use Apple Vision Pro as an HDMI display can still be useful.

Since Apple Vision Pro does not support connecting to an HDMI input directly or using an HDMI capture card, we have to be a little creative to make this work. NDI provides the ability to stream HDMI content over a local network with really low latency, and it works great with Apple Vision Pro.

This page shows the setup I’m using.

mixmix

{
  "seq": 216609486,
  "version": "1.0.0",
  "value": {
    "@BIbVppzlrNiRJogxDYz3glUS7G4s4D4NiXiPEAEzxdE=.ed25519": {
      "mentions": {
        "@BIbVppzlrNiRJogxDYz3glUS7G4s4D4NiXiPEAEzxdE=.ed25519": 1,
        "@J+0DGLgRn8H5tVLCcRUfN7NfUcTGEZKqML3krEOJjDY=.ed25519": 4,
        "%sYZDD1+cOg52V+AQnXwcLsagUyYW2CUSynk5RFORV0c=.sha256": 1,
        "%gPh+LUOO6SaI5ukRJWYYixatHDPGl4I0cHzFYR/OqtA=.sha256": 1,

protrolium

Install ImageMagick

brew install ImageMagick

Pull specific region of frames from video file w/ ffmpeg

ffmpeg -ss 14:55 -i video.mkv -t 5 -s 480x270 -f image2 %04d.png

• -ss 14:55 gives the timestamp where I want FFmpeg to start, as a duration string.
  
• -t 5 says how much I want FFmpeg to decode, using the same duration syntax as for -ss.
  
• -s 480x270 tells FFmpeg to resize the video output to 480 by 270 pixels.
  
• -f image2 selects the output format, a series of still images — make sure there are leading zeros in filename.