Particle.news

Apple Brings Foveated Streaming to Vision Pro in visionOS 26.4 Beta

The beta uses NVIDIA CloudXR plus eye tracking to stream detail to a user's gaze, potentially easing ports of desktop or cloud VR to Vision Pro.

Overview

  • Apple’s release notes confirm visionOS 26.4 adds official support for NVIDIA CloudXR with foveated streaming to deliver high‑resolution, low‑latency immersive content on Vision Pro.
  • The framework prioritizes image quality where the user is looking and lowers detail in peripheral areas to reduce processing and bandwidth demands.
  • Apps can mix streamed environments with locally rendered RealityKit elements, such as keeping cockpit gauges or in‑car instruments native while streaming the outside world.
  • Developers must integrate three parts to use it: the NVIDIA CloudXR Runtime, a Streaming Manager Protocol, and an Apple Vision Pro client app built on an OpenXR‑compliant runtime.
  • The capability is available now in beta, and while adoption timing is unclear, coverage suggests it could broaden the Vision Pro app library and improve performance for streamed games and experiences.