Computer Graphics
TU Braunschweig

Fast Eye-Tracked 3D Gaussian Rendering for Virtual Reality


Fast Eye-Tracked 3D Gaussian Rendering for Virtual Reality

Recent advances in 3D Gaussian Splatting (3DGS) promise interactive exploration of photorealistic reconstructions in virtual reality (VR) applications.

Unfortunately, current approaches for 3DGS are unable to meet the high demands of VR rendering, suffering from immersion-breaking artifacts, requiring aggressive pruning of primitives, or failing to reach sufficiently high frame rates for complex scenes.

We introduce VR-HTGS, the first fully integrated eye-tracked foveated solution for 3DGS rendering that, in contrast to previous work, dynamically adapts the tile-based 3DGS rasterizer to a heterogeneous tile layout following the gaze position. In comparison to homogeneous layouts, this allows tiles to be rendered at varying resolutions, retaining real-time performance without sacrificing the primitive count.

To minimize immersion-breaking inconsistencies during rendering, VR-HTGS builds on top of an efficient view-consistent Gaussian splat renderer to enable dynamic foveation along with further modifications to reduce aliasing, popping, and sky floaters.

In combination, these improvements enable fast, high-quality rendering of 3D Gaussians at 120+ Hz on commodity hardware for scenes consisting of millions of Gaussians.


Author(s): Timon Scholz, Florian Hahlbohm, Martin Eisemann, Susana Castillo, Marcus Magnor
Published: to appear
Type: Article in conference proceedings
Book: Proc. Vision, Modeling and Visualization (VMV) (The Eurographics Association)
Presented at: Vision, Modeling and Visualization (VMV) 2026
Project(s): Increasing Realism of Omnidirectional Videos in Virtual Reality 

BibTex 



@inproceedings{scholz2026fast,
  title = {Fast Eye-Tracked 3D Gaussian Rendering for Virtual Reality},
  author = {Scholz, Timon and Hahlbohm, Florian and Eisemann, Martin and Castillo, Susana  and Magnor, Marcus},
  booktitle = {Proc. Vision, Modeling and Visualization ({VMV})},
  organization = {Eurographics},
  year = {2026}
}

Authors