What is Gaussian splatting and how does Apple use it?

Gaussian splatting is an AI-based algorithm that converts 2D images into 3D models. Apple employs it for interactive photos, 3D maps, Vision Pro avatars, and virtual environments from panoramas.

What new 3D processing features arrive with iOS 27?

iOS 27 introduces Spatial Reframing, a tool for editing photos in 3D mode. Users can change viewing angles and let AI redraw surroundings dynamically.

When will Apple enable full 3D space scanning?

Current hardware limits restrict full 3D scans. More accessible headsets and advanced cameras are needed, likely arriving in the coming years.

← All news

Artificial intelligence

Apple Introduces 3D Image Processing: What’s New in iOS 27 and Vision Pro

June 12, 2026

Photo: CNET

Quick answer

Apple integrated Gaussian splatting into iOS 27 and VisionOS 27 for advanced 3D image processing. The new Spatial Reframing feature enables interactive 3D photo editing, while panoramic images can now be converted into…

At WWDC 2026, Apple unveiled iOS 27 with a revolutionary 3D image processing feature: Spatial Reframing. This tool converts standard photos into interactive scenes where users can adjust viewing angles and watch AI reconstruct hidden parts of the image. The technology relies on Gaussian splatting, previously used in Vision Pro for creating realistic 3D avatars and detailed spatial maps.

Gaussian splatting is already integrated into third-party Vision Pro apps, such as urban district scanning and virtual tour creation. In VisionOS 27, Apple added the ability to convert panoramic photos into explorable 3D environments. However, full-scale exploration of these worlds remains unavailable due to high data and hardware demands.

Experts note Apple is gradually adopting 3D technologies without abrupt changes. Beyond Spatial Reframing, iOS 27 enhances 3D maps, while Vision Pro introduces new panorama tools. The company plans to expand spatial scanning capabilities but requires more affordable headsets and advanced cameras, expected no earlier than next year.

Common questions

What is Gaussian splatting and how does Apple use it?: Gaussian splatting is an AI-based algorithm that converts 2D images into 3D models. Apple employs it for interactive photos, 3D maps, Vision Pro avatars, and virtual environments from panoramas.
What new 3D processing features arrive with iOS 27?: iOS 27 introduces Spatial Reframing, a tool for editing photos in 3D mode. Users can change viewing angles and let AI redraw surroundings dynamically.
When will Apple enable full 3D space scanning?: Current hardware limits restrict full 3D scans. More accessible headsets and advanced cameras are needed, likely arriving in the coming years.

Dzen feed: /feed/dzen.xml · RSS: /feed.xml