ARKit for visionOS

Build and debug ARKit features for Apple visionOS. Covers ARKitSession setup and authorization, data providers for world tracking, plane detection, scene reconstruction, and hand tracking, anchor processing, and RealityKit integration in immersive spaces.

This skill helps you implement spatial-computing features on Apple Vision Pro with ARKit and RealityKit. It configures ARKitSession and requests the right authorizations, runs data providers for world tracking, plane detection, scene reconstruction, and hand tracking, processes anchors, and wires results into RealityKit inside immersive spaces — plus it diagnoses provider and data-access issues on visionOS.

When to use

Use when building ARKit workflows for visionOS — setting up ARKitSession and authorization, using world tracking, plane detection, scene reconstruction, or hand-tracking providers, processing anchors, integrating RealityKit, or debugging ARKit data access.

Examples

Set up an ARKitSession

Authorize and start providers

Set up an ARKitSession on visionOS that requests authorization and starts world-tracking and plane-detection providers, handling the denied case gracefully

Hand tracking

Read hand anchors each frame

Add a hand-tracking data provider and update RealityKit entities to follow the user's fingertips in an immersive space

Scene reconstruction

Mesh the real environment

Use the scene reconstruction provider to build a mesh of the room and place a virtual object that collides with real surfaces