blog / visionos / Apr 23
visionOS killer apps will emerge in three themes: big virtual screens replacing physical displays for portable, scalable workspaces; real-time holograms enabling immersive social interactions and 3D recreations like sports; and spatial visualization for customizing physical environments with virtual overlays. These require lighter, affordable hardware in 2.5-5 years to drive consumer adoption beyond current enterprise use. OS features like Environments and Personas lay groundwork, unlocking third-party monetization.
augmented-realityvisionosapple-vision-prospatial-computingkiller-appsvirtual-screensholograms
“Apple Vision Pro is not a consumer device due to weight, cost, and isolation, with accessible versions 2.5-5 years away”
blog / visionos / Apr 23
An experienced visionOS developer identifies key framework limitations from hands-on experimentation, proposing prioritized enhancements for future releases. Top requests include 3D/Volumetric MapKit for spatial navigation in visionOS 3, robust Spatial Interaction or multiplayer frameworks leveraging UWB chips by visionOS 4, expanded RoomPlan with privacy safeguards, ARKit multi-app concurrency to enable shared resource access without full session sharing, and a customizable PersonaKit for avatars. These address current pain points in ARKit exclusivity, device interaction, and social features to unlock spatial computing potential.
visionosrealitykitarkitspatial-computingapple-developerfeature-requestsaugmented-reality
“3D Volumetric MapKit is essential for visionOS and should launch in visionOS 3 with initial regional coverage”
blog / visionos / Apr 23
visionOS 2's room tracking provides quick, accurate surface detection for walls and floors, ideal for anchoring mixed reality effects like virtual rainstorms in apps such as Mirage. Developers must prefer plane detection over scene reconstruction for precise, flat surfaces despite low fidelity in plane and mesh detection on 2024 Vision Pro hardware. Performance optimization is critical: limit particles/emitters, avoid excessive semi-transparency, use RealityKit Trace and hardware "melting" tests, geometry modifiers for overlaps, and non-spatial audio where appropriate.
visionosmixed-realityroom-trackingindie-app-devarkitrealitykitspatial-computing
“Room tracking in visionOS 2 quickly and relatively accurately detects surfaces representing walls and floors.”
blog / visionos / Apr 23
visionOS Enterprise APIs, introduced at WWDC 2024, provide Main Camera Access for raw camera frames but require special Apple approval and limit distribution to in-house or Apple Business Manager channels, excluding the App Store. The API delivers only basic image frames without depth maps or segmentation, unlike ARKit's richer data on iOS. Prototypes demonstrate utility in interior design and construction via color sampling, with potential for enhanced AR integration using supplementary ARKit data.
visionosenterprise-apismain-camera-accessaugmented-realityarkitinterior-designspatial-computing
“visionOS Enterprise APIs include Main Camera Access for raw camera frames.”