Generative Wall Art with Apple Vision Pro

A compact example project that demonstrates the core functionalities of visionOS

visionOS APIs Used

• Scene Types (WindowGroup & ImmersiveSpace)
• RealityKit
  • AnchorEntity (Plane Detection & Head Tracking)
  • ModelEntity
  • BillboardSystem
  • ParticleEmitterComponent
  • SwiftUI Attachments
  • SimpleMaterial
  • TextureResource
• SwiftUI
  • RealityView
  • Observable Macro
  • Animations
• UIKit
  • UIBezierPath

3D Content

This demo handles 3D content in two ways. First, the main character including its animations and particle effects is created in Reality Composer Pro. Second, the image canvas and its resources are created programmatically in Swift.

Setup

To run this project you need Xcode 15 Beta 5+ and visionOS 1.0 which you can download here.

1. Clone the repo.
2. Open the project in Xcode 15.
3. Select the root project GenerativeWallArt in the view hierarchy.
4. Go to Signing & Capabilities.
5. Select your development team.
6. Select the Apple Vision Pro simulator as a build target.
7. Build and run the project.
8. Select the museum scene, and move the character to the empty wall.
9. Tap the character to start the demo.