This book is the easiest and fastest way to get hands-on experience using Apple frameworks and technologies like Reality Composer, RealityKit, and ARKit — all the available rendering technologies Apple has to offer, as well as a collection of fun projects for creating various real-world AR experiences.
After reading this book, you’ll have a deep understanding of the technologies and frameworks used to create powerful, immersive AR experiences for the Apple platform.
Take a deep dive into:
AR Quick Look: Discover how to integrate AR Quick Look into your apps to give them some cool AR superpowers.
Reality Composer & Reality Files: Find out how to leverage the power of Reality Composer to create interactive AR-based experiences.
Reality Converter & PBR Materials: Discover how PBR materials can add a level of realism to your AR objects, and how you can use Reality Converter to convert, view and customize USDZ content.
RealityKit: Find out how to set up and use RealityKit to build a face-based augmented reality app.
Facial Blend Shapes: Build a fully interactive augmented reality face mask that reacts to your facial expressions using blend shapes.
ARKit: Get a complete introduction to ARKit, Apple’s framework for creating fully interactive augmented reality, and learn about the different types of rendering options available with ARKit.
Raycasting & Physics: Learn about raycasting, 2D hit-testing and the SpriteKit physics engine as you add more features and functionality to your game.
ECS & Collaborative Experiences: Build a collaborative AR experience and learn how to create and manage a multipeer connection.
Before You Begin
This section tells you a few things you need to know before you get started, such as what you’ll need for hardware and software, where to find the project files for this book, and more.
Welcome to the first section of the book. In this section, you’ll dip your toes into the shallow end of augmented reality as you learn about AR Quick Look, Reality Composer, Reality Converter and USDZ files. You’ll create an interactive virtual drum kit that you’ll be able to share with your friends on iMessage.
Discover how PBR materials can add a level of realism to your AR objects, and how you can use Reality Converter to convert, view and customize USDZ content.
Section II: Reality Composer & Image Tracking
In this section, you’ll dive a little deeper into augmented reality and learn about image anchors and tracking. You’ll also create an interactive AR Business Card that you can show off to your friends, making them green with envy.
Spice up your reality apps with animations and sound effects using behaviors, triggers and actions.
Section III: Reality Composer & Object Tracking
In this section, you’ll add another dimension with Object tracking. Using object anchors, you’ll augment a physical toy truck with interactive buttons that will reveal some fun facts about its real-world counterpart.
Learn how to use object anchors to anchor AR content to physical objects within the real world, and take a tour of ARKit Scanner — an iOS app that lets you scan physical objects.
Section IV: RealityKit & Face Tracking
In this section, you’ll learn about RealityKit and face tracking. You’ll create a SnapChat-like face filter app with SwiftUI that lets you mockup your face with funny props. You’ll also create an animated mask that you can control with your eyes, brows and mouth.
Build a fully interactive augmented reality face mask that reacts to your facial expressions using blend shapes.
Section V: ARKit & SpriteKit
In this section, you’ll get a full introduction to ARKit and find out what makes it so powerful. In doing so, you’ll create a fun 2D SpriteKit game where you get to save tiny Emoji’s before they fall to their death.
Learn about raycasting, 2D hit-testing and the SpriteKit physics engine as you add more features and functionality to your game.
Section VI: ARKit & SceneKit
In this section, you’ll continue learning about ARKit. You’ll also learn about SceneKit, Apple’s framework for creating 3D content, as you build a miniature interactive virtual airport that allows customers to access basic departure and arrivals information.