Apple today introduced ArKit 2, a platform that enables developers to integrate shared experiences, persistent augmented reality experiences associated with a particular location, object detection, and image tracking to create even more dynamic augmented reality apps. Apple has also unveiled the Measure app for iOS, which uses augmented reality to calculate the size of real objects, and a new open source format for iOS 12 called usdz, which is designed to further integrate augmented reality into the entire iOS system and deliver augmented reality objects across Apple’s app ecosystem.
In addition to ARKit 2.0, Apple has introduced a new type of augmented reality file called Universal Scene Description (USDZ). Adobe confirmed in the scenario that it will adopt the new file format.
Apple says ARKit makes a number of improvements, including:
- Improved face tracking
- Realistic representation
- 3D object detection
- Persistent experiences
- Shared Experiences
- Craig Federighi promotes a specific feature of shared experiences, which will allow users to see the same augmented reality experience, either as a participant or as an observer.
Apple also brought Lego to the stage to showcase the company’s Lego Studio application that is based on ARKit. The company promoted that augmented reality “really opens up those creative possibilities of play”
Since the launch of ARKit last fall, Apple has made great strides in the field of augmented reality available to developers at a very fast pace. In fact, this is the third major version. ARKit gives developers tools to create augmented reality experiences that change the way iOS users perceive the world, either for fun or to increase their productivity.
The experiences shared with ARKit 2 offer even more interactive augmented reality on the iPhone and iPad by allowing multiple players to play a game or collaborate together on projects such as home improvement. Developers can also add a viewer mode for family and friends to enjoy augmented reality gaming from another iOS device.
Persistent experiences will also change the way customers interact with their augmented reality apps, allowing them to leave virtual objects in the real world and return to them later. For example, they can start a puzzle on the table and pick it up later or work on an art project over the course of several weeks without losing their progress.
ARKit 2 also extends support for image detection and tracking, so that 3D objects such as toys or sculptures can be detected. In addition, it allows you to automatically apply real-world reflections to augmented reality objects. This makes the augmented reality experience a more realistic combination of the virtual and the real world.
Measure
Measure is a new iOS 12 app that uses augmented reality to quickly calculate the size of real objects like a tape measure. This new app automatically provides the dimensions of objects such as frames, posters, and signs, and can also display diagonal measurements, calculate areas, and allow users to take a photo and share it with the exact measurements from their iPhone or iPad.
QuickLook and usdz
With iOS 12, it’s easy to enjoy augmented reality almost anywhere in iOS. Apple has introduced a new open source format in collaboration with Pixar. It’s called usdz and is optimized for sharing on apps like Messages, Safari, Mail, Files and News without sacrificing the powerful features of graphics and animation. Thanks to usdz, Quick Look for AR also allows users to place 3D objects in the real world and evaluate how something looks in a given space.
ARKit 2 and usdz are part of a preview of iOS 12 for developers that is available to members of the Apple Developer Program starting today. Support for ARKit 2 and usdz will be available this fall as part of a free software update for iPhone 6s or later, all iPad Pro, 5th generation iPad, and 6th generation iPad models.