Apple to allow developers to create apps for mixed reality headset using Siri

Apple is creating a software platform to enable users of its mixed-reality headset to easily create and develop their own augmented reality applications.

According to sources, Apple is developing a mixed reality headset with a tool that allows users to create augmented reality apps without coding. The tool, which is rumored to be based on technology from Fabric Software, a company acquired by Apple in 2017, would allow users to create digital environments and objects using procedural generation, a technique commonly used in video games. The tool is said to be controlled by Siri, and users would only need to verbally communicate their desired AR experience.

The project is believed to be led by Peter Zion, a co-founder of Fabric Software. This development aligns with Apple's previous acquisition of DigitalRune, a company focused on making 3D game development more accessible.

Apple may be developing a tool to make it easier for developers to create unique objects for headset apps. The tool would allow developers to scan and import objects that would look and behave realistically, eliminating the need to rely on Apple's stock models.

Additionally, the company is reportedly working on technology such as Object Capture, which creates 3D models from iPhone photos, and RoomPlan, for virtual floor plans. Although Apple has not commented on these developments, it is rumored that the company originally planned to release the suite of tools at the same time as the headset. The headset, which is rumored to be named Reality Pro, is expected to be released in the spring and may be targeted towards professionals rather than everyday users. However, the company is said to be developing features such as FaceTime calls with avatars and health and fitness apps that could attract a wider audience. By fostering the app ecosystem, Apple may be paving the way for a more affordable mixed reality headset in the future.