Today, Magic Leap announced that Magic Leap 2, their immersive enterprise AR device, is now conformant with OpenXR. With OpenXR on Magic Leap 2, they can now provide a range of benefits to developers and enterprises, such as:
- Solution portability
- Feature scalability
- User flexibility
- Developer accessibility
- Platform capability
There is a strong need from third party developers to have a tutorial-style walkthrough on how to use OpenXR along with best practices. The Khronos Group has issued and RFP to develop these materials. Anyone is welcome to respond.
Godot 4.0 runs on Windows, Linux, and MacOS, and also Android devices. The Goldot team embedded OpenXR in the engine’s core and introduced Godot XR tools, which will help developers of XR projects. With two new Vulkan backends (Clustered and Mobile), Godot rendering has never been so advanced. While Godot is excited to leverage Vulkan for performance optimization going forward, it was very important not to penalize users with less powerful hardware. For that, they’ve integrated an OpenGL-based compatibility renderer aimed at supporting older and lower-end devices. As always, Godot wants to see people create games on the full spectrum of devices for everyone to enjoy. They’re also working on a Direct3D 12 renderer for better Windows and Xbox support. With Je06jm‘s contribution, you can now also take advantage of AMD’s Fidelity FX Super Resolution 1.0 (FSR 1.0) to dynamically and beautifully render at lower resolution while keeping your game running smoothly. Spoiler: Support for FSR 2.1 is planned in future releases.
The XR Hands package, which is currently in preview, enables hand tracking by utilising both the default XR subsystem that Unity provides as well as OpenXR. This indicates that it can be used in conjunction with other standard systems such as the XR Interaction Toolkit. Quest and HoloLens are currently supported by XR Hands, and Unity has plans to add support for additional OpenXR headsets that include hand tracking.
“We are extremely pleased to be fully compliant with the OpenXR [1.0] [for Android] standard as it will give PICO consumer and enterprise users access to a wider array of apps to improve their overall experience with our suite of consumer and enterprise headsets. This is an important step for PICO as we continue to enhance our headsets and the apps our PICO users are able to access through them.” - Henry Zhou, President of PICO.
AWS’ approach to spatial computing focuses on ways to enable customers to be successful. This focus extends to the company’s partnerships in the industry. AWS already publicly supports a plethora of XR companies big and small, including Campfire 3D, Meta, Magic Leap, NVIDIA, and many others. AWS’ Spatial Computing unit incorporates multiple divisions, including gaming, film, simulation, and geospatial, which makes sense when you consider that all of these mediums are inherently spatial. Many, but not all, will use a game engine to render their worlds. AWS has also heavily supported open standards such as OpenXR and even turned its game engine, Lumberyard, into the Open 3D Engine in partnership with the Linux Foundation to create an open-source game engine that it regularly updates.
Unity’s new XR hands package lets developers add hand tracking without using headset-specific SDKs. The package, currently in preview, supports hand tracking via Unity’s standard XR Subsystem and OpenXR. It works with other standard systems like the XR Interaction Toolkit. XR Hands already works with Quest and HoloLens, and Unity plans to add support for other OpenXR headsets with hand tracking.
Rendering in VR demands that hardware and applications maintain very high frame rates. A typical PCVR (PC and VR) setup comprises a PC connected to a head-mounted device (HMD) and a pair of hand-held controllers that must all function in real-time. This setup must contend with fluid controller and game movements, 6DoF animations, head movements, and two render passes (one per eye) at 90 to 120 FPS. Switch this setup to a wireless HMD, and the communications channel (e.g., Wi-Fi, 5G, etc.) must also be up to the task of real-time data transfer.
Last year, Qualcomm collaborated with Guy Godin, creator of Virtual Desktop, to enhance PCVR rendering performance. Qualcomm added Space Warp functionality to their Adreno Motion Engine which runs on all headsets powered by the Snapdragon XR2 and its Qualcomm Adreno GPU. Space Warp produces missing frames just-in-time on the HMD with no PC overhead, thus reducing PC-to-HMD bandwidth and stress on the encoder. This doubles the available PC render time and the effective encoder bitrate for PCVR-to-HMD streaming.
Virtual reality headsets are getting smaller, faster, wireless, and more portable than ever before. As the hardware advances, we are also seeing a seamless transition on the software side to OpenXR.
Using Monado, Colllabora’s open-source OpenXR runtime, intern Moses Turner completes a hand tracking project. In this blog, Moses guides us through the process, limitations, results and next steps.
OpenXR is composed of the core feature-set, multi-vendor extensions, and vendor-specific extensions. One of those vendors-specific extensions is VARJO_quad_views, available on Varjo HMDs as the name of the extension indicates. By default, in OpenXR, an application will generate two images, one for each eye. This is known as stereo views. But one unique capability of Varjo HMDs (except the Aero), is to have two displays per eye, allowing human eye resolution in the center area of the screen. The purpose of VARJO_quad_views is to enable the application to generate one view covering the entire field of view at the resolution of the context screen, and one inner view to match with the resolution and field of view of the focus screen (padded for taking into account the head movement and latency).
The VARJO_foveated_rendering extension is augmenting the VARJO_quad_views extension by adding eye tracking. The idea is that every rendered frame the application will be provided a different position of the inner view based on where the eyes are looking at. But also, since we know where the eyes are looking, the size of the inner view is much reduced from the default quad_views. And then the resolution of the outer view can also be reduced, as there is no need to even calculate as many pixels as the context screen can display, because even though it is not as high resolution as the focus screen, it is still higher resolution than the eye can detect at its periphery.
HTC VIVE announced developers can now join the OpenXR public beta program for the VIVE Focus 3. Developers have access to start new projects or port existing applications to multiple XR devices. OpenXR compatibility benefits consumers in addition to developers, giving them more flexibility to enjoy their VR content on multiple devices, including high-performance headsets like VIVE Focus 3.
The Award-winning technology company announces it received the prestigious financial grant form Epic, the company behind the popular Unreal Engine and Fortnite. The Epic MegaGrant is awarded for the further development of its OpenXR runtime, adopting the industry-standard. With recently being honoured an Innovation Award at CES last January, this is the 2nd award the Dutch technology company wins in Q1 of 2022 based on its Simulated Reality technology.
Godot recently released Godot 4.0 alpha 4 release candidate. In the release, Godot promoted OpenXR from a plug-in into the core for better integration with Vulkan and other engine components.
The Khronos Group has an open Request for Quote (RFQ) for OpenXR CTS Improvements. The OpenXR working group has developed a conformance test suite for validating vendor runtimes against the OpenXR specification to help ensure uniformity across AR and VR platforms. This project will extend the current conformance test suite with additional tests of the core specification as well as implementing tests for a number of extensions. The OpenXR Working Group may also seek some sample development to provide application developers simple example code to bootstrap their own development efforts. The deadline for RFQ submission has been extended to Friday, March 25th, 2022.