How to develop 3D applications for mobile devices - Khronos Group Events, Seminars and Presentations

The Khronos Group - Connecting Software to Silicon

The Khronos Group is a not for profit industry consortium creating open standards for the authoring and acceleration of parallel computing, graphics, dynamic media, computer vision and sensor processing on a wide variety of platforms and devices. All Khronos members are able to contribute to the development of Khronos API specifications, are empowered to vote at various stages before public deployment, and are able to accelerate the delivery of their cutting-edge 3D platforms and applications through early access to specification drafts and conformance tests.

OpenGL - The Industry Standard for High Performance Graphics

OpenGL® is the most widely adopted 2D and 3D graphics API in the industry, bringing thousands of applications to a wide variety of computer platforms. It is window-system and operating-system independent as well as network-transparent. OpenGL enables developers of software for PC, workstation, and supercomputing hardware to create high-performance, visually compelling graphics software applications, in markets such as CAD, content creation, energy, entertainment, game development, manufacturing, medical, and virtual reality. OpenGL exposes all the features of the latest graphics hardware.

OpenCL - The open standard for parallel programming of heterogeneous systems

OpenCL™ is the first open, royalty-free standard for cross-platform, parallel programming of modern processors found in personal computers, servers and handheld/embedded devices. OpenCL (Open Computing Language) greatly improves speed and responsiveness for a wide spectrum of applications in numerous market categories from gaming and entertainment to scientific and medical software.

OpenGL ES - The Standard for Embedded 3D Graphics

OpenGL ES is a royalty-free, cross-platform API for full-function 2D and 3D graphics on embedded systems - including consoles, phones, appliances and vehicles. It consists of well-defined subsets of desktop OpenGL, creating a flexible and powerful low-level interface between software and graphics acceleration. OpenGL ES includes profiles for floating-point and fixed-point systems and the EGL specification for portably binding to native windowing systems. OpenGL ES 1.X: fixed function hardware offering acceleration, image quality and performance. OpenGL ES 2.X: enables full programmable 3D graphics.

EGL - Native Platform Interface

EGL™ is an interface between Khronos rendering APIs such as OpenGL ES or OpenVG and the underlying native platform window system. It handles graphics context management, surface/buffer binding, and rendering synchronization and enables high-performance, accelerated, mixed-mode 2D and 3D rendering using other Khronos APIs.

WebGL - OpenGL ES 2.0 for the Web

WebGL is a royalty-free, cross-platform API that brings OpenGL ES 2.0 to the web as a 3D drawing context within HTML, exposed as low-level Document Object Model interfaces. It uses the OpenGL shading language, GLSL ES, and can be cleanly combined with other web content that is layered on top or underneath the 3D content. It is ideally suited for dynamic 3D web applications in the JavaScript programming language, and will be fully integrated in leading web browsers.

WebCL - Heterogeneous parallel computing in HTML5 web browsers

The WebCL working group is working to define a JavaScript binding to the Khronos OpenCL standard for heterogeneous parallel computing. WebCL will enable web applications to harness GPU and multi-core CPU parallel processing from within a Web browser, enabling significant acceleration of applications such as image and video processing and advanced physics for WebGL games. WebCL is being developed in close cooperation with the Web community and has the potential to extend the capabilities of HTML5 browsers to accelerate computationally intensive and rich visual computing applications.

COLLADA - Digital Asset and FX Exchange Schema

COLLADA™ defines an XML-based schema to make it easy to transport 3D assets between applications - enabling diverse 3D authoring and content processing tools be combined into a production pipeline. The intermediate language provides comprehensive encoding of visual scenes including: geometry, shaders and effects, physics, animation, kinematics, and even multiple version representations of the same asset.COLLADA FX enables leading 3D authoring tools to work effectively together to create shader and effects applications and assets to be authored and packaged using OpenGL® Shading Language, Cg, CgFX, and DirectX® FX

glTF - runtime asset format for WebGL, OpenGL ES, and OpenGL

The "glTF" project aims to define a final stage OpenGL Transmission Format to enable rapid delivery and loading of 3D content by WebGL, OpenGL, and OpenGL ES APIs. glTF together with COLLADA comprise a standards-based content pipeline for rich 3D web and mobile applications. glTF Specification is a work-in-progress from the COLLADA Working Group; it is not an official Khronos-ratified specification yet. It is incomplete and subject to change. The draft specification and related converters and loaders are available on github.

OpenVG - The Standard for Vector Graphics Acceleration

OpenVG™ is a royalty-free, cross-platform API that provides a low-level hardware acceleration interface for vector graphics libraries such as Flash and SVG. OpenVG is targeted primarily at handheld devices that require portable acceleration of high-quality vector graphics for compelling user interfaces and text on small screen devices - while enabling hardware acceleration to provide fluidly interactive performance at very low power levels.

OpenSL ES - The Standard for Embedded Audio Acceleration

OpenSL ES™ is a royalty-free, cross-platform, hardware-accelerated audio API tuned for embedded systems. It provides a standardized, high-performance, low-latency method to access audio functionality for developers of native applications on embedded mobile multimedia devices, enabling straightforward cross-platform deployment of hardware and software audio capabilities, reducing implementation effort, and promoting the market for advanced audio.

OpenMAX IL - The Standard for Media Library Portability

OpenMAX™ is a royalty-free, cross-platform API that provides comprehensive streaming media codec and application portability by enabling accelerated multimedia components to be developed, integrated and programmed across multiple operating systems and silicon platforms. The OpenMAX API will be shipped with processors to enable library and codec implementers to rapidly and effectively make use of the full acceleration potential of new silicon - regardless of the underlying hardware architecture.

OpenMAX AL - The Standard for Media Library Portability

StreamInput - Cross-platform advanced sensor processing and user interaction

The Khronos StreamInput working group is driving industry consensus to create a cross-platform API to enable applications to discover and use new generation sensors to create sophisticated user interactions. The new API will support a general-purpose framework for consistently handling advanced sensors such as depth cameras, touch screens and motion and orientation sensors as well as traditional input devices. StreamInput will provide flexible device discovery to enable an application to select and process high-level semantic input from low-level device capabilities, enabling significant innovations by sensor and device manufacturers while simplifying portable application development. The API will also provide system-wide sensor synchronization for advanced multi-sensor applications such as augmented reality, and will use Khronos’ proven extension mechanisms to enable new types of input devices to be easily added and supported.

OpenVX - Hardware acceleration for Computer Vision applications & libraries

Computer vision has become an essential component of many modern applications including gesture tracking, smart video surveillance, automatic driver assistance, biometrics, computational photography, augmented reality, visual inspection, robotics and more. The OpenVX working group has been formed to drive industry consensus to create a cross-platform API standard to enable hardware vendors to implement and optimize accelerated computer vision algorithms. The OpenVX API can accelerate high-level libraries, such as OpenCV open source vision library, or be used by applications directly. A strong focus will be on providing computer vision on mobile and embedded systems and enabling acceleration on a wide variety of computing architectures including CPUs, GPUs and DSPs. OpenVX will explore interoperability with existing Khronos standards for camera control, video processing, compute acceleration and graphics rendering.

Camera Work Group - CALL for Industry Participation

The Khronos Camera working group is creating an open, royalty-free standard for advanced, low-level control of mobile and embedded cameras and sensors: Mobile and embedded devices are increasingly being equipped with the sensors and processing power for advanced camera-based applications such as computational photography, face and gesture processing, augmented reality and 3D object and scene reconstruction; While Khronos is defining APIs for vision and image processing the industry still lacks a camera API with low-level control of the camera sensor, lens and flash to generate the input image stream needed by cutting-edge computational photography and computer vision; The Camera working group will drive industry consensus to create a cross-platform API that provides functionality such as: burst control over sensor, flash and lens, system wide time stamping of sensor samples, multiple sensor control, output format and resolution selection, region of interest extraction, and consistent device and frame metadata.

Other Khronos Group APIs and Technologies

The Khronos Group manages other APIs and Technologies:

OpenGL SC - Safety Critical Profile
OpenMAX DL - The Standard for Media Library Portability
OpenKODE - Khronos Open Development Environment
OpenWF - The Standard for building composited windowing systems
OpenML - The Standard for Dynamic Media Authoring

Quick Links:

Sorry, this event is now over

We've collected some of the more interesting items from this event and linked to them from here.

Presentations	Press	Podcasts

YouTube	Press Kits

Flickr

Date: Tuesday August 7th 2007
Location: Siggraph 2007, Room 4
Website: http://www.siggraph.org/s2007/attendees/courses/25.html

Overview

How to develop 3D applications for mobile devices, how they function, and where they are heading. The course focuses on OpenGL ES and M3G, and how to use these technologies to create efficient applications and deploy them in the mobile world. It covers the structure and evolution of 3D applications, shows programming examples, and provides tips and tricks for programmers and artists.

Prerequisites

Basic knowledge of 3D computer graphics. Working knowledge of a modern graphics API like OpenGL, D3D, X3D, or Java3D. Ability to read simple computer programs written in C and Java. Useful but not required: exposure to shading languages such as GLSL, HLSL, and Cg.

Intended Audience

Anyone who is interested in developing 3D graphics applications on mobile devices, although the content is targeted more towards programmers than artists.

Organizer

Kari Pulli
Nokia Research Center

Lecturers

Jani Vaarala
Nokia Corporation

Ville Miettinen
Hybrid Graphics, Ltd.

Robert J. Simpson
AMD Finland

Tomi Aarnio
Nokia Research Center

Mark Callow
HI Corporation

Additional information can be found on the Siggraph site.

The Khronos Group - a non-profit industry consortium to develop, publish and promote open standard, royalty-free media authoring and acceleration standards for desktop and handheld devices, combined with conformance qualification programs for platform and device interoperability.

Connecting Software to Silicon