NXP delivers a wide range of processing solutions on which machine-learning (ML) applications can run. Developers will need the associated software and tools to make them work and this is where eIQ framework and development tools come into play. The eIQ framework is designed to work with hardware abstraction layers like OpenCL, OpenVX, and the Arm Compute Library, as well as inference engines like the Arm NN (neural net), Android NN, GLOW, and OpenCV.
Khronos member Peter McGuinness has written an overview about NNEF over on the GFXSpeak blog. The new standard was released in provisional form in December of 2017 and, after a period of consultation with industry, is now ratified in its final form and available for immediate use. As well as the standard itself, Khronos is simultaneously releasing a suite of open source tools to allow developers to immediately begin using the format with the three most popular training frameworks: Tensorflow and Caffe/Caffe2. All of these tools are available on GitHub in the Khronos repo. Learn more about NNEF.
The Khronos Group NNEF Working Group Chair Peter McGuinness discusses fragmentation in the Machine Learning field. Machine learning capabilities are being added to everything from social media platforms, IoT devices and cameras to robots and cars. The pace of innovation is leading to fragmentation, and one potential consequence of that fragmentation is a risk of stalling. A universal transfer standard for neural networks will cut down time wasted on transfer and translation and provide a comprehensive, extensible and well-supported solution that all parts of the ecosystem can depend on. The Neural Network Exchange Format is one of two standards currently being developed to satisfy this need. Learn more about NNEF and how it aims to solve this issue.
Codeplay has a very good write-up today on machine alternatives that don’t use Neural Networks. The included code, SYCL-ML was developed as a proof of concept to show what a machine learning application using heterogeneous computing can look like and has been published as an open source project. The project was developed using SYCL and ComputeCpp, which is an implementation of SYCL developed by Codeplay.
Neil Trevett, Khronos Group President and Radhakrishna Giduthuri, Software Architecture and Compute Performance Acceleration at AMD, spoke at two Khronos related events this past week. Neils presented was an update on the Khronos Standards for Vision and Machine Learning which covered Khronos Standards OpenVX, NNEF, OpenCL, SYCL and Vulkan. Radhakrishna presented Standards for Neural Networks Acceleration and Deployment covered Khronos Standards OpenVX and NNEF. The slides from both presentations are now online.