Applications for the QNX Platform for ADAS

There are various types of applications that you can create for your ADAS system.

Provided with QNX Platform for ADAS are sample applications that fall under one of these categories:
  • ADAS applications
  • Publish and subscribe data applications
Note: If you are building applications for a safety-related system, see the documentation for the QNX OS for Safety 2.0.


Figure 1. Sensor Framework and QNX Platform for ADAS Services.

ADAS applications

To create applications that provide ADAS functions, you can use Camera, Sensor, and ADAS libraries that come with the Sensor Framework. Applications that use the Camera library can take the video stream from a camera and then use vision algorithms to stitch the images together to create surround view of its environment or identify objects in the video, such as traffic lights, other vehicles, or pedestrians.

Applications that use the Sensor framework can gather the information from multiple sensors and publish the data to other applications in the system, and subscribe to data from publisher. Applications that use the ADAS library can visualize sensor data from a camera or point cloud viewer (viewers), overlay text, rectangles, or images over visualized sensor data, apply vision algorithms to the data to overlay track information on the viewers.
Figure 2. Sample applications that use the Sensor Framework
For more information, see the Camera Developer's guide, the Sensor Developer's Guide, ADAS Developer's Guide, and the System Services guide.
For example, you can build an application that runs as soon as the system boots to provide feeds from sensors and cameras connected to the system. Included on most of the provided reference images is the ADAS example application that boots immediately and shows an image from various sensors representing the car and its surroundings. The example visualizes data and provides overlays (boxes) that highlight the traffic light and provide a representation of the vehicle's surroundings as shown in the illustrations below.
Figure 3. Front view running on ADAS example application
Figure 4. Point cloud showing multiple sensors for a bird's eye view
In addition to the ADAS example application, there are some other sample applications available on the reference images (depending on the hardware platform), such as:
  • Sensor example, which demonstrates how to use the Sensor library
  • Camera example, which demonstrates how to use the Camera library
  • Camera MUX 2x2, which shows a 2x2 grid of different views
  • Robot OS example, which shows how to publish and subscribe to data from a sensor using Robot OS (ROS)
  • Publish and Subscribe example, which shows to publish data from a sensor using Platform-independent Publish Subscribe (PiPS) using Fast RTPS. You can configure the application to use SOME/IP or RTI Connext Pro.

For more information about these sample applications, see the “Run Sample Applications” chapter in the Getting Started guide for the hardware platform you want to use.