Reference image sensor support

Updated: April 19, 2023

Here's an overview of the sensors (lidar, radar, GPS, IMU systems) and cameras the reference images support. In some cases, you can develop or integrate support for an unsupported sensor or camera into an image for your hardware platform.

The reference images are typically configured to run virtual sensors and virtual cameras, which are referred to as file data and file cameras. File data simulate hardware using sensor data in files, while file cameras simulate hardware using recorded video. This is useful for testing and development.

You can configure your reference images to use sensors or cameras connected to the target system. This release supports up to 64 sensors and cameras, but the actual support is based on the physical limitations of your target system's hardware, including its interface connectors, memory, and bandwidth. For example, you might be able to connect only three USB cameras because you have three USB ports available. If you extend the capabilities by using a USB hub, you are further constrained by bandwidth that's available on the USB connection and by the speed of the hub.

DANGER
A minimum of 25 centimeters (10 inches) between you and radar-emitting hardware must be maintained in accordance to FCC radiation exposure limits.
Table 1. Reference image sensor support
Sensor Hardware Renesas R-Car V3H VMware (x86_64) NXP i.MX8QM Sample configuration1
Leopard Imaging Inc. USB cameras

USB 3.0 with Omnivision OV10635 image sensor (LI-USB30-OV10635)

NO YES YES Sensor configuration file for USB camera
FLIR (previously Point Grey Research) USB Vision3 Cameras

(FL3-U3-13G4C-C, BFLY-U3-23S6C-C, GS3-U3-23S6C-C, CM3-U3-13Y3C-CS)

NO YES YES Sensor configuration file for USB camera
FLIR (previously Point Grey Research) GigE Vision Camera

(BFLY-PGE-13E4C-CS, BFLY-PGE-12A2C-CS)

NO YES YES Sensor configuration file for GigE network camera
Omnivision OV5640 camera

(MINISASTOCSI module – OV5640 MIPI CSI BOARD (MINI SAS))

NO NO YES Sensor configuration file for OV5640 camera
Omnivision OV10635 camera using MAX9286 deserializer

(MCIMXCAMERA1MP module – OV10635 MIPI CAMERA)

NO NO YES Sensor configuration file for OV10635 camera
AMI MINICube RDACM24 camera YES NO NO Sensor configuration file for four AMI MINICube RDACM24 cameras
Panasonic ONVIF Profile S

(WV-SP105)

NO NO YES Sensor configuration file for ONVIF camera
Axis Communications ONVIF Profile S

(Axis P1214 Network Camera)

NO NO YES Sensor configuration file for ONVIF camera
Delphi ESR Medium Range/Long Range Radar NO NO NO Sensor configuration file for radar
Delphi SSR2 Short Range Radar NO NO NO Sensor configuration file for radar
Velodyne Lidar (Puck VLP-16 and Puck Hi-Res) NO NO NO Sensor configuration file for lidar
Leddertech Lidar

(Vu8 – 8-channel module, 48-degree wide laser, commercial carrier, part #75H0011-1)

NO NO NO Sensor configuration file for lidar (Leddartech)
XSens GPS and IMU sensor

(MTi-G-710-GNSSINS-2A5G4-DK)

NO NO NO Sensor configuration file for GPS (XSens)
NovAtel GPS and IMU Sensor

(OEM6 Family of Receivers)

NO NO NO Sensor configuration file for NovAtel GPS and IMU sensors
1 The examples for configuring cameras and sensors are found in the Sensor (sensor) chapter of the Sensor Framework Services Guide.