Renesas enhances its R-Car V3H with improved deep-learning performance

Renesas Electronics Corporation, a supplier of advanced semiconductor solutions, has introduced an update of its state-of-the-art R-Car V3H system-on-chip (SoC), which delivers significantly improved deep-learning performance for smart camera applications. This includes for driver and occupant-monitoring systems (DMS / OMS), automotive front cameras, surround view, and auto parking for high-volume vehicles up to Level 2+.

The updated SoC combines sensor fusion on the real-time domain with up to ASIL C metrics and an architecture optimized for smart computer vision. It offers OEMs and Tier 1s a high-performance, low-power solution that supports the latest NCAP 2020 requirements as well as the roadmap to NCAP 2025 3 Stars at competitive system costs.

“The rising popularity of intelligent systems for applications, such as driver monitoring, park assist, driver recognition, and occupant sensing, is stoking higher demand for deep learning functions as automakers look for new ways to enable smart camera applications,” said Naoki Yoshida, VP of Automotive Digital Products Marketing Division at Renesas. “The updated SoC provides R-Car V3H customers a flexible, easy, and cost-effective path to higher computer vision performance for next-generation front camera systems.”

Building on the state-of-the-art recognition technology introduced with the R-Car V3H in February 2018, which includes integrated IP for convolutional neural networks (CNN), the updated R-Car V3H delivers four times the performance for CNN processing compared to the earlier version and achieves up to overall 7.2 TOPS processing — with all-computer vision IPs — and maintains low-power consumption levels.

The highly integrated SoC supports up to ASIL C metrics safety goals on the real-time domain, reducing the need for an external safety microcontroller (MCU) to manage sensor fusion and final decision actions. The R-Car V3H features a suite of proven IPs that support the perception stack, sensor fusion with radar and/or Lidar, and ISP with up to eight MP camera support, allowing OEMs and Tier 1s to achieve quicker time to market with a lower bill of materials costs.

“We are excited to continue bringing cutting-edge innovation to our customers with our growing platform of open and scalable SoCs for ADAS and highly automated driving,” added Yoshida.

Features

Delivers up to 7.2 TOPS, including 3.7 TOPS for CNN, with optimized performance-to-power balance
Supports ASIL D development process for the systematic capability for the full SoC
Supports metric targets for ASIL B (sensor layer, application processors) and ASIL C (real-time domain) safety goals
Full hardware and software compatibility with the currently mass-produced R-Car V3H SoC
Integrates a full set of automotive peripherals including CAN, Ethernet AVB, and FlexRay
Features a full set of video processing and image recognition IP for advanced sensing and recognition, including CNN-IP, Computer vision engine, Image-distortion-correction IPs, Stereovision, Classifier, and Dense Optical Flow

The updated R-Car V3H joins Renesas’ expanding lineup of SoCs within the open and flexible Renesas autonomy platform, which offers OEMs and Tier 1s complete scalability from entry-level NCAP applications up to highly automated driving systems.

Customers can also combine the R-Car V3H SoC with Renesas’ high-performance low-power RH850 MCU, integrated power management ICs, and power transistor devices to access the key components required for more complex safety compliant systems.