Advanced global-shutter image sensor enhances driver-monitoring systems

STMicroelectronics, a global semiconductor provider serving customers across the spectrum of electronics applications, is enhancing vehicle safety with its latest global-shutter image sensors for driver-monitoring systems (DMSs).

DMSs continually watch the driver’s head movements to recognize signs of drowsiness and distraction, enabling systems in the vehicle to generate warnings that can preserve the safety of occupants.

Traffic agencies estimate that about 95 percent of road-traffic accidents result from human error, many of which could be avoided using systems such as DMSs.

With almost 19,000 accident fatalities in Europe in 2020, recently enacted legislation will mandate DMS for all new car platforms in Europe in 2024 and for existing model platforms in 2026. With traffic fatalities twice as high in the U.S., the National Transportation Safety Board (NTSB) has recommended DMS for all semi-autonomous vehicles.

“Drivers may not realize that they are unsafe to drive due to tiredness or distraction. DMS removes uncertainty by detecting the problem automatically, which protects all occupants as well as others traveling on the road,” said Eric Aussedat, executive VP and Imaging Sub-Group GM, STMicroelectronics. “Our latest global-shutter sensors deliver sensitivity and compactness, simplifying DMS hardware and reducing the overall system cost. This enables our customers and partners to deliver high-performing and reliable DMS systems reaching the legislation expectations.”

The new global-shutter sensor, VB56G4A, leverages ST’s in-house investment in manufacturing advanced 3D-stacked back-side illuminated (BSI-3D) image sensors. These are more sensitive, smaller, and more reliable than conventional front-side illuminated (FSI) sensors typically used in first-generation DMSs.

ST is supplying samples of its new sensor to lead customers now and mass production is scheduled for the beginning of 2023 for adoption in model year 2024 vehicles.

Technical information
Global-shutter sensor offers big advantages over rolling-shutter imagers. By simultaneously exposing all pixels to the image, a global-shutter sensor allows simple synchronization with NIR illumination, improving the illumination-subsystem power budget.

Moreover, the new sensor achieves high Quantum Efficiency (QE), reaching 24 percent at 940nm near-infrared wavelength, with linear dynamic range up to 60dB. This enables a simple low-power, non-visible LED emitter to provide adequate illumination for the sensor. Operating outside the visible spectrum also ensures consistent response in day or night driving and in bright or overcast conditions.

The sensor’s high QE, combined with a pixel size of just 2.6µm, helps optimize total power consumption and camera size. In addition, integrated automatic exposure control eases use and simplifies the application-software design by minimizing system interaction with the sensor.

The sensor also provides flexible operating modes that help optimize system features and performance. These include programmable sequences of four-frame contexts, illumination control outputs synchronized with sensor integration periods, an input for an external frame-start signal, automatic dark calibration, dynamic defective-pixel correction, image cropping, and a mirror/flip-image readout.

External connections include eight programmable general-purpose I/O (GPIO) pins and a dual-lane MIPI CSI-2 transmitter interface operating up to 1.5 Gbps per lane. The sensor can operate at up to 88 frames per second (fps) at full resolution and typical power consumption is 145mW at 60 fps.