Despite the increased prevalence and sophistication of automated emergency braking (AEB) in vehicles today, pedestrian fatalities are climbing. The US-based Governors Highway Safety Association (GHSA) estimates 6 200 pedestrians were killed in traffic accidents in the U.S. in 2018. This is the he highest total since 1990. The GHSA also found that during the past 10 years, nighttime crashes account for more than 90% of the total increase in pedestrian deaths.
Car manufacturers admit to situations where AEB or pedestrian collision avoidance systems are challenged. They include pedestrians in darkness, wearing white, being near walls, pushing a stroller and bending forward to name a few common scenarios.
How can AEB systems improve, especially in cases where visible cameras and radar are challenged? To solve this problem, automotive researchers and developers now consider multi-sensing solutions, including thermal cameras that ‘see’ heat energy. This is with layered levels of protection to ensure safety in all common driving situations.
Given that technology is advancing rapidly there are at least four reasons why tech – such as thermal imaging cameras – can improve existing AEB systems to save lives:
- Thermal cameras add a layer of protection where existing technologies fail
Thermal cameras detect and measure an entirely different wavelength of energy compared to other sensors. Long-wave infrared (LWIR) radiation, or thermal radiation, is part of the electromagnetic spectrum that is given off, absorbed or is reflected by everything warmer than 0 Kelvin (-273°C). This constitutes basically everything on earth.
Thermal cameras ‘see’ equally well in daylight, in total darkness, or in blinding sun glare. They work significantly better than visible cameras in smoke or in inclement weather such as fog. Additionally, they are particularly adept at detecting body heat, even pedestrians in a cluttered roadside background.
- Thermal cameras provide more time for AEB Systems to take appropriate action
Machine learning datasets can be used to train algorithms to not only detect an object but also classify the shapes. This can let the system know that the object is potentially a pedestrian along with an associated algorithm confidence level. Thermal cameras can detect and classify a pedestrian on the roadway up to four times farther than the illumination distance of a typical car’s headlights. This provides more time for an AEB system to identify and react to a potentially dangerous roadway situation. They provide additional assurance that an object is what the system thinks it is – day or night.
Annotated thermal datasets are available that include people, dogs, cars, bicycles and other vehicles.
- Thermal cameras improve a vehicle’s overall automated decision-making process
Existing automotive AI programs paired with visible cameras struggle with equitable predictive performance of pedestrians with different skin tones. Researchers at Georgia Tech University found that pedestrians with darker skin are at greater risk of being missed using the AI systems they evaluated versus those with lighter skin. Thermal cameras are unaffected by this recognition bias because they instead detect body heat. Skin tone is inconsequential for thermal.
- Thermal imaging is a proven automotive technology
A common objection to greater deployment of thermal cameras is technology maturity and hardware cost. FLIR thermal sensors exist within automotive-qualified systems though tier-one automotive supplier Veoneer, on more than 600 000 primarily luxury vehicles. These thermal cameras are used for a passive early-warning system where the driver is alerted visually or audibly of potential hazards on the roadway ahead. The next step in this evolution is to connect these cameras to existing AEB systems to make them even more effective and useful for drivers.
The adoption of thermal cameras for collision-avoidance systems remains in its infancy. However, where split-second action can be the difference between an accident and near miss, adding thermal cameras to AEB systems can’t wait. Furthermore, as adoption and manufacturing scale grows, costs will decrease, making thermal sensors increasingly more affordable for all AEB systems.
Click here to read more MasterTips
