The collaboration between SnT and IEE

IEE is a global leader in automotive sensing technology. Based in Bissen (Luxembourg), the company has built its reputation on developing cutting-edge sensors that make vehicles safer and smarter. They’re known for their seat belt reminder sensors and BodySense system, which enables smart airbag deployment based on whether an adult or a small child in a car seat is detected. When IEE identified the need for a new type of safety sensor, they knew they needed strong research backing to create something truly groundbreaking.

The company chose to partner with SnT because of its deep expertise in signal processing and sensor technology, and its unique Partnership Programme. Once both partners defined the scope of the project, SnT found a doctoral researcher whose expertise aligned perfectly with the project’s needs: Gabriel Beltrao. He joined the Signal Processing Applications in Radar and Communications (SPARC) research team, where he and his colleagues dedicated themselves to solving IEE’s challenge. Both organizations shared a clear vision: to harness technology to save lives.

The partnership model proved ideal. SnT researchers worked directly in IEE’s labs, using their testing facilities and equipment. Teams met regularly, shared insights, and solved problems together. This close collaboration sparked new ideas and accelerated innovation. What started as a focused project soon grew into a long-term partnership that continues to explore new applications for their shared technology.

The challenge: detecting children left in cars

The statistics paint a troubling picture: in the United States alone, approximately 37 children die each year from heatstroke after being left in vehicles, with more than 1,000 deaths reported over the last 25 years. The social consequences for affected families are devastating, often carrying a significant stigma despite research showing this can happen to anyone, regardless of their level of responsibility or care.

The technical challenge was multifaceted. The solution needed to:

• Detect even the smallest movements of a child, including breathing patterns

• Work through obstacles like blankets and car seats

• Distinguish between a child’s presence and other moving objects

• Function reliably in various weather conditions, such as rain or hail

• Avoid false alarms that might lead users to ignore the system

As IEE became aware of this troubling data from the United States, the company immediately started exploring solutions. They tried different technologies: cameras, thermal sensors, and vibration detectors. But many technologies had significant limitations.

Camera-based systems, for instance, couldn’t detect children behind sunshades or blankets, while other technologies struggled with accuracy and reliability.

The solution: radar technology

But around 2010, IEE’s CTO made a surprising discovery. Using a basic radar kit, he found he could detect a child’s breathing pattern. This spark of insight opened up new possibilities. Radar showed promise – unlike cameras, it could penetrate blankets and car seats and sense the tiniest movements.

The research partnership explored this idea further. SnT researchers contributed their knowledge in fundamental research and offered algorithmic solutions to IEE engineers to address the novel challenges towards exploiting the opportunities.

One major challenge was that radar signals bounce differently inside each car model. The interior geometry of vehicles varies greatly, affecting how radar waves reflect. Gabriel Beltrao and his IEE colleagues helped refine algorithms that adapt to different car models. They recorded extensive data for each vehicle type and used it as a reference point for the detection system. They also created special algorithms to handle tricky conditions, like telling the difference between rain noise and a child’s breathing.

The team’s creativity showed in their testing approach. They needed a consistent way to test their system. Their solution? A technician went to a toy store and bought dolls. They turned these into test dummies that could mimic human breathing and how human bodies reflect radar signals. This breakthrough helped them fine-tune their system. By 2014, they had their first working prototype.

At its core, VitaSense works by transmitting radar signals that reflect off objects in the car. These signals can pick up the tiny movements of a child breathing. The team chose to use 60 GHz radar – something no one had put in a car before. This turned out to be the key to making the system both sensitive and reliable.

Making an impact: changing industries and saving lives

The journey from concept to market implementation faced several challenges. Initial attempts to bring the technology to market in 2016 were met with hesitation, as manufacturers were cautious about introducing such a novel feature for a problem that wasn’t widely recognized at the time.

However, persistence and robust validation processes eventually led to success. The breakthrough came when Hyundai Kia Motor Company became the first manufacturer to implement the technology in their Genesis G70 model in 2020. The implementation process included:

• Extensive testing across different vehicle models

• Development of 3D models for each car’s geometry

• Recording and analysis of data in various environmental conditions

• Creation of algorithms to handle specific challenges like suppressing vibrations

• Rigorous validation to ensure minimal false alarms

VitaSense has changed the automotive safety landscape. It was the first radar-based child detection system ever used in car cabins worldwide. Today, over half a million vehicles have this life-saving technology installed. Major car makers, such as Hyundai, Kia, and Genesis have embraced the system in their vehicles.

The industry has taken notice. The project won the Luxembourg Federation of Industry Innovation Award and the CLEPA Innovation Award in 2016. It was also named a finalist in the prestigious PACE awards, a rare honour in the automotive world.

Perhaps the strongest sign of success came from Euro NCAP, Europe’s leading car safety assessment program. They now award safety points for child detection systems like VitaSense. Cars can earn up to four points for these systems as of 2023. The score will increase to five points in 2026. For car makers chasing top safety ratings, VitaSense has become a key technology.

Looking ahead

The success of VitaSense has opened new avenues for research and development. The partnership between IEE and SnT continues through the DISCO (Distributed and Collaborative Sensing) project, exploring expanded applications of the technology. Future developments include:

• Enhanced vital sign monitoring capabilities
• Potential medical applications
• Post-crash vital sign monitoring
• Integration of multiple sensor systems for improved detection
• Exploration of collaborative sensing principles

The SPARC Team at SnT have set up a radar lab in 2018 to test and finetune their research. “Our researchers currently work on multiple projects in this lab, several of them in collaboration with IEE. Novel applications bring novel challenges, and we are looking forward to solving these”, says Bhavani Shankar who leads this Research Group.

The partnership between IEE and SnT demonstrates how academic-industry collaboration can drive innovation and create solutions that not only advance technology but also save lives. As vehicle safety requirements evolve and new applications emerge, this collaboration continues to push the boundaries of what’s possible in automotive safety technology.

—

The Signal Processing Applications in Radar and Communications research group (SPARC) conducts research on enhancing radar performance through digital signal processing, and integrated sensing and communication. Applications range from automotive radars to future uses of radar signal processing in areas like biomedicine and environmental sensing.

IEE provides a variety of sensors for vehicle safety and comfort, assisted/automated driving and components for battery management. Based in Bissen, Luxembourg, IEE launched the world’s first in-cabin radar sensor – VitaSense – to detect unattended children. The company gathers 4.100 employees around the Globe, with a strong focus on R&D.