A new era of in-car interaction starts now!
With the power of LLMs, the in-car experience is evolving into something smarter, more intuitive - and fully agentic.
🎙️ Listen in as Nils Schanz, EVP, Product & Technology, shares the story and technical vision behind Cerence xUI™ - our new conversational AI assistant platform - with Melanie Hörmannsdorfer, Senior Marketing Manager.
Stay tuned for Part 2 👀
#WeAreCerenceAI
Cars today become more and more digitally complex. User interfaces today are fragmented. They often offer different but also sometimes overlapping experiences. Most incar experiences rely heavily on touch screens. Is just leading to a cognitive overload. As an industry, we have really reached an inflection point in vehicle interaction. Paradigm must be reevaluated. That's exactly where XUI comes in. It's intuitive, it's flexible. Think of as being the quarterback in the whole system. Yes, thanks so much for taking the time today and sitting down with me and chatting about Serene XUI, our fully agentic LLM based AI assistant platform. What inspired the development of Serene XUI and also what sort of problems have you maybe heard from our automaker customers to solve for? Yeah. We see that cars today become more and more digitally complex. We've been hearing that a lot from our automaker customers that basically they see their end users struggling with these systems and also facing a lot of challenges with the user interaction. I believe there are a lot of different reasons for it, but mainly the most important ones are really that the user interfaces today are fragmented. So we see this inbuilt systems from the OEM. We see also projection modes like Apple. Power Play or Android Auto and they often offer different but also sometimes overlapping experiences and this can be very confusing for the end user. Plus, most in car experiences rely heavily on touch screens which demand a lot of visual attention, which can also be distracting. Um, and 3rd point is also that the increasing number of features and capabilities and services the OEMs put into the systems is just leading to a cognitive overload and oftentimes really frustration with the end user. I can totally relate to that. I mean, imagine how many features I've never even touched before And also who has time to read manuals these days? Exactly. And looking a bit further into the future as autonomous driving and other technologies are coming into the car, the cabin. Is becoming a first base for the consumers. Who expect more natural and optimized experiences. Also there's a lot of change happening all at once. So I believe that as an industry, we have really reached an inflection point where the in vehicle interaction paradigm must be reevaluated. And that's exactly where XUI comes in. Serene XUI is an LLM based agentic AI platform. And it's really designed specifically for automotive use cases, which is different when you interact with a smartphone or any kind of a machine. It allows users to really communicate with the car and beyond in a very natural way and in a conversational manner. So it's intuitive, it's flexible. Users really can speak to it very normally as we speak here without needing remember specific commands or anything in the system. Is capable of and at the end it just minimizes driver distraction. So how does it all come together? What technologies are the foundation of XUI? Yeah, that's a great question. Syrinx UI is powered by our Multi LLM agentic platform with calm as its core and column stands for Serene Automotive large language model, which is basically a family of cloud and embedded language models specifically optimized for automotive tasks. Think of column as being the quarterback in the whole system, really orchestrating all the different agents, taking the user requests and making sure things are getting done. Yeah, each agent can access Serens hosted and for party content, and it can be augmented through Rec. So retrieval, augmented generation. This agentic architecture is really highly flexible and can also be tailored to the needs of the OEMs. Count is based. On open source models and fine-tuned and optimized with our proprietary automotive data set we have collected over the years and this is really giving us a unique edge. Another important aspect of XUI is allowing OEMs really to differentiate their system responses and the whole parent experience to their brand values, right? So we also use NVIDIA guard trailing technology. To ensure the system behaves as specified by the OEMs, including keeping drivers safe by really navigating around inappropriate commands and questions. And this is all part, let's say, of our commitment to deliver more flexible, scalable and really future proof solutions for our customers. Styrene AI. For a world in motion.
The integration of LLMs into in-car systems like Cerence xUI marks a significant shift towards more autonomous and context-aware user interfaces. This evolution not only enhances user interaction but also aligns with broader trends in AI-driven personalization and predictive analytics. I'm curious about how Cerence plans to address the challenges of real-time data processing and privacy concerns in such a dynamic environment. How do you envision balancing these aspects while maintaining a seamless user experience?
Impressive! Looking forward..