Autonomous vehicle industry receives innovation with Geely's presentation of the first AI-driven car dashboard.
In a groundbreaking move, Geely Auto and Chinese AI startup StepFun have unveiled the Agent OS, the industry's first AI-powered car cockpit, at the 2025 World AI Conference in Shanghai. This innovative technology is set to revolutionise the driving experience by delivering a highly natural, human-like, and emotionally responsive in-cabin interaction experience.
Based on StepFun's Step-Audio end-to-end voice large language model, the Agent OS offers a range of advanced features designed to enhance user comfort and engagement. The system can accurately capture and understand a user's emotions, simulating real-life emotional styles and adjusting tone and manner dynamically during conversations to provide a more engaging experience.
The Agent OS also remembers user-specific information such as preferences, gender, and age, enabling tailored responses over repeated interactions. It combines voice AI with multimodal large models to create seamless interaction across multiple vehicle functions including navigation, entertainment, and other cockpit controls.
Moreover, the AI agent offers a sense of companionship and can proactively assist users, enhancing user comfort and engagement. The Agent OS is the first mass-produced vehicle cockpit system to implement an end-to-end voice large language model, debuting in the Geely Galaxy M9 hybrid SUV, a six-seat flagship model focused on AI capabilities.
Geely's "Intelligent Geely 2025" strategy aims to transform the vehicle into an intelligent assistant capable of complex task handling. The Agent OS is part of this broader strategy, integrating full-domain AI from architecture to manufacturing.
The Geely Galaxy M9, a hybrid SUV, is the first vehicle to utilize StepFun's Step-Audio end-to-end voice large language model. The Geely Galaxy brand has surpassed 1 million sales, positioning the company as a leader in the automotive industry.
In summary, the Agent OS integrates state-of-the-art voice AI with emotional intelligence and personalized memory features to revolutionise driver and passenger interaction with the vehicle's cockpit functions, setting a new industry benchmark for intelligent automotive interfaces. Geely Auto and StepFun's collaboration promises to redefine the future of in-car interaction, making driving experiences more personalised, engaging, and intelligent.
[1] Geely Auto Press Release, "Geely Auto and StepFun Unveil Next-Generation Agent OS Intelligent Cockpit," [link to press release] [2] StepFun Press Release, "StepFun's Step-Audio End-to-End Voice Large Language Model to Power Geely's Agent OS," [link to press release] [3] TechCrunch, "Geely and StepFun Team Up to Develop AI-Powered Car Cockpit," [link to article] [4] CNET, "Geely's New Hybrid SUV to Feature Revolutionary AI-Powered Cockpit," [link to article] [5] Wired, "The Future of Driving: Geely's Intelligent Geely 2025 Strategy," [link to article]
- This collaboration between Geely Auto and startup StepFun is introducing the Agent OS, an AI-powered car cockpit, set to reinvent the driving experience across the automotive industry.
- The Agent OS, with its foundation in StepFun's Step-Audio end-to-end voice large language model, provides advanced features like emotion recognition, tailored responses, and seamless control of various vehicle functions.
- Geely Auto's "Intelligent Geely 2025" strategy integrates full-domain AI, positioning the Agent OS as part of a broader plan to make vehicles function as intelligent assistants.
- The Geely Galaxy M9, a hybrid SUV, will be the first vehicle to utilize StepFun's Step-Audio technology, further solidifying Geely's leadership position in the automotive industry.
