Artificial Intelligence Debut: Geely's Car Cabin Now Controlled by AI Agents
Geely Auto and Chinese AI startup StepFun have unveiled the next-generation Agent OS intelligent cockpit at the 2025 World AI Conference in Shanghai. This AI-powered car cockpit is set to revolutionise the in-cabin experience, making it more natural, human-like, and emotionally engaging.
The Agent OS, an intelligent cockpit developed through a collaboration between Geely Auto and StepFun, is based on StepFun's Step-Audio end-to-end voice large language model. This foundation enables ultra-natural, human-like, and emotionally rich voice interactions.
One of the key features of the Agent OS is its ability to accurately capture and understand users' current emotions. It can simulate real-life emotions and styles in conversations, dynamically adjusting its tone and manner based on the user's emotional state and semantic intent.
The Agent OS also boasts advanced memory capabilities. It remembers users' preferences, gender, age, and personalised information, allowing for tailored responses in future interactions.
Geely Galaxy's M9 hybrid SUV will be the first to feature this AI-powered cockpit, marking the industry's first deployment of an end-to-end voice large language model in a mass-produced car. The M9 hybrid SUV offers a more natural, human-like, and emotionally engaging interaction experience due to the Agent OS.
The Agent OS goes beyond typical voice assistants by providing richly contextualized, emotionally aware conversations with proactive care and companionship. It represents a milestone by fully integrating multimodal AI and emotional intelligence in a production automotive cockpit for the first time globally.
In addition to its emotional computing and memory personalization capabilities, the Agent OS also integrates multimodal large models and voice AI to provide multimodal fusion for ultra-natural interaction. It features integrated cloud-edge memory and human-machine co-piloting based on fully integrated maps, enhancing the in-cabin experience even further.
The unveiling of the Agent OS intelligent cockpit is a significant step forward in the automotive industry, bringing AI-driven interactions to the forefront of car cockpit design. With the M9 hybrid SUV, Geely Auto is leading the way in creating a more human-like and emotionally engaging driving experience.
[1] Geely Auto and StepFun Unveil Next-Generation Agent OS Intelligent Cockpit at 2025 World AI Conference
[3] Geely Galaxy's M9 Hybrid SUV to Feature Industry's First AI-Powered Car Cockpit
[5] StepFun's End-to-End Voice Large Language Model to Power Geely Galaxy's M9 Hybrid SUV
[2] The Agent OS, an intelligent cockpit developed through a collaboration between Geely Auto and StepFun, is set to revolutionize the sales of vehicles in the EV technology industry due to its advanced AI-driven interactions, such as emotional computing and memory personalization.
[4] With the integration of artificial-intelligence technology, the Agent OS is poised to transform the driving industry by providing a more immersive and emotional experience for users, rather than just focusing on traditional sales aspects like speed and fuel efficiency.
[6] By offering a more natural, human-like, and emotionally engaging conversation experience, the Agent OS has the potential to significantly increase customer satisfaction and, in turn, industry sales as more consumers seek out this advanced technology in their vehicles.
