Positioned as the most focused AI company in the automotive industry, SenseTime's Zhuoying is fully committed to advancing large models for vehicles.
On November 27, at the 2024 "Zhuoying Strength AI DAY," SenseTime Zhuoying comprehensively showcased its "Cabin-Cloud" integrated general artificial intelligence (AGI) product system and strategic layout.
“As a strategic partner accelerating the entry of smart vehicles into the AGI era, SenseTime Zhuoying will firmly grasp the time window of the new wave of smart vehicle transformation, engaging in comprehensive and in-depth cooperation with automotive partners. By sharing high computational power and large models, building data infrastructure together, and jointly creating innovative applications for large models in smart vehicles, we can achieve win-win outcomes and lead the way to the future,” said Wang Xiaogang, CEO of SenseTime Zhuoying, co-founder of SenseTime Technology, and Chief Scientist.
Wang Xiaogang, CEO of SenseTime Zhuoying, co-founder of SenseTime Technology, and Chief Scientist
SenseTime Zhuoying aims to give smart vehicles an “interesting soul,” achieved through cutting-edge AI large model technologies such as native streaming multimodal large models, in-car humanoid memory frameworks, and continuous operation frameworks.
For instance, in the smart cabin sector, SenseTime Zhuoying launched its industry-first innovative large model product, "A New Member For U" (Your New Family Member). According to the company, this product can fully perceive users' voice, expressions, gestures, and environmental data, allowing for deep understanding and reasoning capabilities, making it able to comprehend both the world and humanity. The first domestic "in-car humanoid memory framework" enables the system to exhibit human-like memory capabilities, granting vehicles their own "memories."
In terms of smart driving, SenseTime Zhuoying has built a "Vehicle-Cloud Integration" product matrix, releasing a comprehensive range of high-level smart driving products covering highways, urban areas, and parking, alongside end-to-end smart driving systems. Furthermore, they have upgraded their industry benchmark “Awareness” world model to establish a robust data infrastructure.
Wang Xiaogang revealed that the mass production delivery of SenseTime Zhuoying's smart driving solutions is progressing steadily. The smart driving solution based on the J6 platform is expected to be delivered in mass production by the second quarter of 2025, while the mass production of the end-to-end smart driving solution is anticipated to take place by the end of next year.
Currently, most automotive manufacturers and smart driving companies face challenges with the difficulty, inefficiency, and high costs associated with acquiring high-quality driving data. Wang Xiaogang believes that the competitive smart vehicle industry will inevitably experience a "battle of a hundred models," stating in an exclusive interview, "The arrival of the end-to-end autonomous driving era places the greatest value on data. Those who are closer to the data will hold the competitive advantage in the 'battle of a hundred models.'"
To get closer to the data, deep collaboration with OEMs is essential. In Wang Xiaogang's view, operating in isolation will make it challenging to stand out in the AGI era. OEMs and AI companies must engage in a new style of deep strategic cooperation to foster industry competitiveness. Reports indicate that SenseTime Zhuoying has signed strategic cooperation agreements with partners like Daizhuo Intelligent and Dongfeng Motor to engage in comprehensive deep cooperation across high-level smart driving mass production, end-to-end production, AI cloud services, and AI large models, accelerating the implementation and evolution of autonomous driving.
“Today, we can see that overall, smart driving is still some distance away from profitability. During the delivery process, if the resource and data tool chain are not aligned, it often leads to redundant investments. The ability to improve efficiency and achieve cost-effective delivery will determine who can go further,” Wang Xiaogang commented.
As of now, SenseTime Zhuoying's smart driving solutions have been mass-produced and delivered to three automotive companies, including GAC Aion and FAW Hongqi, across six vehicle models.
Third-party research data shows that SenseTime Zhuoying has maintained the top market share in the cabin visual AI software sector for five consecutive years. SenseTime Zhuoying has partnered with over 30 domestic and international automotive manufacturers, covering more than 100 vehicle models. By the end of 2024, cumulative mass production deliveries are expected to surpass 3.5 million vehicles.
Additionally, cabin AI large model products have been implemented in vehicles such as Xiaomi SU7, IM, and LEVC L380.