China
SAIC-Volkswagen Automobile Co., Ltd (SVW) is a Sino-German joint venture operated by SAIC and Volkswagen Group, and it is one of the oldest automotive joint ventures in China. In recent years, SAIC-Volkswagen attaches great importance to the digitalization market demand and continues to explore the use of new big data technology in new energy vehicles and telematics business.
New Energy Vehicle Monitoring Data Volumes Growing Rapidly
As the trend of connectivity and intelligence has become more apparent in recent years, SVW is also keeping abreast of market trends by increasing its investment in digital technology. However, with the rapid growth of NEVs, the volume and complexity of vehicle monitoring information has shown an exponential increase, presenting a huge challenge to the computing power, storage, transmission and application of data monitoring. At the same time, along with the further call by the state to share vehicle monitoring information of NEVs, SVW's existing data processing technology needed to meet the changing regulatory requirements as well as the growing volume and complexity of data.
Modernized Big Data Platform Helps Solve Massive Data Surge Problems
Against this backdrop, led by Xie Cong, Head of Big Data Platform at SVW Database, the SVW Big Data Platform team started to build a new platform for vehicle data monitoring based on big data technology in 2017 to empower the key business development of new energy vehicles. In 2022, SVW upgraded its data platform to Cloudera for further optimization of data storage and operation performance.
Cloudera helps to improve vehicle data storage and accounting capacity
After using Cloudera optimization, the SAIC-Volkswagen big data platform has seen an extremely significant improvement in its ability to store and calculate vehicle data. First, HBase storage space was reduced by about 73TB, saving 67% of space usage, which greatly improved the operational efficiency of its vehicle data monitoring; second, the total cluster file count was reduced by about 80 million, optimizing the original file count by about 75%. In addition, significant performance improvements were realized in the cardio reporting and batch operations, with batch job performance increasing by 2.5 times on average and up to 6.6 times. These performance upgrades ensure that SVW's vehicle monitoring data chain can be completely stored and analyzed in detail, and fully meet the requirements of national vehicle data management laws and regulations. In addition, based on this data platform, SVW has also built the SAIC Motor application, which brings smarter automobile services to customers, including remote checking of real-time vehicle status, intelligent navigation services, etc. The platform has reached 6 million users in less than two years since its launch.
Xie Cong, Head of Big Data Platform, SVW Database, said: "SVW had been implementing CDH in 2017 and built a data lake in 2018. In 2022, SVW successfully upgraded its data platform to Cloudera in just six months, becoming one of the first companies in the domestic automotive industry to do so. The vehicle data monitoring platform we built can easily realize massive data storage and perfect vehicle data monitoring and analysis; and this data will further help us better serve vehicle owners and promote the continuous development of our IoV business. As a mature big data platform, Cloudera has effectively helped us address the challenge of storing, managing and computing the ever-growing real-time data. We will work with Cloudera to further address storage-computing separation and the inconsistent growth rate of computing and storage for the best performance-resource balance based on the changes in workloads."
Looking ahead, SVW will continue to expand the adoption of more Cloudera features and utilize the advantages of a data lakehouse infrastructure to upgrade its data monitoring platform, laying a solid data-driven foundation for the continued innovation of intelligent connected vehicle services.
