Improved Vehicle Data Management by Reducing Data Storage Space by 67%; Increased Data Collection Capacity and Boosted Batch Job Performance by 2.5 times
BEIJING, CHINA Sept. 18, 2023 - Cloudera, the data company for trusted enterprise AI, announced that it has helped SAIC Volkswagen (SVW) build a vehicle data monitoring platform to address regulatory requirements related to collecting and monitoring smart vehicle data for its Internet of Vehicles (IoV) business. SVW has realized significant performance improvements in core run batch operations since deploying the Cloudera Data Platform (CDP) for vehicle data monitoring operations. This has also reduced costs while optimizing efficiency in data operations by reducing storage space needs by 67%, which improves vehicle monitoring efficiency and helps to optimize management of vehicle data.
In recent years, with the rapid growth of New Energy Vehicles (NEVs), the volume and complexity of vehicle monitoring information has grown exponentially. At the same time, the Chinese government has put forward further calls for NEV monitoring and information sharing, which creates a need for better computing power, storage, transmission and application of the data monitoring related to vehicle enterprises.
Against this backdrop, the SVW Big Data Platform team started to build a new platform for vehicle data monitoring based on big data technology in 2017 to address key business development needs created by new energy vehicles. In 2022, SVW upgraded its data platform to the CDP to further optimize data storage and operation performance. First, HBase storage space was reduced by about 73TB, saving 67% of space usage, which greatly improved the operational efficiency of its vehicle data monitoring; second, the total cluster file count was reduced by about 80 million, optimizing the original file count by about 75%. In addition, significant performance improvements were realized in the cardio reporting and batch operations, with batch job performance increasing by 2.5 times on average and up to 6.6 times. These performance upgrades ensure that SVW's vehicle monitoring data chain can be completely stored and analyzed in detail, and fully meet the requirements of national vehicle data management laws and regulations. In addition, based on this data platform, SVW has built the SAIC Motor application, which brings smarter automobile services to customers, including remote checking of real-time vehicle status, and intelligent navigation services. The platform has reached 6 million users in less than two years since its launch.
Xie Cong, Head of Big Data Platform, SVW Database, said: "SVW has been implementing Cloudera's CDH since 2017 and built a data lake in 2018. In 2022, SVW successfully upgraded its data platform to CDP in just six months, becoming one of the first companies in the domestic automotive industry to do so. The vehicle data monitoring platform we built can easily support massive data storage and vehicle data monitoring and analysis; and this data will further help us better serve vehicle owners and promote the continuous development of our IoV business. As a mature Big Data platform, CDP has effectively helped us address the challenge of storing, managing and computing the ever-growing real-time data. We will work with Cloudera to further address storage-computing separation and the inconsistent growth rate of computing and storage for the best performance-resource balance based on the changes in workloads."
Wang Gang, Vice President of Cloudera Greater China, said, "At a time when the IoV market is evolving rapidly, considerable concern arises about data monitoring and management of intelligent vehicles from the government as well as private industry. How to store, manage and gain insights from Big Data is important for the development of car companies. It has been proven that the data platform built by Cloudera for SVW has helped SVW optimize all aspects of data storage and batch job performance as a solid basis for accelerated construction of the IoV ecosystem. We will continue to support SVW and enable data-driven development of new energy vehicles and IoV."
Looking ahead, SVW will continue to expand the adoption of more CDP features and utilize the advantages of a data lakehouse infrastructure to upgrade its data monitoring platform, laying a solid data-driven foundation for the continued innovation of intelligent connected vehicle services.
About Cloudera
At Cloudera, we believe data can make what is impossible today, possible tomorrow. We empower people to transform data anywhere into trusted enterprise AI so they can reduce costs and risks, increase productivity, and accelerate business performance. Our open data lakehouse enables secure data management and portable cloud-native data analytics, helping organizations manage and analyze data of all types, on any cloud, public or private. With as much data under management as the hyperscalers, we’re the preferred data partner for the top companies in almost every industry. Cloudera has guided the world on the value and future of data and continues to lead a vibrant ecosystem powered by the relentless innovation of the open source community.
Learn more at Cloudera.com.
Cloudera and associated marks are trademarks or registered trademarks of Cloudera, Inc. All other company and product names may be trademarks of their respective owners.