编程知识 cdmana.com

Fusioninsight creates hard power for Huawei cloud big data

Abstract : stay IDC2020 Big data report , There are cloud service providers 、 Tradition ICT manufacturer , And three types of enterprises in the era of big data “ The player ”, Why Huawei cloud stands out ?

In recent days, ,IDC Release 《IDC MarketScape: China big data management platform manufacturer evaluation ,2020》 The report . The report from the ability 、 market 、 The three dimensions of strategy comprehensively evaluate the mainstream big data manufacturers in China , The report shows that Huawei's cloud is in “ The leader (Leaders)” quadrant , And in the market share and technical strength of two dimensions of double lead .

You can see , stay IDC Big data report , There are cloud service providers 、 Tradition ICT manufacturer , And three types of enterprises in the era of big data “ The player ”. Why Huawei cloud stands out ?

Interpretation of Huawei cloud FusionInsight Smart data Lake five hard core capabilities

according to the understanding of , Hua Wei Yun FusionInsight The five hard core capabilities of smart data Lake highlight innovative technologies .

Hard core capability one : Let government and enterprise customers in a big 、 fast 、 melting 、 Sustainable evolution under a stable data Lake Architecture !

Big : Traditional big data single cluster expansion is limited , It tends to expand to 2000 Nodes are hard to break through , Hua Wei Yun FusionInsight Break through the bottleneck of scalability through large clusters , Maximum support 2 ten thousand + Big cluster of nodes , The cluster federation can also be infinitely expanded . This large-scale feature has been practiced in Huawei , Huawei cloud process IT adopt FusionInsight structure OneData Big data cluster , It's on the scale of 1 ten thousand + node , Support the operation analysis of each department 、 Big data analysis such as ad hoc query , The daily new data is nearly 100TB,10 10000 meters , Ad hoc query task daily average 1 ten thousand +, Batch jobs every day 10 ten thousand +. Huawei process IT OneData Large clusters have undergone two rolling upgrades , Business 0 interrupt , It has been running steadily for six years .

fast : Because the amount of data is still growing exponentially , People's ultimate pursuit of efficient big data processing is endless ! Traditional big data has a long analysis link , With T+1 After the event reports mainly . Hua Wei Yun FusionInsight MRS can T+0 Real time updates and increments OLAP, Let big data be used more and more ” fast “! Huawei group IT be based on FusionInsight, Realized CDC+FLINK Real time integration solution of , Supporting the main deal 、 Finance and economics, 、 The incremental integration model of supply and other transaction data was implemented , Compared with the traditional warehouse ETL+ Scheduling plan , The efficiency of data supply has been improved 10 times .

melting : Traditional big data analysis faces many types 、 Spread out 、 It's difficult to coordinate ;FusionInsight adopt HetuEngine Achieve five major integrations , Unified SQL The interface is simple SQL It can be operated PB Level data , All the people BI, Make big data easier to use . A line is based on FusionInsight Building financial big data , adopt HetuEngine Unified SQL Interface , Solve data dispersion , There are many components 、 Many languages and so on , Lower the threshold of technology development , Cross source, cross domain and cross engine fusion analysis , Data is free of relocation , Lower the whole TCO.

steady :FusionInsight It can guarantee the continuity of one enterprise and one lake , Online rolling upgrade , Business is always online , There is no need to dismantle the cluster 、 Move the application , Thoroughly solve the problem of traditional big data cluster 、 Low efficiency 、 Difficult to manage 、 It's hard to upgrade , Keep key business uninterrupted during the upgrade process , Ensure business continuity . An operator uses FusionInsight Build a big data platform to deal with 5G Data surges , The smooth evolution of big data platform has been realized through two rolling upgrades , Achieve business without interruption , Upgrade no perception , The user experience continues to be online , The scale of single cluster has been expanded to 1500+ node , It supports all kinds of government affairs 、 tourism 、 Targeted poverty alleviation and so on 200+ Big data application services , Cover users 1.3 Billion +.

Hard core capability two : Real time data Lake

In order to achieve real-time , Hua Wei Yun FusionInsight A real-time data lake is proposed , Support real-time batch data into the lake 、 Real time incremental synchronization , Total data supply efficiency T+0; It can analyze the source data in real time and multi dimensionally , Shorten the analysis link , Improve analysis efficiency , Keep the value of data close at hand !

Hard core capability three : Cloud native data Lake

In recent years , Cloud nativity is a key technological innovation in the field of cloud computing , Huawei cloud has been exploring the cloud native field for many years , adopt Data Lake Catalog Data Lake catalog , Provide unified metadata service for large scale analysis engine , Make data globally visible and available ; In terms of data storage , adopt OBS The separation scheme of storage and calculation , Implement the calculation 、 Storage capacity expansion on demand , enterprise-level EC Achieve the minimum 1.2 copy , The overall TCO falling 20%+, Let the data every bit Better cost .

Lake provides interactive analysis engine , Seamless docking BI Reporting and self-help analysis , Realize the second level usage , Data is free of relocation ; Unity in the lake SQL Interface , Lower the threshold of technology development , Simplify the use of numbers , Realize the technology-leading cloud native data Lake .

Hard core capability four : Enterprise data warehouse

Hua Wei Yun FusionInsight Provide customers with the basis of Shared-Nothing Architecture provides a new generation of open 、 Full scenario analytical data warehouse DWS, Support 2048 Node scalability ; Multi level full parallel computing engine , It can schedule massive computing resources , Through efficient instruction efficiency , Realize data import and analysis ; With multi-level disaster recovery capability , Stable and reliable , offline 、 Semi online 、 Online expansion technology , Deal with various expansion scenarios calmly .

Hard core capability five : One stop data Lake Management Center

Hua Wei Yun FusionInsight Provide one-stop data Lake Management Center for customers , Help enterprises quickly build from data access to analysis E2E Data governance system , Unified data standards , Accelerating data capitalization . Unify information architecture through global data view , Unified data standards ; Through the one-stop full stack platform to achieve 30+ Efficient data integration of heterogeneous data sources ; It has an open and complete security system , Data classification , Unified security authentication .

Through the above five “ hardcore ” Capacity enhancement , Hua Wei Yun FusionInsight The next generation of data Lake , Let big data use faster and faster 、 The easier it is to use 、 The more used, the more stable 、 The more you use, the less you need !

Is the technical product good , Use cases to talk about

in fact , Hua Weiyun, this kind of “ Stability first ” The performance of the , It is also reflected in many authoritative lists , For example, China's big data enterprises listed by the Ministry of industry and information technology for four consecutive years 50 strong , Three years in a row Gartner Magic Quadrant for Data Management Solutions for Analytics, In China, the manufacturer ranks first .

While the technology is recognized by the authority , Hua Wei Yun FusionInsight It's also “ The most knowledgeable ” Big data solutions for . By 2020 year 6 End of month , Huawei cloud big data has already served 60+ Countries and regions 、3000+ Customer , Cover the government 、 Finance 、 Operator, 、 Electric power 、 Medical care 、 manufacture 、 Internet and many other industries .

In the field of government , At home 50% All smart cities have Huawei cloud FusionInsight The indefatigable figure of , Huawei cloud big data has supported the construction of many ministries, provinces, cities and regions “ big data + government affairs ”.

In a city , Hua Wei Yun FusionInsight Joint partners build “ One cloud, two networks and three platforms ”, Under the guidance of unified logic model of government data , For people's livelihood 、 industry 、 Governmental “ Pain points ” and “ difficulty ”, Start with the construction of urban data resource database , Support the government's intelligent decision with big data analysis , To build smart applications as the starting point , Break the information island , Realize the exchange and sharing of information resources , stay “ Gather together to benefit the people ”、“ A few gather together to develop business ”、“ Good governance ” Three aspects , Play the power of big data , brace “ A no. 、 A window 、 A net ” E-government services , Let's streamline administration and decentralize power 、 People run business “ Run once at most ” Become reality .

In Finance , At home 50% Of TOP20 Financial customers ( Including banks 、 negotiable securities 、 Insurance etc. ) Huawei cloud has been used FusionInsight Build its big data platform . A certain bank uses Huawei cloud FusionInsight Building a big data basic platform , Supporting the bank enterprise data Lake 、 Data warehouse 、 Group information base is the core of “ Two lakes ” Building , It carries the business system of the head office and each sub branch , Support the daily bank BI、AI、 data mining 、 Data analysis, etc , A global availability of data is realized , Exempt from data relocation , Enhance collaborative efficiency 10 times , Storage cycle improvement 2 times , The maximum utilization rate of resources can reach 90%, Accelerate the process of digital transformation of banks .

In the field of operators , The three major domestic operators all use Huawei cloud FusionInsight Build its big data platform . Guangdong Mobile is based on Huawei cloud FusionInsight, We will work together with government and enterprise customers to build a smart grid 、 Intelligent transportation 、 Smart port 、 High definition video series benchmarking applications , Get through the data lifecycle link , Realize internal business support 、 External application enabling , It supports all kinds of government affairs in an all-round way 、 People's livelihood and other big data application services .

In the field of transportation , Shenzhen Metro is in 6、10 Huawei cloud is adopted for line 1 FusionInsight Big data analysis platform , Build the leading 5G+ Big data solution , And build its data asset center and operation monitoring center , Carrying the subway business system , Support equipment health 、 Energy management 、 Passenger flow statistics 、 Line center level monitoring 、 Line level data analysis such as emergency decision and image fire analysis , The efficiency of data analysis is reduced from weekly level to minute level , Achieve efficient operation , Push Shenzhen into a better era of fully connected digital rail transit …

And in terms of environmental protection , Qinghai green energy data Co., Ltd. is based on Huawei cloud FusionInsight It has built the first energy big data innovation platform in China , The planning assistant decision is realized 、 Scientific guidance of meteorological data for power generation and other innovative business , For the upstream and downstream industry chain enterprises to provide 25 class 47 Data services , Push 28 New energy stations have realized “ No one on duty 、 Few people are on duty ”, And effectively supported Qinghai “ Green electricity 15 Japan ”, Based on big data , Building a green new Qinghai , Protect the plateau harmonious ecology .

meanwhile , Huawei insists on “ Your own parachute, jump first ”, Huawei group IT adopt FusionInsight structure OneData Big data cluster , Realize the development of big data platform in large-scale scenarios ,OneData The scale of the cluster has reached 1 ten thousand + node ; meanwhile , Realize a unified data management service , In the Bodhi sea UniDB In the product , Through logical unification , hold 50+ Physically distributed computing clusters (Hadoop+MPP), Based on the Five Unities ( Data security , Metadata catalog , Data integration , The data access , Task scheduling ), Integrated into the structure of the lake warehouse , Supporting thousands of business tenants PB Level data analysis and processing requirements . One is based on FusionInsight MRS+DWS Of “+ government ,+AI,+ operating ,+ cloud ” The converged data base of ( Bodhi sea ) Already in Huawei Group IT Widely used , Future period !

These are just “ The tip of an iceberg ”, Hua Wei Yun FusionInsight On the one hand, we will continue to understand the growing business demands of customers , On the other hand , Continue technological innovation and lead the development of the industry , Business appeal + Technological innovation two wheel drive industry sustainable 、 High quality development ,“ Usage ” Help our customers succeed in business ! The above argument has fully proved that , HUAWEI cloud is “ Know how ” Big data leaders of , Let the customer use the number well 、 Take care of the numbers 、 Don't worry !

Hard foundation is the real hard truth

You can see , Whether it's technical strength or market performance , Huawei cloud has become the first in the industry .

that , In the face of the existing achievements , Can Huawei cloud “ You can keep it ”? This aspect , Judging from the existing actions , Besides the main feature of differentiation , There are three competitive advantages for Huawei cloud to maintain its position .

1. Long term technology precipitation

Hua Wei Yun FusionInsight Big data from 2009 I've been doing research since , As early as 2014 Commercial products were launched in , Now? ,MRS“ Big fast and steady ” Cloud native data Lake 、DWS Enterprise data warehouse and one-stop data Lake governance center 3 These hard core capabilities are built on such a long-term accumulation , The lack of technology accumulation and understanding of the platform is obviously unable to complete such an upgrade .

2. To the industry 、 For business 、 Understanding the reality of the enterprise

Big data services must be built on the basis of deep business understanding , And it's not something that can be done overnight , It needs constant exploration and running in . Huawei's market first is a result of competition , It also represents the broadest and most in-depth business practice opportunities .

3. Rich and profound ecological cooperation

The present , Huawei cloud has accumulated a group of partners in the fields from infrastructure to analysis and application , Including multiple industries 800+ISV etc. , Now? , It provides partners with 100+ to open up API Interface , The application of big data brought by ecological technology will be more abundant .

You can see , All three need the advantages of time and experience , Let Huawei cloud big data have both deep and wide competition “ The moat ”.

Click to follow , The first time to learn about Huawei's new cloud technology ~

版权声明
本文为[Huawei cloud developer community]所创,转载请带上原文链接,感谢

Scroll to Top