编程知识 cdmana.com

Uccloud intelligent big data platform USDP launched to help enterprises quickly build big data services

Under the head effect of the Internet market , Enterprises are facing more and more competitive pressure , How to effectively solve the high cost of customer acquisition 、 Low user stickiness 、 Weak liquidity and other issues , It is the original intention of more and more enterprises to build big data platform .

But because of the complexity of the components involved in big data solutions 、 The technical threshold is high , And the initial investment of resources and later maintenance costs are larger , It is a great test of enterprise's big data platform construction and operation and maintenance ability . therefore ,UCloud The big data team recently launched the big data intelligent platform (UCloud Smart Data Platform, Hereinafter referred to as" USDP) , It aims to help enterprises quickly build big data analysis and processing platform , And centralized management of big data clusters , So as to reduce the enterprise's big data development 、 Maintenance cost .

One stop big data intelligent management platform

USDP It is to help enterprises build cloud hosted one-stop big data collection 、 Storage 、 analysis 、 Intelligent platform for application and operation . The product architecture is as follows :

As can be seen from the above figure ,USDP Is built on UCloud Public cloud IaaS Based on basic resources , Provide Hadoop Ecological service system , Such as HDFS、Hive、HBase、Spark、Flink、Presto、Atlas、Ranger And many open source big data service components , And configuration management of these components 、 Monitoring alarm 、 Fault diagnosis and other intelligent operation and maintenance management , So as to help enterprises quickly build the analysis and processing capacity of big data .

User access USDP Convenient and rapid deployment of various services and components in big data cluster , And centralized operation and maintenance of these components . And in the process of deploying services and components ,USDP The whole process can be fully automated , Greatly reduces deployment costs .

meanwhile ,USDP The real-time monitoring view and alarm strategy integrated in can help the operation and maintenance personnel to obtain abnormal alarm information in time , Quickly locate and troubleshoot problems .

besides ,USDP Highly integrated Hadoop Services and components in Ecology , And it's all based on Apache Version complete adaptation , No deep modification , Therefore, users need not worry about the problems caused by the use of service components API Incompatibilities , There is no need for users to worry about being wronged Apache It is bound by a service framework other than the open source protocol .

Lightweight 、 Big data for automatic operation and maintenance “ The housekeeper ”

USDP As pure localization 、UCloud Self developed big data management service , It can be realized on the cloud 、 Convenient and unified interaction under the cloud , Its specific characteristics are as follows :

  • Comprehensive component support

Based on an open management architecture ,USDP Integrated 30 The remaining open source big data components , Covering data integration 、 data storage 、 Calculation engine 、 Task scheduling 、 All aspects of big data processing such as permission management , The most comprehensive in the industry . Enterprises can according to their own business characteristics and needs , Select the corresponding components to build your own big data processing platform .

  • Perfect monitoring and warning mechanism

From years of big data operation and maintenance experience ,USDP Perfect monitoring and alarm templates are preset for each component , Rich monitoring indicators and flexible alarm mode , Help users to master the running status of each component in time , Carry out necessary maintenance and optimization . meanwhile , Intelligent fault diagnosis tools and professional technical support team , For the stable operation of big data cluster .

  • Visualization workflow UDS

UDS(UCloud Data Studio) Is a UCloud Self developed lightweight 、 Distributed 、 Extensible visualization DAG Workflow task scheduling system . Through drag and drop workflow development IDE, Simple Web Drag and drop operation to complete the task development of the whole big data workflow . Built in rich processors , Diverse mission support :Shell、Python、Hive、Spark、MR、SQL、 Sub processes, etc .

UDS Provide visual process definition capabilities , It can provide high-speed and stable data integration capability for a large number of heterogeneous data sources , And in the synchronization process to achieve the data ETL operation .

  • Safe and stable

Public cloud USDP The underlying resources of are exclusive to users , The cluster is located in a separate virtual private network , Effective security isolation is achieved . meanwhile ,USDP The integrated components are compiled from Apache Community stable version , After rigorous compatibility testing and stress testing , Key components support high availability features , Ensure the stable and reliable operation of the cluster .

  • Flexible and easy to use

For big data application scenarios , Public cloud USDP It offers a wide variety of models ( Big data physical machine 、 General virtual machine 、 Kuaijie virtual machine, etc ) For user selection , And combined with the elastic scalability of public cloud , Effectively control the actual use cost . Wizard like operation process and perfect scene case , Help users get started easily .

  • Support privatization deployment

USDP Except for UCloud Public cloud IaaS Integrate , It can also be deployed as an independent big data component management platform in a privatized data center , And compatible with virtual machines 、 Physical server environment . Provide big data platform services consistent with public cloud experience for customers deployed in privatization .

UCloud Also available based on USDP Software and hardware integrated delivery solution , Pre installed USDP service , Realize the big data platform management service of plug and play .

Typical application scenarios

1、 Data warehouse At present, the most commonly used data warehouse model in China is dimension warehouse , According to the fact table 、 Dimension table to build data warehouse 、 The data mart . In this system , Dimension is the angle of describing facts , Such as date 、 Customer 、 Suppliers, etc , The fact is the measure , If the number of customers 、 Sales, etc . adopt USDP, Users can deploy all the services needed to build a dimensional Repository , The middle platform helps enterprises build data quickly .

2、 machine learning In machine learning , There's a lot of demand for computing , adopt USDP Medium Spark、Flink The framework of distributive operations , With official algorithm or self-developed algorithm , The machine learning development can be carried out with half the effort . meanwhile , In the field of deep learning , A lot of data needed for modeling , It can also be stored in HDFS, So as to realize one-stop development .

3、 Real time computing You can use USDP Medium Kafka、Flink、Spark Streaming Real time processing of data , To meet real-time risk control 、 Real-time recommendation 、 Real time log analysis 、 Real time click and other scene requirements .

summary

Big data era , Data as the core production factor of enterprises , Its hidden business value cannot be separated from the deep mining of big data technology , and USDP The launch of big data is just to solve the high cost faced by enterprises in building big data solutions 、 High tech threshold, etc , Help more enterprises quickly build big data services , Fully unleash the business value of data productivity .

版权声明
本文为[Cloud computing]所创,转载请带上原文链接,感谢
https://cdmana.com/2020/12/20201224104311352c.html

Scroll to Top