I've learned to take data from Sql Server Import to Hive DB, And in Hue Of Web The interface can be queried , The next step is to configure the client tool to connect directly to Hive database , Commonly used DbVisualizer、SQuirreL SQL Client、DataGrip, I only tried the first two , It took 1 It took more than a few days to connect these two tools Hive, I still have a sense of achievement .
Let's explain the environment first , Some problems are very dependent on the environment version .
Hadoop/Hive： It uses CDH 5.15 edition
SQuirreL SQL Client：v 3.7
The first thing I saw was the great God's article ,”Hive Way of learning （ 5、 ... and ）DbVisualizer configure connections hive“, After configuration, it is impossible to connect , Tips Required field 'client_protocol' is unset!,
Checked the , This is because jdbc And the server side Hive Of jdbc Caused by an inconsistent version , The server side uses CDH 5.15, I found the original CDH Installation package , stay cm-5.15.1\share\cmf\common_jars\ Path to find the corresponding version of the file , The main documents are as follows ：
These files can't be missing , Otherwise it will be reported ClassNotFoundException Such mistakes
Will these jar When you connect again after replacing the previous version file , Wrong again. , Tips Illegal Hadoop Version:unknown (expected A. B. * format)
This should refer to this link https://github.com/timveil/hive-jdbc-uber-jar To solve , The original take Hadoop Version method VersionInfo In some cases, you can't get , So this great God rewrites this method , It's a great man , I wonder why we don't submit this code directly to the open source library .
Return to the right topic , According to the above method, a hive-jdbc-uber-220.127.116.11-292 file , Copy this file to jdbc In the path of , stay Driver Manager I'm going to quote this again jar, Find or prompt the previous error “Required field 'client_protocol' is unset!”, The mistake is clear jdbc Version problem , Look at the next from github Download the project , Found out pom.xml There is the following paragraph in . Try to hive All the notes about , Package again to generate hive-jdbc-uber-18.104.22.168-292 file , This time it's a success .
DBVisualier Setting screen in
Query the data of a table after successful connection
use SQuirreL SQL Client You can refer to the basic steps of https://www.cnblogs.com/tgzhu/p/5760698.html, The same phenomenon , If hadoop/hive Of jar Inconsistent or missing versions , I'll report the same mistake as above , Therefore, it is also handled in the same way as above , The difference is , Generate hive-jdbc-uber-22.214.171.124-292 When you file , There is no need to hive Related reference notes for , I guess when there are multiple jdbc hive version ,SQuirreL SQL Client There's a special mechanism to find the right jdbc edition , but DbVisualizer You can't .
in addition SQuirreL Remember the steps when configuring , Be a newspaper Illegal Hadoop Version when , stay jdbc Driver We need to introduce hive-jdbc-uber-126.96.36.199-292, At the same time hadoop-common-2.6.0-cdh5.14.0 Remove the reference of , Just save it .
If Hive Configured with Kerberos Security mechanism , Using these two clients to connect will be a lot of trouble , reference https://community.hortonworks.com/content/kbentry/73458/connecting-dbvisualizer-and-datagrip-to-hive-with.html.
Big data self study 3-Windows client DbVisualizer/SQuirreL configure connections hive More articles about
- Big data applications Windows platform Hbase client Eclipse Development environment construction
Big data applications Windows platform Hbase client Eclipse Development environment construction Big data applications Windows platform Hbase client Eclipse Environment building -Java edition author : Zhang Ziliang copyright , Reprint please indicate the source Introduction ...
- Big data application log collection Scribe Installation configuration guide
Big data application log collection Scribe Installation configuration guide Big data application log collection Scribe Installation configuration guide 1. summary Scribe yes Facebook Open source log collection system , stay Facebook It has been widely used internally . it ...
- Through the database client interface tool DBeaver Connect Hive
Preface This article explains how to use the database client interface tool DBeaver Connect hive, And solve the problem that the driver can't download . 1. Why use client interface tools Why use the client interface tool instead of the command line hive View the analysis through the interface tool ...
- Big data self study 4-Hue Description of each module in the integrated environment
I've learned how to import data from a relational database into Hive/HDFS, And in Windows The client queries the imported data , Next, keep learning CDH, Knowledge point : 1.Hue Environment DB Query How to use ,DB Query This ...
- Big data self study 2-Hue Integrated environment Sqoop Component slave Sql Server Import data to Hive/HDFS
installed CDH after , I found that there were too many things in it , For a beginner of big data, it's like Grandma Liu entering Grand View Park , Very novel , Each of these things is enough to drink . The next step is to learn step by step , First, I roughly learned what each module is used for , ...
- centos6.5 Environment building openvp Server and windows Client building and configuration details
1. Environment building explain : vpn client 192.168.8.16/24 openvpn server: eth0: 192.168.8.41 eth1: 172.16.1.10 app serve ...
- Introduction to big data ：Hadoop install 、 Environment configuration and detection
Catalog 1. Guide pack Hadoop package 2. Configure environment variables 3. hold winutil Package copy to Hadoop bin Under the table of contents 4. hold Hadoop.dll Put it in system32 Next 5. testing Hadoop Whether it is installed normally 5.1 stay ma ...
- fifty-nine . big data 、Hadoop 、 Hadoop Installation and configuration 、 HDFS
1. install Hadoop Stand alone mode installation Hadoop install JAVA Environmental Science Set the environment variable , Startup and operation 1.1 Environmental preparation 1) The configuration host name is nn01,ip by 192.168.1.21, To configure yum Source ( System source ) To prepare ...
- stay windows The structures, IDEA + Spark Connect Hive Environment
For the convenience of development and testing , Want to be directly in IDEA Running in Spark Program , Can be connected Hive, If not after packing , Put it on a cluster and run it . The main configuration work is as follows : 1. Put... In the cluster environment hive-core.xml, hdfs- ...
- windows System installation MongoDB
I've been learning node.js,nodejs There is a microblog in the development guide web Development projects , Because the book came out earlier (2012 Out of ), So far, using nodejs Conduct web Great changes have taken place in the development of various composite technologies , For example, in the book ...
- Servlet working principle
Servlet The life cycle is divided into three stages : 1, Initialization phase call init() Method 2, Response to customer requests call service() Method 3, Termination phase call destroy() Method Servlet Initialization phase : stay ...
- Java Basic knowledge enhancement 37：StringBuffer Of the class StringBuffer Construction method of
1. StringBuffer Construction method of : (1)StringBuffer(): (2)StringBuffer(CharSequence seq): (3)StringBuffer(int capa ...
- SRM 599 DIV1
A First of all, we found that for 2 operation , Each prime factor can be considered separately , Then take out the answer with the most steps , And then we add the... For each prime factor 1 operation ; Step two I made a mistake , The best solution is to operate the prime factor index in binary system , stay 1 The location of the execution 1 operation ,0 Bit ...
- swiper Achieve touch slide
The need to introduce documents <link href="css/swiper.min.css" rel="stylesheet" type="text/css ...
- Find a c++ vector sort Of bug
There is a very strange problem in the development : I use vector Stored a set of data , And then call sort Method , Use the custom sort function to sort , But it's always a mistake , Print the values participating in the sorting in the sorting function , Found null values , And it's the same data every time ...
- VMware10 Virtual machine installation mac os x 10.9
More and more friends buy mac notebook , Constantly tempting Xiaobian , I've been thinking about buying one recently mac The book is full of force , Later I thought about developing ( Not ios) There may be all kinds of problems , Just play on the virtual machine first , After all 1,2 ten thousand RMB It's not a decimal . stay mac os ...
- Android Performance testing ——Allocation Tracker(Device Monitor)
Android Performance testing --Allocation Tracker(Device Monitor) Allocation Tracker What can be done ? Track memory allocation information , In order , So that we can see something clearly ...
- JAVA Increase by 14 ：HashSet In depth analysis
We introduced HashMap,Hashtable, Then there's another one hash family , That's it HashSet; In the interpretation of the HashSet front , The first thing you need to know is HashSet Is the interface to a single valued set , That is Collection Below ...
- <iframe> and <frame> difference
1.frame Can't get away from frameSet Use alone ,iframe Sure 2.frame Can't put body in , Otherwise, it cannot be displayed normally frame Unable to join body Use at the same time <!--<body>--> ...