Hive||beeline連線的InvalidURL

突突修發表於2018-03-09
Hive

今天在使用hive的client工具beeline時遇到了一個Invalid URL的錯誤。環境資訊如下：
hiveclient: bd23
hiveserver2: cloud011

hiveclient所在主機的jdk 1.7_51，hive 0.12和hadoop 2.3.0是從伺服器端拷貝過來的，環境變數一切OK.
執行連線報了Invalid URL的錯誤：
$ beeline
Beeline version 0.12.0 by Apache Hive
beeline> !connect jdbc:hive2://cloud011:10000
scan complete in 2ms
Connecting to jdbc:hive2://cloud011:10000
Enter username for jdbc:hive2://cloud011:10000:
Enter password for jdbc:hive2://cloud011:10000:
Error: Invalid URL: jdbc:hive2://cloud011:10000 (state=08S01,code=0)

開始的一段時間都在糾結這個jdbc的URL格式問題，後來在cloudra論壇上找到了一個方法,
直接呼叫的jdbc:hive2的驅動測試是正常的，證明CLASSPATH等環境變數沒有問題。

1
2
3
4
5
6
7
8
9
10
11
$ beeline –u jdbc:hive2://
scan complete in 3ms
Connecting to jdbc:hive2://
...
14/03/18 00:11:48 INFO HiveMetaStore.audit: ugi=bjdpi   ip=unknown–ip–addr      cmd=get_databases: default
14/03/18 00:11:48 INFO cli.CLIService: SessionHandle [f8c185f0–e491–4f8a–88fa–7f0be7089d23]: openSession()
14/03/18 00:11:48 INFO cli.CLIService: SessionHandle [f8c185f0–e491–4f8a–88fa–7f0be7089d23]: getInfo()
Connected to: Hive (version 0.12.0)
Driver: Hive (version 0.12.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 0.12.0 by Apache Hive

這時候感覺很可能不是客戶端的問題，矛頭指向伺服器端：

1
2
# netstat -lanp | grep 10000
tcp        0      0 127.0.0.1:10000          0.0.0.0:*                   LISTEN      24553/java

發現繫結的主機地址是localhost，而localhost的地址是127.0.0.1。這應該就是問題所在，從伺服器本地測試：

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
$ beeline
Beeline version 0.12.0 by Apache Hive
beeline> !connect jdbc:hive2://172.19.1.11:10000
scan complete in 3ms
Connecting to jdbc:hive2://172.19.1.11:10000
Enter username for jdbc:hive2://172.19.1.11:10000:
Enter password for jdbc:hive2://172.19.1.11:10000:
Error: Invalid URL: jdbc:hive2://172.19.1.11:10000 (state=08S01,code=0)
0: jdbc:hive2://172.19.1.11:10000> !connect jdbc:127.0.0.1:10000
scan complete in 0ms
scan complete in 1100ms
No known driver to handle “jdbc:127.0.0.1:10000”
0: jdbc:hive2://172.19.1.11:10000> !connect jdbc:hive2://127.0.0.1:10000
Connecting to jdbc:hive2://127.0.0.1:10000
Enter username for jdbc:hive2://127.0.0.1:10000:
Enter password for jdbc:hive2://127.0.0.1:10000:
Connected to: Hive (version 0.12.0)
Driver: Hive (version 0.12.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
1: jdbc:hive2://127.0.0.1:10000>

連線成功！

下面就要把引數改一下，然後重啟服務

1
2
3
4
5
6
<property>
  <name>hive.server2.thrift.bind.host</name>
  <value>localhost</value>
  <description>Bind host on which to run the HiveServer2 Thrift interface.
  Can be overridden by setting $HIVE_SERVER2_THRIFT_BIND_HOST</description>
</property>

重啟服務後檢查監聽地址，這次是正確的了。

1
2
SHELL$ netstat –lanp | grep 10000
tcp        0      0 172.19.1.11:10000          0.0.0.0:*                   LISTEN      24553/java

再次在客戶端主機上測試連線：

1
2
3
4
5
6
7
8
9
10
SHELL$ beeline
Beeline version 0.12.0 by Apache Hive
beeline> !connect jdbc:hive2://172.19.1.11:10000
Connecting to jdbc:hive2://172.19.1.11:10000
Enter username for jdbc:hive2://172.19.1.11:10000:
Enter password for jdbc:hive2://172.19.1.11:10000:
Connected to: Hive (version 0.12.0)
Driver: Hive (version 0.12.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://172.19.1.11:10000>

成功。

cloudra論壇上下面有個類似的錯誤：
cannot connect by beeline
http://community.cloudera.com/t5/Batch-SQL-Apache-Hive/Cannot-connect-to-beeline/td-p/5723/page/3
看來當beeline連線失敗的時候都會報這個invalid URL的錯誤，確實給定位問題帶來了不小的困難。


相關文章