sqoop匯出hive資料到mysql錯誤ava.util.NoSuchElementException解決辦法
sqoop錯誤日誌:
14/05/08 12:25:40 INFO mapred.JobClient: Task Id : attempt_201405071437_0013_m_000000_0, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.util.NoSuchElementException
at java.util.ArrayList$Itr.next(ArrayList.java:794)
at wordcount.__loadFromFields(wordcount.java:198)
at wordcount.parse(wordcount.java:147)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
14/05/08 12:25:40 INFO mapred.JobClient: Task Id : attempt_201405071437_0013_m_000001_0, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.util.NoSuchElementException
at java.util.ArrayList$Itr.next(ArrayList.java:794)
at wordcount.__loadFromFields(wordcount.java:198)
at wordcount.parse(wordcount.java:147)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
sqoop匯出語句:
sqoop export --connect jdbc:mysql://icity0:3306/sqoop --username root --password root --table wordcount --input-fields-terminated-by '\001' --export-dir '/user/hive/warehouse/wordcount'
這個錯誤的原因是指定Hive中表欄位之間使用的分隔符錯誤,供Sqoop讀取解析不正確,由於此處hive中的資料是由hdfs中匯入的,其分隔符是'\t',故修改從下列的匯出語句即可:
sqoop export --connect jdbc:mysql://icity0:3306/sqoop --username root --password root --table wordcount --input-fields-terminated-by '\t' --export-dir '/user/hive/warehouse/wordcount'
注:如果是由hive執行mapreduce操作彙總的結果,預設的分隔符是 '\001'.
相關文章
- Sqoop匯出ClickHouse資料到HiveOOPHive
- sqoop用法之mysql與hive資料匯入匯出OOPMySqlHive
- MySQL匯入資料亂碼、出錯等問題的解決辦法MySql
- scp出現錯誤的解決辦法
- SQLServer匯出匯入資料到MySQLServerMySql
- 資料庫升級後匯出報EXP-00056錯誤解決辦法資料庫
- Sqoop將MySQL資料匯入到hive中OOPMySqlHive
- sqoop導oracle資料庫的資料到hiveOOPOracle資料庫Hive
- SAP錯誤提示解決辦法
- springMVC資料驗證出現404錯誤解決辦法SpringMVC
- dns錯誤怎麼辦 dns錯誤的解決辦法DNS
- man出錯解決辦法
- sqoop1.4.7環境搭建及mysql資料匯入匯出到hiveOOPMySqlHive
- MYSQL資料庫匯入資料時出現亂碼的解決辦法MySql資料庫
- 連線oracle錯誤解決辦法Oracle
- nginxFastCGI錯誤Primaryscriptunknown解決辦法NginxAST
- Unable to locate package錯誤解決辦法Package
- oracle 1455 錯誤解決辦法Oracle
- 畢設之錯誤解決辦法
- 【Mysql】匯出資料到excel檔案中MySqlExcel
- git add .出現錯誤LF will be replaced by CRLF in 解決辦法Git
- photoshop匯出png發生未知錯誤的解決方案,ps匯出發生未知錯誤怎麼解決
- Idea編譯錯誤解決辦法Idea編譯
- PHP編譯錯誤及解決辦法PHP編譯
- samba一個錯誤的解決辦法!Samba
- ORA-29339錯誤解決辦法
- ORA-54013錯誤解決辦法
- sqoop資料匯入匯出OOP
- NPM run dev 出現這樣錯誤我的解決辦法NPMdev
- Ubuntu20.04安裝MySQL8.0時出現依賴錯誤解決辦法UbuntuMySql
- PowerDeisnger16下匯出到sqlserver2005以上出現sysproperties錯誤的解決辦法SQLServer
- mysql 資料sqoop到hive 步驟MySqlOOPHive
- Ubuntu 安裝包時提示錯誤E: Unable to locate package mysql-server錯誤 解決辦法UbuntuPackageMySqlServer
- iOS路上遇到的錯誤及解決辦法iOS
- ubuntu下import matplotlib錯誤解決辦法UbuntuImport
- ORA-12705,錯誤的解決辦法
- OpenCV1.0編譯錯誤解決辦法OpenCV編譯
- Xamarin提示安裝包錯誤解決辦法