Hive job,拋錯java.io.FileNotFoundException:/.../container_000001(Is a directory)
場景: 跑hive job時,夯住
錯誤: 檢視RM Web
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop-2.7.2/tmp/nm-local-dir/usercache/root/appcache/application_1468583637020_0006/filecache/10/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /hadoop/hadoop-2.7.2/logs/userlogs/application_1468583637020_0006/container_e58_1468583637020_0006_01_000001 (Is a directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:221)
at java.io.FileOutputStream.(FileOutputStream.java:142)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at org.apache.hadoop.yarn.ContainerLogAppender.activateOptions(ContainerLogAppender.java:55)
at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.(LogManager.java:127)
at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:64)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:285)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:156)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:132)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)
at org.apache.hadoop.service.AbstractService.(AbstractService.java:43)
Jul 19, 2016 7:32:00 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Jul 19, 2016 7:32:00 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 19, 2016 7:32:00 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Jul 19, 2016 7:32:00 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 19, 2016 7:32:00 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 19, 2016 7:32:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 19, 2016 7:32:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
分析:
1>.wordcount測試MR--ok
2>.調優yarn引數
解決方法: 修改每個節點的yarn-site.xml,然後重啟服務生效
點選(此處)摺疊或開啟
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/30089851/viewspace-2126300/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- hive job oom問題HiveOOM
- Hive On Tez自定義Job NameHive
- pg_basebackup 報錯could not create directory
- 面試: 怎麼往 Generator 裡拋個錯?面試
- hive使用報錯解決方法Hive
- 高德地圖使用cocoapods No such file or directory錯誤地圖
- Oracle ASM User Directory and Group DirectoryOracleASM
- Apache Hive啟動報NoClassDefFoundError錯誤ApacheHiveError
- tar (child): bzip2: Cannot exec: No such file or directory 報錯
- Hive1.2.1 啟動報錯 ClassNotFoundException: org.apache.hadoop.hive.service.HiveServerHiveExceptionApacheHadoopServer
- MySQL 建表DATA DIRECTORY 、INDEX DIRECTORY 簡介MySqlIndex
- error on auto execute of job "SYS"."PURGE_LOG"錯誤分析Error
- HIVE隨手記——Hive命令(?$HIVE_HOME/bin/hive)Hive
- create directory in OracleOracle
- sudo apt update時報錯 E: Unable to lock directory /var/lib/apt/lists/APT
- Linux 錯誤:fatal error: uuid/uuid.h: No such file or directoryLinuxErrorUI
- 更新Android SDK 出錯 Failed to rename directory \temp\ToolPackage.old01.AndroidAIPackage
- MogDB 安裝解壓錯誤:cannot run bzip2: No such file or directory
- hive報system:java.io.tmpdir錯誤解決HiveJava
- oracle建立job並執行jobOracle
- [Hive]Hive排序優化Hive排序優化
- Hive --------- hive 的優化Hive優化
- Hive之 hive架構Hive架構
- [hive] hive cli 命令列Hive命令列
- 【JOB】Oracle JOB全面學習(DBMS_JOB和DBMS_SCHEDULER)Oracle
- SVN chechout failed: xxx is not valid as filename in directory svn檢出錯誤AI
- 自定義容器啟動指令碼報錯:exec user process caused "no such file or directory"指令碼
- hadoop叢集,熱插拔硬碟後報錯:Task Tracker local directory is not writableHadoop硬碟
- oracle--job執行報錯--ORA-01031Oracle
- Oracle Job ORA-12005 錯誤的解決Oracle
- Oracle ASM Disk DirectoryOracleASM
- Oracle ASM File DirectoryOracleASM
- Oracle ASM Alias DirectoryOracleASM
- Oracle ASM Template DirectoryOracleASM
- asmcmd does not exist in directoryASM
- move oracle 10 directoryOracle
- shell script to rename directory
- ORACLE directory 目錄Oracle