WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_xxx is : 1

2014-09-03 14:34:46,574 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1409734969311_0027_000001 (auth:SIMPLE)

2014-09-03 14:34:46,773 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1409734969311_0027_01_000001 by user margusja

2014-09-03 14:34:46,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1409734969311_0027

2014-09-03 14:34:46,816 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=margusjaIP=90.190.106.48OPERATION=Start Container RequestTARGET=ContainerManageImplRESULT=SUCCESSAPPID=application_1409734969311_0027CONTAINERID=container_1409734969311_0027_01_000001

2014-09-03 14:34:46,817 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1409734969311_0027 transitioned from NEW to INITING

2014-09-03 14:34:46,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1409734969311_0027_01_000001 to application application_1409734969311_0027

2014-09-03 14:34:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1409734969311_0027 transitioned from INITING to RUNNING

2014-09-03 14:34:46,838 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from NEW to LOCALIZING

2014-09-03 14:34:46,838 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1409734969311_0027

2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.jar transitioned from INIT to DOWNLOADING

2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.splitmetainfo transitioned from INIT to DOWNLOADING

Screen Shot 2014-09-03 at 15.05.25

2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.split transitioned from INIT to DOWNLOADING

2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.xml transitioned from INIT to DOWNLOADING

2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1409734969311_0027_01_000001

2014-09-03 14:34:47,105 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/container_1409734969311_0027_01_000001.tokens. Credentials list: 

2014-09-03 14:34:47,109 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user margusja

2014-09-03 14:34:47,172 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /tmp/hadoop-yarn/nm-local-dir/nmPrivate/container_1409734969311_0027_01_000001.tokens to /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/container_1409734969311_0027_01_000001.tokens

2014-09-03 14:34:47,172 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set to /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027 = file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027

2014-09-03 14:34:48,150 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.jar(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED

2014-09-03 14:34:48,180 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.splitmetainfo(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED

2014-09-03 14:34:48,211 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.split(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED

2014-09-03 14:34:48,249 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.xml(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED

2014-09-03 14:34:48,251 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from LOCALIZING to LOCALIZED

2014-09-03 14:34:48,300 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from LOCALIZED to RUNNING

2014-09-03 14:34:48,310 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [nice, -n, 0, bash, /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/container_1409734969311_0027_01_000001/default_container_executor.sh]

2014-09-03 14:34:48,557 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1409734969311_0027_01_000001 is : 1

2014-09-03 14:34:48,559 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1409734969311_0027_01_000001 and exit code: 1

org.apache.hadoop.util.Shell$ExitCodeException: 

at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)

at org.apache.hadoop.util.Shell.run(Shell.java:418)

at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)

at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)

at java.util.concurrent.FutureTask.run(FutureTask.java:262)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)

The problem:

  • org.apache.hadoop.mapreduce.v2.app.MRAppMaster was missing!

Solution: you need install:

(1/2): hadoop-client                                                                                                                                                                                                    |  16 kB     00:00     

(2/2): hadoop-mapreduce