2014-09-03 14:34:46,574 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1409734969311_0027_000001 (auth:SIMPLE)
2014-09-03 14:34:46,773 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1409734969311_0027_01_000001 by user margusja
2014-09-03 14:34:46,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1409734969311_0027
2014-09-03 14:34:46,816 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=margusjaIP=90.190.106.48OPERATION=Start Container RequestTARGET=ContainerManageImplRESULT=SUCCESSAPPID=application_1409734969311_0027CONTAINERID=container_1409734969311_0027_01_000001
2014-09-03 14:34:46,817 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1409734969311_0027 transitioned from NEW to INITING
2014-09-03 14:34:46,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1409734969311_0027_01_000001 to application application_1409734969311_0027
2014-09-03 14:34:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1409734969311_0027 transitioned from INITING to RUNNING
2014-09-03 14:34:46,838 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from NEW to LOCALIZING
2014-09-03 14:34:46,838 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1409734969311_0027
2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.jar transitioned from INIT to DOWNLOADING
2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.splitmetainfo transitioned from INIT to DOWNLOADING
2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.split transitioned from INIT to DOWNLOADING
2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.xml transitioned from INIT to DOWNLOADING
2014-09-03 14:34:46,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1409734969311_0027_01_000001
2014-09-03 14:34:47,105 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/container_1409734969311_0027_01_000001.tokens. Credentials list:
2014-09-03 14:34:47,109 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user margusja
2014-09-03 14:34:47,172 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /tmp/hadoop-yarn/nm-local-dir/nmPrivate/container_1409734969311_0027_01_000001.tokens to /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/container_1409734969311_0027_01_000001.tokens
2014-09-03 14:34:47,172 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set to /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027 = file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027
2014-09-03 14:34:48,150 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.jar(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2014-09-03 14:34:48,180 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.splitmetainfo(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2014-09-03 14:34:48,211 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.split(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2014-09-03 14:34:48,249 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://h14.dbweb.ee:8020/user/margusja/.staging/job_1409734969311_0027/job.xml(->file:/tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2014-09-03 14:34:48,251 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from LOCALIZING to LOCALIZED
2014-09-03 14:34:48,300 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1409734969311_0027_01_000001 transitioned from LOCALIZED to RUNNING
2014-09-03 14:34:48,310 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [nice, -n, 0, bash, /tmp/hadoop-yarn/nm-local-dir/usercache/margusja/appcache/application_1409734969311_0027/container_1409734969311_0027_01_000001/default_container_executor.sh]
2014-09-03 14:34:48,557 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1409734969311_0027_01_000001 is : 1
2014-09-03 14:34:48,559 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1409734969311_0027_01_000001 and exit code: 1
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
The problem:
- org.apache.hadoop.mapreduce.v2.app.MRAppMaster was missing!
Solution: you need install:
(1/2): hadoop-client | 16 kB 00:00
(2/2): hadoop-mapreduce