How to run a jar file in hadoop?

by

I was able to reproduce your problem. The problem is where you are creating the jar.

Basically, the directory that you are packaging into the jar is confusing the jar file in locating the main class file. Instead if you try doing :

/usr/lib/jvm/jdk1.7.0_07/bin/jar cf Dictionary.jar /home/hduser/dir/Dictionary.class

i.e. package the class file specifically into the jar and then run:

/usr/local/hadoop/bin/hadoop jar Dictionary.jar Dictionary

It just works fine provided that you have a main function in your class called Dictionary.

The problem is when you package a full directory inside a jar then the jar also needs to be aware of the directory structure to locate the class file. For this, we need to have a well defined package hierarchy to define the class location. So, when you are packaging /home/hduser/dir/ into the jar, the jar is not aware of the location of the class file which is located deep inside this directory structure. For this you need to add a package name to your .java file according to the directory structure , for example home.hduser.dir and while running the hadoop jar command specify the class name with the package structure, for example home.hduser.dir.Dictionary.

More Related Contents:

  1. How to make an executable JAR file?
  2. How do I read a resource file from a Java jar file?
  3. What is a fat JAR? [duplicate]
  4. Call “java -jar MyFile.jar” with additional classpath option
  5. Controlling Maven final name of jar artifact
  6. How to write a Java program which can extract a JAR file and store its data in specified directory (location)?
  7. What is the maven-shade-plugin used for, and why would you want to relocate Java packages?
  8. Java creating .jar file
  9. Write a file in hdfs with Java
  10. Should I call ugi.checkTGTAndReloginFromKeytab() before every action on hadoop?
  11. Eclipse: Attach source/javadoc to a library via a local property
  12. Multiple runnable classes inside JAR, how to run them?
  13. Run exe which is packaged inside jar file
  14. What is the best way to avoid maven-jar?
  15. Can I set Java max heap size for running from a jar file?
  16. Finding unused jars used in an eclipse project
  17. Hadoop Word count: receive the total number of words that start with the letter “c”
  18. How to reference JSF managed beans which are provided in a JAR file?
  19. How to includes all images in jar file using eclipse
  20. How do I access a config file inside the jar?
  21. Difference between maven plugins ( assembly-plugins , jar-plugins , shaded-plugins)
  22. Could not find or load main class with a Jar File
  23. ClassNotFoundException/NoClassDefFoundError in my Java web application
  24. How to run a maven created jar file using just the command line
  25. How to wildcard include JAR files when compiling?
  26. Convert .Jar to .Dmg
  27. hadoop java.net.URISyntaxException: Relative path in absolute URI: rsrc:hbase-common-0.98.1-hadoop2.jar
  28. Run a jar File from java program
  29. Why does my JAR file execute at CMD, but not on double-click?
  30. Difference between the maven-assembly-plugin, maven-jar-plugin and maven-shade-plugin?

Leave a Comment