Set hadoop system user for client embedded in Java webapp

by

Finally I stumbled on the constant

static final String HADOOP_USER_NAME = "HADOOP_USER_NAME";`

in the UserGroupInformation class.

Setting this either as an environment variable, as a Java system property on startup (using -D) or programmatically with System.setProperty("HADOOP_USER_NAME", "hduser"); makes Hadoop use whatever username you want for connecting to the remote Hadoop cluster.

More Related Contents:

  1. Begenner at spark Big data programming (spark code)
  2. Failed to locate the winutils binary in the hadoop binary path
  3. What is the difference between partitioning and bucketing a table in Hive ?
  4. How does Hadoop Namenode failover process works?
  5. How to open/stream .zip files through Spark?
  6. Sqoop import : composite primary key and textual primary key
  7. When do reduce tasks start in Hadoop?
  8. Hadoop java.io.IOException: Mkdirs failed to create /some/path
  9. Spark on yarn concept understanding
  10. How can I access S3/S3n from a local Hadoop 2.6 installation?
  11. java.lang.NoClassDefFoundError: org/apache/hadoop/fs/StorageStatistics
  12. OOZIE: properties defined in file referenced in global job-xml not visible in workflow.xml
  13. How to access s3a:// files from Apache Spark?
  14. How to get the input file name in the mapper in a Hadoop program?
  15. Is it better to have one large parquet file or lots of smaller parquet files?
  16. hadoop map reduce secondary sorting
  17. Apache Spark: The number of cores vs. the number of executors
  18. Apache Hadoop Yarn – Underutilization of cores
  19. Where are logs in Spark on YARN?
  20. Parallel Algorithms for Generating Prime Numbers (possibly using Hadoop’s map reduce)
  21. Where does hadoop mapreduce framework send my System.out.print() statements ? (stdout)
  22. Default Namenode port of HDFS is 50070.But I have come across at some places 8020 or 9000 [closed]
  23. How does Hadoop perform input splits?
  24. Hadoop input split size vs block size
  25. Difference between hadoop fs -put and hadoop fs -copyFromLocal
  26. Datanode process not running in Hadoop
  27. Cannot Read a file from HDFS using Spark
  28. What is Google’s Dremel? How is it different from Mapreduce?
  29. Hadoop WordCount example stuck at map 100% reduce 0%
  30. Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

Leave a Comment