Datanode process not running in Hadoop

by

You need to do something like this:

  • bin/stop-all.sh (or stop-dfs.sh and stop-yarn.sh in the 2.x serie)
  • rm -Rf /app/tmp/hadoop-your-username/*
  • bin/hadoop namenode -format (or hdfs in the 2.x serie)

the solution was taken from:
http://pages.cs.brandeis.edu/~cs147a/lab/hadoop-troubleshooting/. Basically it consists in restarting from scratch, so make sure you won’t loose data by formating the hdfs.

More Related Contents:

  1. Hadoop: …be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation
  2. Begenner at spark Big data programming (spark code)
  3. Failed to locate the winutils binary in the hadoop binary path
  4. What is the difference between partitioning and bucketing a table in Hive ?
  5. How does Hadoop Namenode failover process works?
  6. How to open/stream .zip files through Spark?
  7. Sqoop import : composite primary key and textual primary key
  8. When do reduce tasks start in Hadoop?
  9. Hadoop java.io.IOException: Mkdirs failed to create /some/path
  10. Hadoop cluster setup – java.net.ConnectException: Connection refused
  11. Spark on yarn concept understanding
  12. How can I access S3/S3n from a local Hadoop 2.6 installation?
  13. java.lang.NoClassDefFoundError: org/apache/hadoop/fs/StorageStatistics
  14. OOZIE: properties defined in file referenced in global job-xml not visible in workflow.xml
  15. How to access s3a:// files from Apache Spark?
  16. Hadoop speculative task execution
  17. Is it better to have one large parquet file or lots of smaller parquet files?
  18. hadoop map reduce secondary sorting
  19. Apache Hadoop Yarn – Underutilization of cores
  20. Where are logs in Spark on YARN?
  21. Easiest way to install Python dependencies on Spark executor nodes?
  22. Parallel Algorithms for Generating Prime Numbers (possibly using Hadoop’s map reduce)
  23. How does Hadoop perform input splits?
  24. Hadoop input split size vs block size
  25. Job queue for Hive action in oozie
  26. Difference between Pig and Hive? Why have both? [closed]
  27. Difference between HBase and Hadoop/HDFS
  28. What is Hive: Return Code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
  29. Merging multiple files into one within Hadoop
  30. hadoop: difference between 0 reducer and identity reducer?

Leave a Comment