Default Namenode port of HDFS is 50070.But I have come across at some places 8020 or 9000 [closed]

by

The default Hadoop ports are as follows: (HTTP ports, they have WEB UI):

Daemon                   Default Port  Configuration Parameter
-----------------------  ------------ ----------------------------------
Namenode                 50070        dfs.http.address
Datanodes                50075        dfs.datanode.http.address
Secondarynamenode        50090        dfs.secondary.http.address
Backup/Checkpoint node?  50105        dfs.backup.http.address
Jobracker                50030        mapred.job.tracker.http.address
Tasktrackers             50060        mapred.task.tracker.http.address

Internally, Hadoop mostly uses Hadoop IPC, which stands for Inter Process Communicator, to communicate amongst servers. The following table presents the ports and protocols that Hadoop uses. This table does not include the HTTP ports mentioned above.

Daemon      Default Port        Configuration Parameter     
------------------------------------------------------------
Namenode    8020                fs.default.name         
Datanode    50010               dfs.datanode.address        
Datanode    50020               dfs.datanode.ipc.address                                    
Backupnode  50100               dfs.backup.address

check out this link For more info: http://blog.cloudera.com/blog/2009/08/hadoop-default-ports-quick-reference/

More Related Contents:

  1. How does Hadoop process records split across block boundaries?
  2. How does Hadoop Namenode failover process works?
  3. Name node is in safe mode. Not able to leave
  4. How to fix corrupt HDFS FIles
  5. Hadoop java.io.IOException: Mkdirs failed to create /some/path
  6. Spark on yarn concept understanding
  7. Namenode not getting started
  8. Hive: Add partitions for existing folder structure
  9. Spark iterate HDFS directory
  10. How does Hadoop perform input splits?
  11. Hadoop: …be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation
  12. Default number of reducers
  13. Difference between HBase and Hadoop/HDFS
  14. Difference between hadoop fs -put and hadoop fs -copyFromLocal
  15. Behavior of the parameter “mapred.min.split.size” in HDFS
  16. Information about big data and hadoop [closed]
  17. Write to multiple outputs by key Spark – one Spark job
  18. Spark – load CSV file as DataFrame?
  19. Read whole text files from a compression in Spark
  20. Container is running beyond memory limits
  21. What is the purpose of shuffling and sorting phase in the reducer in Map Reduce Programming?
  22. Chaining multiple MapReduce jobs in Hadoop
  23. Pyspark: get list of files/directories on HDFS path
  24. How to load data to hive from HDFS without removing the source file?
  25. Loading Data from a .txt file to Table Stored as ORC in Hive
  26. What is the use of grouping comparator in hadoop map reduce
  27. What are the pros and cons of parquet format compared to other formats?
  28. Cannot Read a file from HDFS using Spark
  29. Hadoop WordCount example stuck at map 100% reduce 0%
  30. Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

Leave a Comment