Configure core-site.xml for hadoop master slave topology(rest part)

 We have already configured hdfs-site.xml files for master and slave. Now we need to configure core-site.xml files

1. In Master or name node

in terminal

cd /etc/hadoop/

vim core-site.Xml

inside file

<property>

<name>fs.dafault.name<\name>

<value>hdfs://masterIPaddress:9001<\value >

<\property>

9001 is the port number. (You can use netstat-tnlp command which ports are in use and then

select a port which is not in use)

format the /drive which you created in master using command

hadoop name node -format

Hadoop-daemon.sh start namenode

2. In slave or data node

in terminal

cd /etc/hadoop/

vim core-site.Xml

inside file

<property>

<name>fs.dafault.name<\name>

<value>hdfs://masterIPaddress:9001<\value >

<\property>


hadoop-daemon.shstart datanode

Still it will not connect. So, for that disable firewall of master node using command

systemctl stop firewall


hadoop dfsadmin -report will check dfs report that how many slave nodes are connected to the master node

To view or add a comment, sign in

More articles by Sanpreet Kaur

  • Cloud Computing

    ->Cloud Computing is online availability of computer system that provides RAM, cpu etc to process our data online…

  • Networking basics

    -> Any number which can be stored in 4 bytes is a valid IP.Usually people think that 198.

  • Hadoop Master And Slave topology Configuration of hdfs-site.xml file

    -> Binary Languages is made by the combination of '1' and '0'. It has base 2 and is directly understandable by the…

  • Some More Linux Basics

    In CLI we use a concept called SHELL through which user interact with OS.The bash shell script is like a code.

    9 Comments
  • Some of the basic Red-hat 8 Linux concepts

    Linux has the multi-user feature which where we can switch between the users without logging off from a user by using…

  • How companies manage Big Data? Distributed storage cluster and Hadoop

    Due to social media platform and other online working platform data is increasing day by day. And it is becoming very…

    2 Comments

Insights from the community

Others also viewed

Explore topics