<div dir="ltr" style="text-align: justify;" trbidi="on">
<div dir="ltr" style="text-align: justify;" trbidi="on"><b>Hadoop Configuration</b><br />
 ;I have to do in the following layers.</p>
<p></p>
<ul style="text-align: left;">
<li><b>HDFS Layer</b>
<ul style="text-align: left;">
<li>NameNode-Master</li>
<li>DataNode-Store Data(Actual Storage)</li>
</ul>
</li>
<li><b>MapReduce Layer</b>
<ul style="text-align: left;">
<li>JobTracker</li>
<li>TaskTracker</li>
</ul>
</li>
<li><b>Secondary Namenode</b>&#8211; storing backup of NameNode it will not work as an alternate namenode, it just stored namenode metadata</li>
</ul>
<div align='center' id="ads-id"></div>
<p>
 <b>Types of Hadoop Configurations</b></p>
<ul style="text-align: left;">
<li><b>Standalone Mode</b>
<ul style="text-align: left;">
<li>All processes runs as single process</li>
<li>Preferred in development</li>
</ul>
</li>
<li><b>Pseudo Cluster Mode</b>
<ul style="text-align: left;">
<li>All processes run in different process but on a single machine</li>
<li>Simulate cluster</li>
</ul>
</li>
<li><b>Fully Cluster Mode</b>
<ul style="text-align: left;">
<li>All processes running on different boxes</li>
<li>Preferred in production Mode</li>
</ul>
</li>
</ul>
<p>
 <a href="https://dineshonjava.com/2014/11/hadoop-installation-tutorial-hadoop-2x.html#step4"><b>What are important files to be configure</b></a></p>
<ul style="text-align: left;">
<li><b>hadoop-env.sh</b> (set java environment and logging file)</li>
<li><b>core-site.xml</b> (configure namenode)</li>
<li><b>hdfs-site.xml</b> (configure datanode)</li>
<li><b>mapred-site.xml</b> (map reduce here taking responsibility of configuring jobTracker and taskTracker)</li>
<li><b>yarn-site.xml</b></li>
<li><b>master </b>(file configured on each datanodes telling about its namenode)</li>
<li><b>slave </b>(file configured on namenode telling what all slave of datanode it has to manage)</li>
</ul>
</div>
</div>
<div class="wp-post-navigation"> 
									 <div class="wp-post-navigation-pre"> 
									 <a href="https://dineshonjava.com/hadoop-installation-tutorial-hadoop-2x/">Previous</a> 
									 </div> 
									 <div class="wp-post-navigation-next"> 
									 <a href="https://dineshonjava.com/introduction-to-mapreduce/">Next</a> 
									 </div> 
									</div>
<script type="text/javascript">
jQuery(document).ready(function($) {
 $.post('https://dineshonjava.com/wp-admin/admin-ajax.php', {action: 'mts_view_count', id: '178'});
});
</script>
Strategy Design Patterns We can easily create a strategy design pattern using lambda. To implement…
Decorator Pattern A decorator pattern allows a user to add new functionality to an existing…
Delegating pattern In software engineering, the delegation pattern is an object-oriented design pattern that allows…
Technology has emerged a lot in the last decade, and now we have artificial intelligence;…
Managing a database is becoming increasingly complex now due to the vast amount of data…
Overview In this article, we will explore Spring Scheduler how we could use it by…