Home
Hadoop Tutorial
December 4, 2014
18 Comments

Hadoop Tutorial

Hadoop Tutorial

Hi in this hadoop tutorial we will describe all about Hadoop, why use Hadoop, Hadoop Architecture, BigData, MapReduce and Some ecosystems.

Now a days required framework like which  handle huge amount of data in an application like Facebook,  Twitter, LinledIn, Google, Yahoo, etc these have lots of data. These companies required some process to that huge data like 1. Data Analysis, 2. Proper Handling of Data and 3. Understandable data to custom format.
Apache Hadoop’s MapReduce and HDFS components originally derived respectively from Google’s MapReduce and Google File System (GFS) papers.

In 2003-2004 Google Introduced some new technique in search engine 1. File System GFS (Google File System) and another framework for data analyzing technique called 2. MapReduce to make fast searching and fast analyzing data. Google just submitted theses white paper to search engine.

In 2005-2006 Yahoo take these technique for Google and Implement in single framework given Name Hadoop. Hadoop was created by Doug Cutting and Mike Cafarella in 2005. Cutting, who was working at Yahoo! at the time, named it after his son’s toy elephant. It was originally developed to support distribution for the Nutch search engine project. No one knows that better than Doug Cutting, chief architect of Cloudera and one of the curious story behind Hadoop.

When he was creating the open source software that supports the processing of large data sets, Cutting knew the project would need a good name. Cutting’s son, then 2, was just beginning to talk and called his beloved stuffed yellow elephant “Hadoop” (with the stress on the first syllable). Fortunately, he had one up his sleeve—thanks to his son. The son (who’s now 12) frustrated with this. He’s always saying ‘Why don’t you say my name, and why don’t I get royalties? I deserve to be famous for this 🙂

Big Data Hadoop
Video

In this Hadoop Tutorial we will learn further following modules.

Module 1-

    1. Understanding Big Data
    2.  Introduction to Hadoop
  2.  Hadoop Architecture

Module 2-

 

    1. Hadoop Distributed File System(HDFS)
    2. HDFS Architecture
    3. JobTracker and TaskTracker Architecture 
    4. Hadoop Configuration 
    1. Hadoop Environment Setup(Hadoop 1.x)
    2. Hadoop Environment Setup(Hadoop 2.x)
    3. Hadoop installation on ubuntu

 

  1. Data Loading Technique

Module 3-

    1. Introduction to MapReduce
    1. MapReduce Flow Chart with Sample Example 
  2. MapReduce Programming Hello World or WordCount Program 

Module 4-

    1. Advanced MapReduce
    1. YARN
  2. YARN Programming

Module 5-

    1. Introduction to Sqoop
  2. Programming with Sqoop

Module 6-

    1. Analytic Using HIVE
  2. Understanding HIVE QL

Module 7-

    1. NoSQL Databases
    1. Understanding HBASE
  2. Zookeeper

Module 8-

    1. Real World Data sets and analysis
  2. Project Discussion
Previous
Hadoop

Related Posts

About The Author

Dinesh Rajput

Dinesh Rajput is the chief editor of a website Dineshonjava, a technical blog dedicated to the Spring and Java technologies. It has a series of articles related to Java technologies. Dinesh has been a Spring enthusiast since 2008 and is a Pivotal Certified Spring Professional, an author of a book Spring 5 Design Pattern, and a blogger. He has more than 10 years of experience with different aspects of Spring and Java design and development. His core expertise lies in the latest version of Spring Framework, Spring Boot, Spring Security, creating REST APIs, Microservice Architecture, Reactive Pattern, Spring AOP, Design Patterns, Struts, Hibernate, Web Services, Spring Batch, Cassandra, MongoDB, and Web Application Design and Architecture. He is currently working as a technology manager at a leading product and web development company. He worked as a developer and tech lead at the Bennett, Coleman & Co. Ltd and was the first developer in his previous company, Paytm. Dinesh is passionate about the latest Java technologies and loves to write technical blogs related to it. He is a very active member of the Java and Spring community on different forums. When it comes to the Spring Framework and Java, Dinesh tops the list!

18 Comments

  1. subrat November 14, 2014

    when i ran a simple programme it compile sucess fully but when i ran it is giving error as Could not find or load main class plz tell me wht i do

  2. Dinesh Rajput November 14, 2014

    Hi,
    Please make sure when ever use run command your class file generated same directory or another directory. Its problem due to when class is not in directory or in this class not contain main method.

  3. Hari November 18, 2014

    Where is it rendering the view here.?

  4. Neelam November 18, 2014

    I did not get why are some sections not linked, nor do i see it is paid. Any other issue ?

  5. Dinesh Rajput November 18, 2014

    Hi Neelam,

    Could you please clear about which sections you are talking? Please put the name of section, then we can give you proper reason.

  6. Sagar November 24, 2014

    Nice information.

  7. Naveen Sharma November 26, 2014

    Hi Dinesh,
    I've just downloaded your project and import in eclipse also added all the jars in buildpath. I'm running this appliction in tomat 7 but its showing me 404.
    Please help

    thanks

  8. Dinesh Rajput November 26, 2014

    make sure the context path of application is correct or not.

  9. Suyash Soni December 26, 2014

    Hi Dinesh, I'm confused about different return types(Model, Map, ModelAndView, String, void etc.) of handler methods. Could you please explain the difference among them and how can we choose the one that fits best to our requirement?

  10. Suyash Soni December 26, 2014

    Your endeavours are much appreciated. But could you please explain the difference among the different return types(ModelAndView, Model, View, String, Map, void) of handler methods?

  11. Dinesh Rajput December 27, 2014

    Thanks for your nice comment!!!

  12. Dinesh Rajput December 27, 2014

    Model and Map we can use when return data simple JSON format.

    ModelAndView using when return with model and view to front layer.

    String we can use for simple return with view name.

    I think right now you clear about these.

    Let us know if you have still confusion about these return types of handler.

    Thanks

  13. mbeddedsoft February 4, 2015

    So in the EmplyeeForm is the element missing modelAttribute="SpringWeb"? I'm confused.

  14. sudhir February 12, 2015

    hii dinesh ,i downloaded this application from your site .i imported it in eclipse ..but its showing 404 file not found ..Kindly help me out whts the pblm..thnks in advance

  15. Dinesh Rajput February 12, 2015

    Dear Sudhir,

    Thanks for using this tutorial!!!

    Please update your context root and add all jars to build class path.
    After that you will try.

    After that same problem is coming please share url of localhost.

  16. sudhir February 12, 2015

    Dear Dinesh,

    Still i m facing same prolem..file not found 404 status..here is my url:http://localhost:7576/sdnext/WEB-INF/views/employeeForm.jsp.

    I added all jars and update context root..still not getting output
    Thanks in advance

  18. sumeet April 26, 2018

    please update all the module related to Hadoop