Hadoop

Understanding Big Data

<div dir&equals;"ltr" style&equals;"text-align&colon; justify&semi;"><b>What is Big Data&quest;<&sol;b><&sol;div>&NewLine;<div dir&equals;"ltr" style&equals;"text-align&colon; justify&semi;">&NewLine;<ul style&equals;"text-align&colon; left&semi;">&NewLine;<li>Lots of Data &lpar;Terabytes or Petabytes&rpar;<&sol;li>&NewLine;<li>Big Data is the term for a collection of data sets so<b> large and complex<&sol;b> that it becomes <b>difficult <&sol;b>to process using on-hand database management tools or traditional data processing applications&period;<&sol;li>&NewLine;<li>Systems or Enterprises generate huge amount of data from Terabytes to and even Petabytes of information<&sol;li>&NewLine;<&sol;ul>&NewLine;<div id&equals;"ads-id" align&equals;"center"><&sol;div>&NewLine;<div class&equals;"separator" style&equals;"clear&colon; both&semi; text-align&colon; center&semi;"><img src&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;wp-content&sol;uploads&sol;2014&sol;11&sol;bigdata&period;jpg" border&equals;"0" &sol;><&sol;div>&NewLine;<ul style&equals;"text-align&colon; left&semi;">&NewLine;<li><b>Facebook <&sol;b>generate 500&plus; TBs data per day for analysis&period;<&sol;li>&NewLine;<li><b>NYSE <&sol;b>generate about 1 TB data of new trade data per day to perform stock trading analytic to determine trends for optimal trades&period;<&sol;li>&NewLine;<li>One <b>Airoplane <&sol;b>per day generate  almost like Facebook data quantity&period;<&sol;li>&NewLine;<li><b>Lighting or Electricity <&sol;b>board has also lots of data per day to analytics for calculating power consumption for a particular state&period;<&sol;li>&NewLine;<&sol;ul>&NewLine;<div class&equals;"separator" style&equals;"clear&colon; both&semi; text-align&colon; center&semi;"><img src&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;wp-content&sol;uploads&sol;2014&sol;11&sol;b&period;png" border&equals;"0" &sol;><&sol;div>&NewLine;<p>&vert;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8211&semi;&vert;<br &sol;>&NewLine;<b>  DATA<&sol;b><br &sol;>&NewLine;&vert;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8211&semi;&vert;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8211&semi;&vert;<br &sol;>&NewLine;<b>  70 &percnt; data       &vert; 30&percnt; Structured<&sol;b><br &sol;>&NewLine;<b> Unstructured&lpar;NoSQL&rpar; &vert;  Data &lpar;RDBMS&rpar;<&sol;b><br &sol;>&NewLine;<b>                                       &vert;<&sol;b><br &sol;>&NewLine;<b>Vertical Scalability       &vert; No Vertical Scalability<&sol;b><br &sol;>&NewLine;&vert;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;-&vert;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;&&num;8212&semi;-&vert;<&sol;p>&NewLine;<div class&equals;"separator" style&equals;"clear&colon; both&semi; text-align&colon; center&semi;"><img src&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;wp-content&sol;uploads&sol;2014&sol;11&sol;bigdata&lowbar;C&period;png" border&equals;"0" &sol;><&sol;div>&NewLine;<p><b>Big Data Technologies<&sol;b><&sol;p>&NewLine;<p><b>1&period; Operational Big Data-<&sol;b><br &sol;>&NewLine;System that provide operational capabilities for real time interactive workload where data is primarily captured and stored&period; <b>&lpar;MongoDB&rpar;<&sol;b><&sol;p>&NewLine;<p><b>2&period; Analytical Big Data-<&sol;b><br &sol;>&NewLine;System that provide analytical capabilities for retrospective&comma; complex analysis that may touch most of all the data&period;<b> &lpar;Hadoop&rpar;<&sol;b><&sol;p>&NewLine;<div class&equals;"separator" style&equals;"clear&colon; both&semi; text-align&colon; center&semi;"><img src&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;wp-content&sol;uploads&sol;2014&sol;11&sol;bigdatauser&period;jpg" border&equals;"0" &sol;><&sol;div>&NewLine;<p>&nbsp&semi;<&sol;p>&NewLine;<&sol;div>&NewLine;<div class&equals;"wp-post-navigation"> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <div class&equals;"wp-post-navigation-pre"> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <a href&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;hadoop-certification-qusetions&sol;">Previous<&sol;a> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <&sol;div> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <div class&equals;"wp-post-navigation-next"> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <a href&equals;"https&colon;&sol;&sol;dineshonjava&period;com&sol;what-is-hadoop&sol;">Next<&sol;a> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab; <&sol;div> &NewLine;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;&Tab;<&sol;div>&NewLine;<script type&equals;"text&sol;javascript">&NewLine;jQuery&lpar;document&rpar;&period;ready&lpar;function&lpar;&dollar;&rpar; &lbrace;&NewLine; &dollar;&period;post&lpar;'https&colon;&sol;&sol;dineshonjava&period;com&sol;wp-admin&sol;admin-ajax&period;php'&comma; &lbrace;action&colon; 'mts&lowbar;view&lowbar;count'&comma; id&colon; '187'&rcub;&rpar;&semi;&NewLine;&rcub;&rpar;&semi;&NewLine;<&sol;script>

Dinesh Rajput

Dinesh Rajput is the chief editor of a website Dineshonjava, a technical blog dedicated to the Spring and Java technologies. It has a series of articles related to Java technologies. Dinesh has been a Spring enthusiast since 2008 and is a Pivotal Certified Spring Professional, an author of a book Spring 5 Design Pattern, and a blogger. He has more than 10 years of experience with different aspects of Spring and Java design and development. His core expertise lies in the latest version of Spring Framework, Spring Boot, Spring Security, creating REST APIs, Microservice Architecture, Reactive Pattern, Spring AOP, Design Patterns, Struts, Hibernate, Web Services, Spring Batch, Cassandra, MongoDB, and Web Application Design and Architecture. He is currently working as a technology manager at a leading product and web development company. He worked as a developer and tech lead at the Bennett, Coleman & Co. Ltd and was the first developer in his previous company, Paytm. Dinesh is passionate about the latest Java technologies and loves to write technical blogs related to it. He is a very active member of the Java and Spring community on different forums. When it comes to the Spring Framework and Java, Dinesh tops the list!

Share
Published by
Dinesh Rajput

Recent Posts

Strategy Design Patterns using Lambda

Strategy Design Patterns We can easily create a strategy design pattern using lambda. To implement…

4 years ago

Decorator Pattern using Lambda

Decorator Pattern A decorator pattern allows a user to add new functionality to an existing…

4 years ago

Delegating pattern using lambda

Delegating pattern In software engineering, the delegation pattern is an object-oriented design pattern that allows…

4 years ago

Spring Vs Django- Know The Difference Between The Two

Technology has emerged a lot in the last decade, and now we have artificial intelligence;…

4 years ago

TOP 20 MongoDB INTERVIEW QUESTIONS 2022

Managing a database is becoming increasingly complex now due to the vast amount of data…

4 years ago

Scheduler @Scheduled Annotation Spring Boot

Overview In this article, we will explore Spring Scheduler how we could use it by…

4 years ago