Dinesh on Java

Hadoop

Understanding Big Data

What is Big Data?

Lots of Data (Terabytes or Petabytes)
Big Data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.
Systems or Enterprises generate huge amount of data from Terabytes to and even Petabytes of information

Facebook generate 500+ TBs data per day for analysis.
NYSE generate about 1 TB data of new trade data per day to perform stock trading analytic to determine trends for optimal trades.
One Airoplane per day generate almost like Facebook data quantity.
Lighting or Electricity board has also lots of data per day to analytics for calculating power consumption for a particular state.

|————————————————————–|
DATA
|————————–|————————————–|
70 % data       | 30% Structured
Unstructured(NoSQL) | Data (RDBMS)
                                   |
Vertical Scalability       | No Vertical Scalability
|————————-|————————————-|

Big Data Technologies

1. Operational Big Data-
System that provide operational capabilities for real time interactive workload where data is primarily captured and stored. (MongoDB)

2. Analytical Big Data-
System that provide analytical capabilities for retrospective, complex analysis that may touch most of all the data. (Hadoop)

Dinesh Rajput

Dinesh Rajput is the chief editor of a website Dineshonjava, a technical blog dedicated to the Spring and Java technologies. It has a series of articles related to Java technologies. Dinesh has been a Spring enthusiast since 2008 and is a Pivotal Certified Spring Professional, an author of a book Spring 5 Design Pattern, and a blogger. He has more than 10 years of experience with different aspects of Spring and Java design and development. His core expertise lies in the latest version of Spring Framework, Spring Boot, Spring Security, creating REST APIs, Microservice Architecture, Reactive Pattern, Spring AOP, Design Patterns, Struts, Hibernate, Web Services, Spring Batch, Cassandra, MongoDB, and Web Application Design and Architecture. He is currently working as a technology manager at a leading product and web development company. He worked as a developer and tech lead at the Bennett, Coleman & Co. Ltd and was the first developer in his previous company, Paytm. Dinesh is passionate about the latest Java technologies and loves to write technical blogs related to it. He is a very active member of the Java and Spring community on different forums. When it comes to the Spring Framework and Java, Dinesh tops the list!