<div dir="ltr" style="text-align: justify;">
<div dir="ltr" style="text-align: justify;">
<p>In this tutorial, we will discuss about an application where we see how to configure a Spring Batch job to read CSV file by FlatFileReader library write into a MySQL database, and also we can filter out some of the records of employees which have less salary or under age employee before writing with ItemProcessor.</p>
<h3>Tools and libraries used</h3>
<ul style="text-align: left;">
<li>Spring Tool Suite (STS)</li>
<li>JDK 1.6</li>
<li>Spring Core 3.2.2.RELEASE</li>
<li>Spring OXM 3.2.2.RELEASE</li>
<li>Spring Batch 2.2.0.RELEASE</li>
<li>MySQL Java Driver 5.1.25</li>
</ul>
<h2><strong>Sample Example of Spring Batch CSV To MySQL Database-</strong></h2>
<h3><b>1. Project Directory Structure</b></h3>
<div class="separator" style="clear: both; text-align: center;"><img src="https://dineshonjava.com/wp-content/uploads/2014/03/111-5.png" border="0" /></div>
<h3><b>2. Input CSV File</b><br />
<b>employees.csv</b></h3>
<p><i>1111,ATUL KUMAR,17,300000.0,delhi</i><br />
<i>3333,ASHUTOSH RAJPUT,21,400000.0,delhi</i><br />
<i>4444,Adesh Verma,27,80000.0,Kanpur</i><br />
<i>5555,Dinesh Rajput,37,300000.0,Noida</i><br />
<i>2222,ATUL KUMAR,17,300000.0,delhi</i><br />
<i>6666,ASHUTOSH RAJPUT,21,400000.0,delhi</i><br />
<i>7777,Adesh Verma,27,80000.0,Kanpur</i><br />
<i>8888,Dinesh Rajput,37,300000.0,Noida</i></p>
<h3><b>3. ItemReader for CSV Flat File reader</b></h3>
<pre class="highlight"><;bean id="employee" class="com.doj.batch.bean.Employee" scope="prototype">;<;/bean>; 
 
 <;bean id="cvsItemReader" class="org.springframework.batch.item.file.FlatFileItemReader">; 
 <;!-- Read a csv file -->; 
 <;property name="resource" value="classpath:csv/employees.csv" />; 
 <;property name="lineMapper">; 
 <;bean class="org.springframework.batch.item.file.mapping.DefaultLineMapper">; 
 <;!-- split it -->; 
 <;property name="lineTokenizer">; 
 <;bean class="org.springframework.batch.item.file.transform.DelimitedLineTokenizer">; 
 <;property name="names" value="empid,name,age,salary,address" />; 
 <;/bean>; 
 <;/property>; 
 <;property name="fieldSetMapper">; 
 <;!-- map to an object -->; 
 <;bean class="org.springframework.batch.item.file.mapping.BeanWrapperFieldSetMapper">; 
 <;property name="prototypeBeanName" value="employee" />; 
 <;/bean>; 
 <;/property>; 
 <;/bean>; 
 <;/property>; 
 <;/bean>; 
 
</pre>
<div id="ads-id" align="center"></div>
<p><b>Employee.java</b></p>
<pre class="highlight">package com.doj.batch.bean; 
 
 
/** 
 * @author Dinesh Rajput 
 * 
 */ 
public class Employee { 
 private int empid; 
 private String name; 
 private int age; 
 private float salary; 
 private String address; 
 /** 
 * @return the empid 
 */ 
 public int getEmpid() { 
 return empid; 
 } 
 /** 
 * @param empid the empid to set 
 */ 
 public void setEmpid(int empid) { 
 this.empid = empid; 
 } 
 /** 
 * @return the name 
 */ 
 public String getName() { 
 return name; 
 } 
 /** 
 * @param name the name to set 
 */ 
 public void setName(String name) { 
 this.name = name; 
 } 
 /** 
 * @return the age 
 */ 
 public int getAge() { 
 return age; 
 } 
 /** 
 * @param age the age to set 
 */ 
 public void setAge(int age) { 
 this.age = age; 
 } 
 /** 
 * @return the salary 
 */ 
 public float getSalary() { 
 return salary; 
 } 
 /** 
 * @param salary the salary to set 
 */ 
 public void setSalary(float salary) { 
 this.salary = salary; 
 } 
 /** 
 * @return the address 
 */ 
 public String getAddress() { 
 return address; 
 } 
 /** 
 * @param address the address to set 
 */ 
 public void setAddress(String address) { 
 this.address = address; 
 } 
 
} 
</pre>
<h3><b>4. Database configuration</b><br />
<b>ApplicationDB.xml</b></h3>
<pre class="highlight"><;?xml version="1.0" encoding="UTF-8"?>; 
<;beans xmlns="http://www.springframework.org/schema/beans" 
 xmlns:jdbc="http://www.springframework.org/schema/jdbc" 
 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
 xsi:schemaLocation="http://www.springframework.org/schema/beans 
 http://www.springframework.org/schema/beans/spring-beans-4.0.xsd 
 http://www.springframework.org/schema/jdbc 
 http://www.springframework.org/schema/jdbc/spring-jdbc-4.0.xsd">; 
 
 <;!-- connect to database -->; 
 <;bean id="dataSource" class="org.springframework.jdbc.datasource.DriverManagerDataSource">; 
 <;property name="driverClassName" value="com.mysql.jdbc.Driver" />; 
 <;property name="url" value="jdbc:mysql://localhost:3306/DAVDB" />; 
 <;property name="username" value="root" />; 
 <;property name="password" value="root" />; 
 <;/bean>; 
 
 <;bean id="transactionManager" class="org.springframework.batch.support.transaction.ResourcelessTransactionManager" />; 
 
<;/beans>; 
</pre>
<h3><b>5. Spring Batch Core configuration</b></h3>
<p>Define <i><b>jobRepository </b></i>and <i><b>jobLauncher</b></i>.<br />
<b>applicationContext.xml</b></p>
<pre class="highlight"><;?xml version="1.0" encoding="UTF-8"?>; 
<;beans xmlns="http://www.springframework.org/schema/beans" 
 xmlns:context="http://www.springframework.org/schema/context" 
 xmlns:p="http://www.springframework.org/schema/p" 
 xmlns:mvc="http://www.springframework.org/schema/mvc" 
 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
 xsi:schemaLocation="http://www.springframework.org/schema/beans 
http://www.springframework.org/schema/beans/spring-beans-4.0.xsd 
http://www.springframework.org/schema/context 
http://www.springframework.org/schema/context/spring-context-4.0.xsd 
http://www.springframework.org/schema/mvc 
http://www.springframework.org/schema/mvc/spring-mvc-4.0.xsd">; 
 
 <;bean id="transactionManager" class="org.springframework.batch.support.transaction.ResourcelessTransactionManager"/>; 
 
 <;bean id="jobLauncher" class="org.springframework.batch.core.launch.support.SimpleJobLauncher">; 
 <;property name="jobRepository" ref="jobRepository"/>; 
 <;/bean>; 
 
 <;bean id="jobRepository" class="org.springframework.batch.core.repository.support.MapJobRepositoryFactoryBean">; 
 <;property name="transactionManager" ref="transactionManager"/>; 
 <;/bean>; 
 
 <;bean id="simpleJob" class="org.springframework.batch.core.job.SimpleJob" abstract="true">; 
 <;property name="jobRepository" ref="jobRepository" />; 
 <;/bean>; 
 
<;/beans>; 
</pre>
<h3>6. Spring Batch Jobs Configuration file<br />
<b>simple-job.xml</b></h3>
<pre class="highlight"><;?xml version="1.0" encoding="UTF-8"?>; 
<;beans xmlns="http://www.springframework.org/schema/beans" 
 xmlns:context="http://www.springframework.org/schema/context" 
 xmlns:p="http://www.springframework.org/schema/p" 
 xmlns:batch="http://www.springframework.org/schema/batch" 
 xmlns:mvc="http://www.springframework.org/schema/mvc" 
 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
 xsi:schemaLocation="http://www.springframework.org/schema/beans 
http://www.springframework.org/schema/beans/spring-beans-4.0.xsd 
http://www.springframework.org/schema/context 
http://www.springframework.org/schema/context/spring-context-4.0.xsd 
http://www.springframework.org/schema/mvc 
http://www.springframework.org/schema/mvc/spring-mvc-4.0.xsd 
http://www.springframework.org/schema/batch 
http://www.springframework.org/schema/batch/spring-batch-2.0.xsd">; 
 
 <;import resource="applicationContext.xml"/>; 
 <;import resource="ApplicationDB.xml"/>; 
 
 <;bean id="employee" class="com.doj.batch.bean.Employee" scope="prototype">;<;/bean>; 
 
 <;bean id="cvsItemReader" class="org.springframework.batch.item.file.FlatFileItemReader">; 
 <;!-- Read a csv file -->; 
 <;property name="resource" value="classpath:csv/employees.csv" />; 
 <;property name="lineMapper">; 
 <;bean class="org.springframework.batch.item.file.mapping.DefaultLineMapper">; 
 <;!-- split it -->; 
 <;property name="lineTokenizer">; 
 <;bean class="org.springframework.batch.item.file.transform.DelimitedLineTokenizer">; 
 <;property name="names" value="empid,name,age,salary,address" />; 
 <;/bean>; 
 <;/property>; 
 <;property name="fieldSetMapper">; 
 <;!-- map to an object -->; 
 <;bean class="org.springframework.batch.item.file.mapping.BeanWrapperFieldSetMapper">; 
 <;property name="prototypeBeanName" value="employee" />; 
 <;/bean>; 
 <;/property>; 
 <;/bean>; 
 <;/property>; 
 <;/bean>; 
 
 <;bean id="databaseItemWriter" class="org.springframework.batch.item.database.JdbcBatchItemWriter">; 
 <;property name="dataSource" ref="dataSource" />; 
 <;property name="sql">; 
 <;value>; 
 <;![CDATA[ 
 insert into EMPLOYEET(empname,empAge,salary,empaddress) values (:name,:age,:salary,:address) 
 ]]>; 
 <;/value>; 
 <;/property>; 
 <;!-- It will take care matching between object property and sql name parameter -->; 
 <;property name="itemSqlParameterSourceProvider">; 
 <;bean class="org.springframework.batch.item.database.BeanPropertyItemSqlParameterSourceProvider" />; 
 <;/property>; 
 <;/bean>; 
 
 <;batch:job id="simpleDojJob" job-repository="jobRepository" parent="simpleJob">; 
 <;batch:step id="step1">; 
 <;batch:tasklet transaction-manager="transactionManager">; 
 <;batch:chunk reader="cvsItemReader" writer="databaseItemWriter" commit-interval="2"/>; 
 <;/batch:tasklet>; 
 <;/batch:step>; 
 <;/batch:job>; 
<;/beans>; 
</pre>
<p>This is the main xml file to configure the Spring batch job. This <i><b>simple-job.xml </b></i>file define a job to read a <i><b>employees.csv</b></i> file, match it to <i><b>employee </b></i>plain pojo and write the data into MySQL database <i><b>Employeet</b></i> table.</p>
<h3><b>7. Spring Batch <i>ItemProcessor </i>for filter data</b></h3>
<p>In Spring batch, the wired Processor will be fired before writing to any resources, so, this is the best place to handle any conversion, filtering and business logic. In this example, we will be ignored all employees whose have salaried less than 70000 i.e. not write to database as well as ignored those employee whose age less than 22 years.</p>
<p><b>DataFilterProcessor.java</b></p>
<pre class="highlight">package com.doj.batch.processor; 
 
import org.springframework.batch.item.ItemProcessor; 
 
import com.doj.batch.bean.Employee; 
 
/** 
 * @author Dinesh Rajput 
 * 
 */ 
public class DataFilterProcessor implements ItemProcessor<;Employee, Employee>; { 
 
 @Override 
 public Employee process(Employee emp) throws Exception { 
 if(emp.getSalary() >; 70000.0 &;&; emp.getAge() >; 22){ 
 return emp; 
 }else{ 
 return null; 
 } 
 } 
 
} 
</pre>
<h3><b>8. Launching Batch Job-</b></h3>
<p>Spring Batch comes with a simple utility class called <b><i>CommandLineJobRunner </i></b>which has a main() method which accepts two arguments. First argument is the spring application context file containing job definition and the second is the name of the job to be executed.</p>
<p>Now run as a java application with both two arguments.<br />
<b><i>org.springframework.batch.core.launch.support.CommandLineJobRunner</i></b><br />
<b><i>simple-job.xml simpleDojJob</i></b></p>
<p>Output. The Spring Batch metadata tables are created, and the content of employees.cvs is inserted into database table &#8220;EMPLOYEET&#8221;.</p>
<div class="separator" style="clear: both; text-align: center;"><img src="https://dineshonjava.com/wp-content/uploads/2014/03/111-6.png" border="0" /></div>
<p> ;</p>
</div>
<h3><b>Download Source Code with Jars</b><br />
<b><a href="https://sites.google.com/a/dineshonjava.com/dineshonjava/dineshonjava/SpringBatchCSVtoDatabase.zip?attredirects=0&;d=1" target="_blank" rel="noopener">SpringBatchCSVtoDatabase.zip</a></b></h3>
<p> ;</p>
<div style="text-align: center;"><b><;<;<a href="https://dineshonjava.com/spring-batch-xml-to-csv-file/">Previuos</a><;<; <a href="https://dineshonjava.com/spring-tutorial/">Index </a>>;>; <a href="https://dineshonjava.com/spring-batch-xml-to-mongodb-database/">Next</a>>;>;</b></div>
<p> ;</p>
</div>
<div class="wp-post-navigation"> 
									 <div class="wp-post-navigation-pre"> 
									 <a href="https://dineshonjava.com/spring-batch-xml-to-csv-file/">Previous</a> 
									 </div> 
									 <div class="wp-post-navigation-next"> 
									 <a href="https://dineshonjava.com/spring-batch-xml-to-mongodb-database/">Next</a> 
									 </div> 
									</div>
<script type="text/javascript">
jQuery(document).ready(function($) {
 $.post('https://dineshonjava.com/wp-admin/admin-ajax.php', {action: 'mts_view_count', id: '223'});
});
</script>
Strategy Design Patterns We can easily create a strategy design pattern using lambda. To implement…
Decorator Pattern A decorator pattern allows a user to add new functionality to an existing…
Delegating pattern In software engineering, the delegation pattern is an object-oriented design pattern that allows…
Technology has emerged a lot in the last decade, and now we have artificial intelligence;…
Managing a database is becoming increasingly complex now due to the vast amount of data…
Overview In this article, we will explore Spring Scheduler how we could use it by…