What is the fastest open source library to parse CSV file in Java?

Question

1.00/5 (1 vote)

See more:

In my project, I would like to to read and process a huge CSV file with millions of records, and the fastest library I could find is uniVocity-parsers. Here is my logic:
1) Read the CSV file with FTP protocol
2) Parse the CSV file with my own logic, such as combination, duplicates deletion and so on.
3) Store the parsed data into the MySQL database.

Currently I'm using the JavaCSV, but it's slow for my project.

Do you have any other suggestion?

Posted 9-May-15 13:11pm

Jerry Sivan

Updated 12-May-15 12:13pm

v2

Add a Solution

Comments

Sergey Alexandrovich Kryukov 9-May-15 20:23pm

Wrong question. How told you that you need any library? The fastest code could be the ad-hoc code your write by yourself. What you really need, depends on your goals. "Millions or records" in a CSV is already the abuse of technology, and making it in a very universal way will hardly be a great fix, anyway...
—SA

Mohibur Rashid 10-May-15 5:25am

Suggestion 1: Drop CSV pick something else

[no name] 12-May-15 20:17pm

Even lightweight code written especially is going to choke on millions of records. You are barking up the wrong tree. If you are not in control of creating the data csv is a very bad choice. Why is speed an issue?

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Mehdi Gholam · Answer 1 · 2015-05-09T18:47:00

Solution 1

Try to use Google first, a simple search gives a lot of potential projects to choose from.

Posted 9-May-15 18:47pm

Mehdi Gholam