Compare two CSV file

Question

1.00/5 (1 vote)

See more:

I need a code in C# which compare two CSV file and saving the not matched column number and data in 3rd CSV file.
CSV can have 1 lakh rows and 30 columns.

Posted 27-Oct-15 23:31pm

Member 12093779

Updated 28-Oct-15 2:09am

v2

Add a Solution

Comments

phil.o 28-Oct-15 5:53am

Not a question.

Andreas Gieriet 28-Oct-15 16:30pm

The difficult thing is to distinguish between a different record and an additional/missing record. How to synchronize where to continue searching for matches? Or are both CSV files assumed to be of same number or records and same "sorting" or records?
Regards
Andi

Member 12093779 29-Oct-15 3:20am

Ya both csv will have same number of records and same column name

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

CPallini · Answer 1 · 2015-10-28T00:12:00

Solution 1

Write a (possibly fast) CSV parser and do the job.
Have a look at this Code Project article: "A Fast CSV Reader"[^].

Posted 28-Oct-15 0:12am

CPallini

v2

cigwork · Answer 2 · 2015-10-28T10:22:00

Assuming your CSV files to be compared have the same column "names" then if you have access to SQL Server, SQL server express would do, then I'd suggest importing each CSV file into separate tables (use T SQL "BULK INSERT") and using SQL queries to identify which rows have columns that don't match. You can use the query output to generate (e.g. from a dataset) your output CSV file.

Lakh (100,000?) row comparisons in SQL are likely to be faster than anything you can write yourself.

See solution 1 for the following question for a few hints on how to import CSV files into SQL server from code. *Warning* you'll need to modify it a bit for your problem if you do decide to try this approach.

SQL Procedure with insert[^]

If you've got access to SQL server DBs via SQL Server Manager (or whatever it's called this week) and this is not a procedure that needs automating then there is (or used to be) a wizard that will guide you through importing a CSV file.