What is best solution for read alot of txt file

Question

0.00/5 (No votes)

See more:

hi there is about 200 .txt file in a server , every file have about 20 number. these files change every 10 second. capacity of each file is about 250 byte.

i want to use theme for draw a chart or calculating or ...every 10 second

what is best and fastest solution for this scenario ?

should i read theme online and save every number of files in a array ?
i want to use 10 thread and each thread read 20 files and save content of a file in one line of array . is it true ?
if i do this, can i read this array in same time with another thread ?

What I have tried:

i want to use 10 thread and each thread read 20 files and save content of a file in one line of array

Posted 23-Mar-16 21:05pm

itman2

Updated 23-Mar-16 21:49pm

Add a Solution

Comments

RickZeeland 24-Mar-16 7:54am

I agree with Beefcake, you need the FileSystemWatcher class, here is an example:
http://www.codeproject.com/Articles/58740/FileSystemWatcher-Pure-Chaos-Part-of

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Matt Comb · Answer 1 · 2016-03-23T21:49:00

As a general rule of thumb when considering a multi-threaded approach, consider if there is any latency in the thread that would benefit from parallelization.

In this case I suspect that you are thinking the wait time while waiting for a file to change is your latency.

A better performing model is to do the following.

1. Use a directory / file watching mechanism which reports changed/new files when they occur, do nothing in the event OTHER than set the dirty flag on the file item in your array.
2. Have a single thread that checks for dirty items, and then reads them from their file.
3. Have a render thread which a) copies your array to a second render array b) renders the chart from the render array

At all points you want to minimize the amount of time thread contention can occur, and use event driven mechanics where possible.