Click here to Skip to main content
15,913,773 members
Home / Discussions / C#
   

C#

 
GeneralRe: Steaming real-time data to a file - recommendations? Pin
Luc Pattyn5-Jan-11 10:47
sitebuilderLuc Pattyn5-Jan-11 10:47 
GeneralRe: Steaming real-time data to a file - recommendations? Pin
Wjousts6-Jan-11 3:57
Wjousts6-Jan-11 3:57 
AnswerRe: Steaming real-time data to a file - recommendations? Pin
Luc Pattyn6-Jan-11 4:05
sitebuilderLuc Pattyn6-Jan-11 4:05 
GeneralRe: Steaming real-time data to a file - recommendations? Pin
Wjousts6-Jan-11 11:49
Wjousts6-Jan-11 11:49 
AnswerRe: Steaming real-time data to a file - recommendations? Pin
Wjousts6-Jan-11 3:57
Wjousts6-Jan-11 3:57 
AnswerRe: Streaming real-time data to a file - recommendations? Pin
Kythen6-Jan-11 9:16
Kythen6-Jan-11 9:16 
GeneralRe: Streaming real-time data to a file - recommendations? Pin
Wjousts6-Jan-11 11:52
Wjousts6-Jan-11 11:52 
AnswerRe: Streaming real-time data to a file - recommendations? Pin
jschell6-Jan-11 9:21
jschell6-Jan-11 9:21 
Wjousts wrote:
The data coming from the sensor isn't particularly fast, it's about 7Hz and what I need to store is the time since the start of recording (in seconds, stored as a double) and the value from the sensor (also a double). I could easily see an hour of data being collected at one time which I (very) roughly estimate as being about 1.5 Mb of raw data. Ultimately this would need to be saved in a human readable format (or at least an Excel importable format) maybe tab delimited text, so the file size on disk would be several times bigger.
So any thoughts? Recommendations? Am I better off trying to store as much as possible in memory and then only write to disk when recording ends? Or is it better to try and write pieces as it's collected?


Where 7 Hz = 7 inputs per second?

In a 24 hour period that gives you 600,000+ rows. Exclusive of finding one value at a specific time or a range in small interval that isn't going to be human readable regardless of what you do.

Storage as text if you store only the time would be probably 12 meg for each day.

You could do one csv file per day.

If you really want to do time since start rather than time of day then you should plan on putting the time the app started either in the file name or at the beginning of the file. The date of course would be in the file name.
GeneralRe: Streaming real-time data to a file - recommendations? Pin
Wjousts6-Jan-11 11:55
Wjousts6-Jan-11 11:55 
AnswerRe: Streaming real-time data to a file - recommendations? Pin
carbon_golem7-Jan-11 5:14
carbon_golem7-Jan-11 5:14 
Questioncall an opener form method Pin
mabrahao5-Jan-11 3:17
mabrahao5-Jan-11 3:17 
AnswerRe: call an opener form method Pin
Paladin20005-Jan-11 3:43
Paladin20005-Jan-11 3:43 
GeneralRe: call an opener form method Pin
mabrahao5-Jan-11 3:50
mabrahao5-Jan-11 3:50 
GeneralRe: call an opener form method Pin
Paladin20005-Jan-11 3:59
Paladin20005-Jan-11 3:59 
GeneralRe: call an opener form method Pin
mabrahao5-Jan-11 4:19
mabrahao5-Jan-11 4:19 
GeneralRe: call an opener form method Pin
Paladin20005-Jan-11 4:22
Paladin20005-Jan-11 4:22 
GeneralRe: call an opener form method Pin
mabrahao5-Jan-11 4:27
mabrahao5-Jan-11 4:27 
GeneralRe: call an opener form method Pin
Paladin20005-Jan-11 4:41
Paladin20005-Jan-11 4:41 
AnswerRe: call an opener form method Pin
Blue_Boy5-Jan-11 4:05
Blue_Boy5-Jan-11 4:05 
GeneralRe: call an opener form method Pin
Luc Pattyn5-Jan-11 5:31
sitebuilderLuc Pattyn5-Jan-11 5:31 
AnswerRe: call an opener form method Pin
dan!sh 5-Jan-11 5:19
professional dan!sh 5-Jan-11 5:19 
AnswerRe: call an opener form method Pin
fjdiewornncalwe5-Jan-11 6:19
professionalfjdiewornncalwe5-Jan-11 6:19 
GeneralRe: call an opener form method [modified] Pin
Paladin20005-Jan-11 6:33
Paladin20005-Jan-11 6:33 
AnswerRe: call an opener form method Pin
fjdiewornncalwe5-Jan-11 7:05
professionalfjdiewornncalwe5-Jan-11 7:05 
AnswerRe: call an opener form method Pin
Paladin20005-Jan-11 7:33
Paladin20005-Jan-11 7:33 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.