|
kevin-rf wrote: I will be working with large data sets (> 4Gb) of binary data
The person that designed that DB should be shot, repeatedly.
|
|
|
|
|
>> I will be working with large data sets (> 4Gb) of binary data
>The person that designed that DB should be shot, repeatedly.
Not a DB application, reading large real world data at high speeds (2 - 5 Mhz) for extended periods. The goal of embedding the XML is to tag some of the parameters used in the data acquisition setup. The thought is XML would be more flexible than a fixed binary header that is very "version" dependant. Data will later be crunched off line into chewable morsels.
The goal is to be able to pull the XML out and make some of the after the fact presentation/processing decisions based upon the XML parameters.
|
|
|
|
|
Ok, maybe I was bit harsh, I was reading XML and Dataset (the class).
IMO it would be easier just to define some C struct and fread it, XML has no real benefit for binary data.
|
|
|
|
|
Well you could Base64 encode data and shove it in an XML, but leppie's right, that wouldn't be a good idea, even with the benefit of extensibility. 4gb of data in XML can get huge.
Your best bet would probably be to sit down and think the file format over on the byte scale keeping in mind all the ways you might possibly need to use it, and then write a reader/writer for it.
|
|
|
|
|
A fair amount of the structuring of the file has been thought out. I am trying to evaluate how to store some of the nondescript data that does not directly effect readout of the binary but would be nice to include with the file. Stuff like the lab bench is green, So and So had to stand on there head spitting nickles to get the test to work, the nickle rate was 2.3 a second.
Embedding binary data in XML is not optimal for two reasons.
1. Encoding Binary Data increases the storage foot print.
2. Encoding the Data is slower than just streaming the data to a HardDrive.
The actual storage of the data will be done in unmanaged C++ for speed (Other side of the cube wall). My goal is to process the data after the fact in C#. The processing is not a CPU intensive, so C# will work nicely. One of the things I am trying to evaluate is, if an XML was tacked into the binary (The structure being defined will support inclusion) how do I get it back. The question is does anyone know of a way to pull the XML out of the binary and dump it into something such as XMLTextReader().
Is there an easy way to generate your XML in memory and then feed it to XMLReader() for parsing?
Thankyou for your feedback...
|
|
|
|
|
You could use XmlDocument. Save the document in the file with a particular encoding (UTF8 is good), note down its size, and then when you load it again, read those bytes and use System.Text.Encoding.Decode to get the xml string back, which you'd read using XmlDocument.Load().
By the way, C# can be as good or better performing than C++ (maybe not more if you consider the fact that C++ can do assembly), believe it or not, even for nitty gritty stuff like this.
Try using C# with pointers; that way you won't have to put the code in a separate assembly. Just make an array of sequential structs and drain all the data in.
|
|
|
|
|
Hello all,
I'm doing a project that does a lot of dynamic inspection of assemblies. Does anyone know of a quick, clean way to save a reference to an assembly within code? In other words, I need some way to persist the information required to locate an assembly so I can load it again later. It's easy enough when it is in the GAC, but what do I do when I want to allow the user to load an assembly from a configurable directory. Any thoughts?
Thanks,
Will
|
|
|
|
|
I think you can do System.IO.Path.GetDirectory(assembly.Location), and then determine the relative path of the file to the configurable directory. You'd probably have to write some code to walk through the subdirectories.
So if the directory is c:\someapp\assemblies and you have an assembly in c:\someapp\assemblies\mammals\dog.dll, the reference would be recorded as mammals\dog.dll.
Just an idea.
|
|
|
|
|
Ok, I've searched my MSDN documentation, but to no avail.
I seem to remember from a different language (whether from C++ or Java, I'm not sure, but I'm leaning toward Java) that, with a two-dimensional array, I could initialize one row at a time, kinda sorta like this:
<br />
someType[][] arrayName = new someType[#][#];<br />
arrayName[0] = new someType[#];<br />
(note syntax of second line!)
Is there a way, in C#, to handle one ROW of a two-dimensional array (as if it were a single-dimensional array)?
I'm aware that the [][] syntax isn't used in C# (I'm aware of the fact that C# instead uses commas in one set of []). But, you get what I'm saying, right?
-Daniel
Typing too fast fro my owngood
-- modified at 16:49 Friday 19th May, 2006
|
|
|
|
|
The [][] syntax is used in C# to create a jagged array (where each sub-array can have a different length). It sounds like that is what you should use.
Josh
|
|
|
|
|
Really? I'll try it again. Thanks!
-Daniel
Typing too fast fro my owngood
|
|
|
|
|
I've created a CharArray that includes alpha characters and Numbers.
For Example the array might look like this:
[a][b][c][1][2][3]
I want to be able to check if each array is a character or an integer. If it's a character I want to assign it an equivelent number I assign.
For example in the first case of [a] I want to check if it's a character. Since it is, I want to assign a's with the number 1. So it will replace [a] with [1]. If it later checks [2] I want it to see that it's an integer and to leave the value at [2].
So my end result might look like this:
[1][2][3][1][2][3]
Any help on this would be appreciated. Sorry for the "noob" questions I have been posting but I am trying to learn  Thanks!
|
|
|
|
|
I would recommend using Int32.TryParse (if you don't want to use Int32.Parse with a try/catch block). That's how I'd do it.
-Daniel
Typing too fast fro my owngood
|
|
|
|
|
TryParse is only available in 2.0 (OP didn't specify whether which version they are using).
Since you're only dealing with single characters, the way I'd do it is to use char.IsDigit and char.IsApha to determine if you're dealing an integer or a character, then do the appropriate conversion.
-----
In the land of the blind, the one eyed man is king.
-- modified at 17:01 Friday 19th May, 2006
|
|
|
|
|
The simplest form of the code.
public class Service : System.Web.Services.WebService
{
public Service () {
//Uncomment the following line if using designed components
//InitializeComponent();
}
[WebMethod]
public string HelloWorld() {
return "Hello World";
}
[WebMethod]
public string PrintXML()
{
// Create a WebBrowser instance.
WebBrowser webBrowserForPrinting = new WebBrowser();
return "Success";
}
}
Hello world works ok.
PrintXML fails with an exception of the form:
System.Threading.ThreadStateException: ActiveX control '8856f961-340a-11d0-a96b-00c04fd705a2' cannot be instantiated because the current thread is not in a single-threaded apartment.
at System.Windows.Forms.WebBrowserBase..ctor(String clsidString)
at System.Windows.Forms.WebBrowser..ctor()
at Service.PrintXML()
Can anyone give me hints on what to do with this?
I've tried using attribute [STAThread] to make the method single threaded but it seems to be getting ignored.
I'm at a loss as to how to instantiate a browser control in a web service. I need to do this so I can send HTML to a printer on the same box as the web service that runs.
thanks!
|
|
|
|
|
Well, AFAIK, IIS doesn't run in single-threaded apartment. You'll have to create another application that can run in single-threaded apartment and make a remoting call to it. For instance, try writing a console app or windows service and have your web method call that. I was wondering if you could create a new AppDomain with a different apartment threading model, but it doesn't look like that's possible.
www.logifusion.com
|
|
|
|
|
That sounds like a workable idea but I dont know how to make a call on an external app from a web service (or from any other windows code for that matter) I'm from linux/java/c and doing these things in windows, I just dont know how yet.
Anyone shed any light on how to make a call out to an external app from a web service?
Thanks!
|
|
|
|
|
|
C# novice - seeking feedback on the proper way to code a break report.
If you had two cvs files and needed to create a break report: (i.e. records in a but not in b, in b but not in a, in a and in b but mis-matched on data, how would you approach it?
I'm planning on loadeing the data into two DataTables, a and b, I've defined within the code, and looping as follows:
foreach (row in a)
find row.key in b
--if not found, copy source row into a-not-b table
--if found, compare
--- if not matching, copy rows and break info into data-break table
--- either way, if found, remove matched row from b table
end foreach
report a-not-b
report b (any remaining rows represent b-not-a)
and data-break
I'm concerned that I don't know the .Net language well enough, and I might be going about this the wrong way. Are there better choices in loading the data that provide 'set-operations' that I can use, to make this process cleaner?
Thanks!
Pauli
|
|
|
|
|
|
hello,
i am attempting to create a program using windows forms. there is a MDIParent form with several children. i have programmatically set the size of the child forms in the constructor, but for some reason they are popping up the wrong size. this is also happening with several controls that i've created. i have no idea why this keeps happening. can anyone help?
thanks!
rc
|
|
|
|
|
IIRC you need to set the FormStartupPosition property to Manual. You need to set both the Location and Size in parent coords.
|
|
|
|
|
Hello
I'm pretty new for the most part to programming in C# and I'm attempting to do something that I haven't been able to locate a solution for. Any help would be appreciated.
I have a text file with data in it that looks kind of like this:
BHG0002304050
BHG9459895944
BHG94859489568
I was able to write a snippet of code that would read that information into a string array so it looked like this:
Array[1] = BHG0002304050
Array[2] = BHG9459895944
Array[3] = BHG94859489568
However, I now want to separate each character within the array into it's own array... so it would look like this:
array1[1] = B
array1[2] = H
array1[3] = G
array1[4] = 0
etc.
I'm not sure I'm doing this the correct way so any help would be appreciated. If you have any suggestions on how to do this a different way then I'm explaining it I'm very open to ideas.
The reason for this is I will be using each of these characters in this datafile into a mathematical formula, each line represents a math formula... so I need to keep each line separate but I need to pull each character from each line if that makes sense.
thanks!
|
|
|
|
|
string[] t = reader.ReadToEnd().Split('\n');
char[][] all = new char[t.Length][];
for (int i = 0; i < t.Length; i++)
{
t[i] = t[i].Trim('\r');
all[i] = t[i].ToCharArray();
}
|
|
|
|
|
Thanks for the quick response.
This example really helped me get it figured it.
-- modified at 15:34 Friday 19th May, 2006
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
