|
|
I am attempting to automate the downloading of a file from a website that requires user login. At this point i want to get clarification of the steps i need to follow to accomplish this. Currently i am doing the following (in pseudo code) without success:
--Make POST HttpWebRequest/HttpWebResponse of "Login.php" that posts login username and password;
--Get response cookie collection and put into CookieContainer variable;
--Make HttpWebRequest/HttpWebResponse of "Content.php"; assign CookieContainer variable to request;
--Get GetResponseStream of response and put HTML content into String;
--Parse HTML content for download link;
--Download link to disk;
--Process downloaded file....
With this code, the HTML retrieved from Content.php is for a webpage shown to users that have not loged on and so the download link is not shown. Below is test code for the above.
// ##################################################################
public void TEST()
{
// login
// forms authenticate
string loginUri = AppGlobal.LoginUrl;
string requestString = "username=" + AppGlobal.UserName + "&password=" + AppGlobal.Password + "&autologin=checked";
byte[] requestData = Encoding.UTF8.GetBytes(requestString);
HttpWebRequest request = null;
Stream stream = null;
HttpWebResponse response = null;
// set up request
_cookies = new CookieContainer();
request = (HttpWebRequest)WebRequest.Create(loginUri);
request.Proxy = null;
request.CookieContainer = _cookies;
request.Method = "POST";
request.ContentType = "application/x-www-form-urlencoded";
request.ContentLength = requestData.Length;
// make form post
stream = request.GetRequestStream();
stream.Write(requestData, 0, requestData.Length);
// get response
response = (HttpWebResponse)request.GetResponse();
// update cookies
foreach (Cookie returnCookie in response.Cookies)
{
// debug help
Debug.WriteLine("COOKIE: " + returnCookie.Name + " = " + returnCookie.Value);
// compare new cookie with stored cookie
// update cookie container
bool cookieFound = false;
foreach (Cookie oldCookie in _cookies.GetCookies(new Uri(AppGlobal.CookieUrl)))
{
if (returnCookie.Name == oldCookie.Name)
{
oldCookie.Value = returnCookie.Value;
cookieFound = true;
}
}
if (cookieFound == false)
{
_cookies.Add(new Uri(AppGlobal.CookieUrl), returnCookie);
}
}
// get webpage
request = (HttpWebRequest)WebRequest.Create(new Uri(AppGlobal.StartUrl));
request.Proxy = null;
request.CookieContainer = _cookies;
// get response
// check link
response = (HttpWebResponse)request.GetResponse();
string statusCode = response.StatusCode.ToString();
if (statusCode == "OK")
{
// handle cookies
foreach(Cookie returnCookie in response.Cookies)
{
bool cookieFound = false;
foreach(Cookie oldCookie in _cookies.GetCookies(new Uri(AppGlobal.CookieUrl)))
{
if (returnCookie.Name == oldCookie.Name)
{
oldCookie.Value = returnCookie.Value;
cookieFound = true;
}
}
if (cookieFound == false)
{
_cookies.Add(returnCookie);
}
}
// handle redirection
// get link html
StreamReader reader = new StreamReader(response.GetResponseStream());
string content = reader.ReadToEnd();
// check for failed log in
int position = content.IndexOf("Please log in to download");
if (position > -1)
{
Debug.WriteLine("FAILED");
}
Debug.WriteLine(content);
}
}
|
|
|
|
|
Have you already searched on Code Project? There are several articles that talk about how to do this, including this[^] one.
|
|
|
|
|
Yes, i have done search of the internet. I got code examples for downloading files using credentials. In order to download the file in my problem, user has to login to website using a POST webform, then go to webpage with link on it, then download link. One cannot go to webpage direct as webpage will not show download link without login cookie. One cannot go to download link directly as link changes name and so one must parse HTML for it first.
My problem is that after i do POST to the login page and get login cookies back, i cannot seem to use these cookies to retrieve the desired webpage. I keep getting the webpage version shown to users not logged in (which does not contain the download link). Since i am new at this, i am not sure what i am doing wrong.
|
|
|
|
|
Hi dude,
I've got the same problem here. I have figured out that the problem raises from the fact that the cookie returned to you from the first request is not persisted on the server, so you are not recognized when you request the second page. I am trying to solve this problem though. Please tell me if you've figured out the problem nearly after a year.
Thanks
|
|
|
|
|
Hi.
I am having trouble parsing a string into the format I want.
Basically, I want the string to end up being "MMdd" where MM is the month (with a leading zero if necessary) and dd is the day (with a leading zero if necessary).
This is what I have tried:
String today = DateTime.Today.Date.ToShortDateString();
String pattern = "MMdd";
DateTime dt_today = DateTime.ParseExact(today, pattern, null); // line 3
today = dt_today.ToString();
Console.WriteLine("today's date is: " + today);
The problem is that my program crashes once run. If you look at the third line, in place of null, I have tried sending: System.Globalization.CultureInfo.InvariantCulture, System.Globalization.CultureInfo.CurrentCulture
Both yielded the same result. I have also tried using "Now" instead of "Today" in the first line.
What am I doing wrong?
I'd appreciate any help.
|
|
|
|
|
I'd use an overload of the ToString method on the datetime, which allows you to specify the format. This looks like too many steps to take, to me.
Christian Graus - Microsoft MVP - C++
"I am working on a project that will convert a FORTRAN code to corresponding C++ code.I am not aware of FORTRAN syntax" ( spotted in the C++/CLI forum )
|
|
|
|
|
Hi,
if you want your ParseExact to succeed, today must consist of exactly four digits.
So it all depends on your regional settings, which control the outcome of ToShortDateString().
You could try String today = DateTime.Today.Date.ToString("MMdd");
Luc Pattyn [Forum Guidelines] [My Articles]
this months tips:
- use PRE tags to preserve formatting when showing multi-line code snippets
- before you ask a question here, search CodeProject, then Google
|
|
|
|
|
What exactly are you trying to do? Do you already have a DateTime object that you are trying to display in a specific format? If so, you just need to call ToString on that object and pass the format string you want.
The code you show takes a DateTime object, converts it to a string, and then tries to parse that string and convert it back to a DateTime object, which you then call ToString on to turn it back into a string.
You can accomplish the same thing by doing this: Console.WriteLine("today's date is: " + DateTime.Today.ToString("MMdd"));
|
|
|
|
|
Thanks all for the replies!
I ended up using the overloaded ToString method.
|
|
|
|
|
I like how all the replies say the same thing 
My current favourite word is: Waffle
Cheese is still good though.
|
|
|
|
|
I had a chance to learn WPF for a little while and found a useful feature which I want to create in WinForm, but not sure how to do so. I was wonder if there's a way to create an expander (just like how it work in WPF) in WinForm? Thanks...!
tant tant 
|
|
|
|
|
You mean create a way for your form to expand or contract ? It won't work as smooth, but just run a timer, and inside it, set the size of your form, or your controls, or whatever.
Christian Graus - Microsoft MVP - C++
"I am working on a project that will convert a FORTRAN code to corresponding C++ code.I am not aware of FORTRAN syntax" ( spotted in the C++/CLI forum )
|
|
|
|
|
Yes, In my WinForm, I want to create a function where i can expand and collapse each sections. Right now I have it by using UserControl and Panel, then each time a user hit the button it hides the Panel. However, the way I have it does not work so well because I'll then have to create a user control for each sections and one form and run to 10 sections. Please advice.
|
|
|
|
|
Is this[^] what you are looking for?
Take care,
Tom
-----------------------------------------------
Check out my blog at http://tjoe.wordpress.com
|
|
|
|
|
Well, I just want an expander function like how WPF have it, but not sure how to create that in WinForm?
|
|
|
|
|
Hi,
I am looking for any help or tutorials on creating a program that is trial until user activates to their system hardware, or using a serial number, either is required.
Thanks, Andrew.
|
|
|
|
|
You can see HASP hardware keys. But if you develop .NET application, it can't help you very much, because, as I know, it's easy to decompile application and switch off security system.
|
|
|
|
|
Hi Andrew,
Try taking a look at this article[^].
Take care,
Tom
-----------------------------------------------
Check out my blog at http://tjoe.wordpress.com
|
|
|
|
|
hello , im having a problem with the DataGridViewButtonColumn/DataGridViewButtonCell
i am trying to apend a button cloumn to my datagridview so everytime the user is clicking on one of the buttons in the grid an event will fire ,
i have noticed there is no access to events in the DataGridViewButtonColumn but there is an onClick protected method which fires when the user clicks the button, so i made my own class which drives from it and added my own event here is the code:
<br />
public delegate void buttonClickHandler(DataGridViewCellEventArgs e);<br />
class DataGridViewButton : DataGridViewButtonCell<br />
{<br />
public event buttonClickHandler buttonClick;<br />
<br />
protected override void OnClick(DataGridViewCellEventArgs e)<br />
{<br />
if (buttonClick != null)<br />
{<br />
buttonClick(e);<br />
this.DataGridView.InvalidateCell(this);<br />
}<br />
else<br />
{<br />
Console.WriteLine("button event was set to null");<br />
}<br />
base.OnClick(e);<br />
}<br />
<br />
<br />
}<br />
i used this DataGridViewButtonCell in my program like that:
<br />
.<br />
.<br />
.<br />
DataGridViewButtonColumn dgvBC = new DataGridViewButtonColumn();<br />
<br />
DataGridViewButton bc = new DataGridViewButton();<br />
bc.buttonClick += new buttonClickHandler(dgv_button_click);<br />
<br />
dgvBC.CellTemplate = bc;<br />
<br />
dataGridView1.Columns.Add(dgvBC); <br />
.<br />
.<br />
. <br />
The Problem:
each time the buttonClick Event fires when the user clicks on one the buttons in the datagridview
the event is for some reason is null , what did i do wrong?
is there any better way to do this? , any advice will be more than welcome , thanks!
Net
|
|
|
|
|
I am currently working on an app that requires large volumes of processing. The long story short, it was determined that threads would be the best way to split it up and increase performance of the application. Heres the catch: I have to use STA as the com objects used are registered as STA objects. Fun!
I ran a quick test with one STA/thread and two STA/threads both running the same code and the results show that the single thread was actually faster than using two threads. I figure this is due to the nature of the message queue and sequential processing. So my question is this, is there any way to have an STA that can process simultaneously without a performance decrease? My code is fairly simple:
<br />
ParameterizedThreadStart workerThread = new ParameterizedThreadStart(EditFeatureClass);<br />
Thread protoThread = new Thread(new ThreadStart(ItterateFeatureClass)); <br />
protoThread = new Thread(workerThread);<br />
protoThread.SetApartmentState(ApartmentState.STA); <br />
protoThread.Name = featureName;<br />
protoThread.Priority = ThreadPriority.Highest;<br />
protoThread.IsBackground = true;<br />
protoThread.Start((object)featureName);<br />
<br />
}
Any suggestions and comments would be appreciated (And no, I am stuck with STA).
I have posted a copy of the unedited document I have been working on in regards to this if it helps. It should be the second link - Thread Performance Testing.[^]
-- modified at 18:25 Thursday 4th October, 2007
_____________________________________________________________________
Our developers never release
code. Rather, it tends to escape, pillaging the countryside all around.
The Enlightenment Project (paraphrased comment)
Visit Me at GISDevCafe
|
|
|
|
|
Aaron VanWieren wrote: it was determined
what do you mean "determined"? Does that mean "assumed"? I suggest Advanced Windows by Richter, it might be able to shine some light on your subject.
|
|
|
|
|
It was the direction my boss said to go. Read some Richter, will look into that one.
_____________________________________________________________________
Our developers never release
code. Rather, it tends to escape, pillaging the countryside all around.
The Enlightenment Project (paraphrased comment)
Visit Me at GISDevCafe
|
|
|
|
|
Hi,
you did not tell us much about ItterateFeatureClass. If all it does is call your COM
object, I am afraid the only way to get it really multi-threading is by providing multiple
identical COM objects, one per thread, assuming the functionality allows that.
The alternative of course would be putting the multithreading right inside the COM object
itself, but I guess that is not what you hope for.
Luc Pattyn [Forum Guidelines] [My Articles]
this months tips:
- use PRE tags to preserve formatting when showing multi-line code snippets
- before you ask a question here, search CodeProject, then Google
|
|
|
|
|
IterateFeatureClass() is just a test class for right now that performs a number of editing operations, which are set up through the COM objects. I would have included that code but it includes allot of third party library stuff that is registered as STA. I ran a test with two threads and my time doubled compared to my single thread test. I made sure to time the performance for just the iterations as well as the setup and tear down.
Basically my test code is creating a workspace(think database connection) and retrieving a featureclass(think table). From this feature class it creates an object and adds a feature(think row) then modifies a field(think column) and finally it stores it in the workspace. I am trying to explain this without getting too much into the library as it is different terminology. But I have ensured that all the COM Components are generated withing the STA thread.
Luc Pattyn wrote: The alternative of course would be putting the multithreading right inside the COM object
itself, but I guess that is not what you hope for.
As this is a library I cannot modify I cannot do this.
The interesting this is that a colleague of mine attempted this and just through it together with MTA threads. In my testing I discovered this was the worst thing to do performance wise as it took the MTA thread 8 mins to do what an STA thread was doing in 4!
Hope this helped a little bit more.
_____________________________________________________________________
Our developers never release
code. Rather, it tends to escape, pillaging the countryside all around.
The Enlightenment Project (paraphrased comment)
Visit Me at GISDevCafe
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
