How do I get data from 10th line, in a website

Question

0.00/5 (No votes)

See more:

, +

C#

var ele = (
                from T in webBrowser1.Document.GetElementsByTagName("div").Cast<HtmlElement>()
                where T.GetAttribute("classname") == "ball ball-1"
                select T).FirstOrDefault();

Hey, im trying to make a simple csgodouble bot, with a ui. I want to get some data from a website called, csgodouble. but i have came into a problem.

div data-rollid="310835" class="ball ball-1">1 /div

html element.
but there are 10 lines there look like that, with very small different, and they change each minute or so. how can you only get the data from the 10th line??
have tried to use the code above, but it will read all the 10th line.

i know xpath, will provide you to only get data from 10th line. but have no clue how to use it, to get that data in my application. i use the windowsapplication project in visual studio.
//*[@id="past"]/div[10] xpath code.

i have searched all over google for help, cant seem to find anything!

If have know how to fix it, and will help. please say what you have done, and why. so i can get a better understanding of c# and code in general.

update to the question d 5/18-2016 - 9:51

C#

http://imgur.com/a/7VdHB

Hey here can you see my code, and the source code from csgodouble.

I have tried everything to get the 10th line information.
have tried ElementAtOrDefault(9); at 10, instead of 9.. but doesnt seem to work
the data-rollid change every time a new number comes in.

i want to get output, if it was red, black or green there won.
the last line in the source code, is color that won
ball ball-1 = red
ball ball-8 = black
ball ball-0 = green</pre>

What I have tried:

C#

var ele = (
                from T in webBrowser1.Document.GetElementsByTagName("div").Cast<HtmlElement>()
                where T.GetAttribute("classname") == "ball ball-1[10]"
                select T).FirstOrDefault();

And other simpler code, but i have delete them. tried a little bit of xpath. but not much.

Posted 16-May-16 20:54pm

Member 12527869

Updated 17-May-16 21:52pm

v5

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Richard Deeming · Accepted Answer · 2016-05-17T02:27:00

Solution 1

If you want to get the 10th item from the sequence, replace FirstOrDefault with ElementAtOrDefault[^]:

C#

var parent = webBrowser1.Document.GetElementById("past");
if (parent != null)
{
    var balls = from b in parent.GetElementsByTagName("div").Cast<HtmlElement>()
                where b.GetAttribute("classname").StartsWith("ball ball-")
                select b;
    
    var theBall = balls.ElementAtOrDefault(9);
    if (theBall != null)
    {
        // Do something with the element here...
    }
}

NB: The index is zero-based, so the 10th element is at index 9.

Posted 17-May-16 2:27am

Richard Deeming

Updated 18-May-16 2:48am

v3

Comments

Member 12527869 17-May-16 9:36am

Well theirs website is down right now, i will get back, when it comes up. i hope i work!!

Member 12527869 18-May-16 2:53am

Hey, i have tried it, and i cant get it to work, it does not found the 10th line, have tried different ways to use ElementAtDefault. but cant seem it to work. have you another idea?

Richard Deeming 18-May-16 7:08am

Try splitting the part that extracts the elements on to its own line:

var elements = from T in webBrowser1.Document.GetElementsByTagName("div").Cast<HtmlElement>()
   where T.GetAttribute("classname") == "ball ball-1"
   select T;

var ele = elements.ElementAtOrDefault(9);

Then, set a breakpoint on the second line, and inspect the results in the elements variable to make sure you've got at least 10 items.

If you haven't got at least 10 items, then you'll need to look at the document to see where you've gone wrong.

As a guess, I would suggest that not all of the elements have the CSS class ball ball-1; the "ball-1" part is probably a sequential number.

Member 12527869 18-May-16 8:34am

i havnt used the debug mode before, so i have no clue what to look after, it returns a null. Am im right if i said, that i doesnt work when it returns a null??

i tried the debug mode another part of my code, that i know works. but it shows the same thing..

Yeah the ball ball-1, doesnt work, beacuse it a class, and it not every time that there are 10 lines with only ball ball-1 classes.

i have done it with (div) (id) past, as shown in my edit of the main question.

Richard Deeming 18-May-16 8:47am

If you don't have 10 elements where the class name is equal to "ball ball-1", then you can't find the 10th element matching that condition!

Try looking for elements where the class name starts with "ball ball-". You can also restrict the search to elements with the specific parent <div> - see my updated solution.

Member 12527869 18-May-16 8:59am

http://imgur.com/UwohgCN
Here can you see what my debugging shows me, i cant seem to find any "elements"
am i even in the right place??

Richard Deeming 18-May-16 9:08am

Did you not read my comment, or my updated answer?!

You CANNOT use == to compare the class name attribute, because the class name is not the same on all of the elements.

That's why I told you to use StartsWith.

Go back and re-read my answer. Then update your code to match my answer, and try again.

Member 12527869 18-May-16 9:13am

Dude, thank you so much!!
i did not see that you have changed my == to StartsWith, i have used == in code simlar to this one..
But thanks you have literally saved my week :)

do you know a way, to see if the 10th line was
ball ball-1, ball ball-8 or ball ball-0?

Richard Deeming 18-May-16 9:20am

Once you've got theBall, and verified that it's not null, you can call theBall.GetAttribute("classname") to retrieve the CSS class ("ball ball-1", "ball ball-8", "ball ball-0", etc).

Member 12527869 18-May-16 9:49am

private string IfYouWinOrNotRed()
{
var parent = webBrowser1.Document.GetElementById("past");
if (parent != null)
{
var balls = (
from T in webBrowser1.Document.GetElementsByTagName("div").Cast<HtmlElement>()
where T.GetAttribute("classname").StartsWith("ball ball-")
select T);
var theBall = balls.ElementAtOrDefault(9);
theBall?.GetAttribute("classname").StartsWith("ball ball-1");

return "won";

}

return null;
}

this is my code, im not sure where to put that theBall.GetAtrribue.
The code does not work, the way i want it to. where should i put theBall.GetAtrribute??

Richard Deeming 18-May-16 9:55am

Try something like this:

var theBall = balls.ElementAtOrDefault(9);
if (theBall?.GetAttribute("classname") == "ball ball-1") return "won";

Member 12527869 18-May-16 9:58am

Jup that worked, i feel stupid, for not thinking about that, it so simple XD

Well i only have 1 problem left to finish up my program, maybe can you help me with it.
i only need to get the data from the 10th line, when ever it updated, not when i start my program, but when the 10th line change to something else, there will i need to get the data

do you know how to do that?

Richard Deeming 18-May-16 10:03am

There isn't an event that gets raised when the class of an element changes. Without cooperation from the site owners, you'll have to check the state of the element every few seconds to see if it's changed. It's probably easiest to do that using a Timer control[^].

Member 12527869 18-May-16 11:08am

i come with this code: Task<timer> control = WaitForIfYouWinOrNotRed();
but how do i add how many seconds it should wait before it check the state of the element agian?

Richard Deeming 18-May-16 11:14am

* Drag a Timer control onto your form.

* Set its Interval to a reasonable value.

* Double-click on the Timer to create a handler for its Tick event.

* In the handler for the Tick event, check the state of the document.

Member 12527869 18-May-16 11:22am

What happen after the interval are gone? does it restart?
and how to check for the timer?

Richard Deeming 18-May-16 11:26am

What?

The Timer ticks; you check the state of the document. That's it.

Where does "restart" come into it? And what are you planning to "check" about the Timer?

Member 12527869 18-May-16 11:29am

Nvm
how to implement the timer in your code.
i mean that i have created what it should search for, after the ticks ends.
but how can my other code know that?
should i just call the timer in my "main" code?

Richard Deeming 18-May-16 11:34am

When you're ready to start checking, set the Timer's Enabled property to True.

The Timer will then raise its Tick event after the length of time you've specified in the Interval property has passed. For example, if you set the Interval to 1000, the Tick event will be raised every second.

In the handler for the Tick event, you check the state of the document, and update your UI based on that state.

Member 12527869 18-May-16 12:53pm

i cant use the code timer1.enable, it says i should put a get; set; on it, but when i do it will still call a error. how should i then enable the timer?

Richard Deeming 18-May-16 12:54pm

timer1.Enabled = true;

Member 12527869 18-May-16 13:12pm

Thank you, that kinda simple.

last question:
<span id="banner">Rolling in 15.70...</span>
how do i get the data inside this?
i want to get "Rolling in 15.70..." how to get that?

Richard Deeming 18-May-16 13:15pm

var banner = webBrowser1.Document.GetElementById("banner");
string bannerText = banner?.InnerHtml;

Member 12527869 18-May-16 13:23pm

Thank you!
how can i tell my code, when the banner.innerhtml, are at "Rolling in 45.00..."
it will continue on with the rest of the code??

Richard Deeming 18-May-16 13:28pm

What?

Sorry, that comment makes no sense.

Member 12527869 18-May-16 13:30pm

Okay,
<span id="banner">Rolling in 15.70...</span>
"Rolling in 15.70..." when it reset, it will be "Rolling in 45.00..."
i want to do something when the banner?.InnerHtml is outputing "Rolling in 45.00..."

does that make more sense? if not i will try to explain it agian

Sorry for my bad english, im from denmark btw

Richard Deeming 18-May-16 13:36pm

That's OK - your English is better than my (non-existent) Danish. :)

There's no event raised when the text of an element changes, so you're going to need a second timer. In the timer2_Tick handler, read the InnerHtml of the element. If it matches the expected value, trigger your "do something" code.

Member 12527869 18-May-16 13:43pm

var banner = webBrowser1.Document.GetElementById("banner");
string bannerText = banner.InnerHtml;

if (bannerText == "Rolling in 45.00...")
{

}
im stuck at these.
i want it to stop my, do method, until it have reached "Rolling in 45.00..."
some way to do that?

Richard Deeming 18-May-16 13:46pm

Add a second timer to the form.
Set the Interval to something sensible.
Double-click to create the event handler.

protected void timer2_Tick(object sender, EventArgs e)
{
   var banner = webBrowser1.Document.GetElementById("banner");
   string bannerText = banner?.InnerHtml;
   if (bannerText == "Rolling in 45.00...")
   {
      DoSomething();
   }
}

Member 12527869 18-May-16 13:52pm

I dont want it to do something, i just want it to pause my "main" code, until the bannertext = "Rolling in 45.00..."

Richard Deeming 18-May-16 14:03pm

OK, that sounds like something that would be best done with async / await:
Asynchronous Programming with async and await (C#)[^]

Let me see if I can put together an example.

Richard Deeming 18-May-16 14:44pm

OK, let's start with a helper method:

public static async Task WaitUntil(Func<bool> condition, TimeSpan checkInterval)
{
   if (condition == null) throw new ArgumentNullException(nameof(condition));
   if (checkInterval <= TimeSpan.Zero) throw new ArgumentOutOfRangeException(nameof(checkInterval));

   while (!condition())
   {
      await Task.Delay(checkInterval);
   }
}

This will call the specified function repeatedly at the specified intervals until it returns true.

Richard Deeming 18-May-16 14:44pm

You then need two functions for the conditions you want to test:

private bool IsRollingIn45()
{
   var banner = webBrowser1.Document.GetElementById("banner");
   string bannerText = banner?.InnerHtml;
   return (bannerText == "Rolling in 45.00...");
}

private bool HasWonOrNotRed()
{
   var balls = (
      from HtmlElement b in webBrowser1.Document.GetElementsByTagName("div")
      where b.GetAttribute("classname").StartsWith("ball ball-")
      select b
   );
   
   var tenthBall = balls.ElementAtOrDefault(9);
   return tenthBall.GetAttribute("classname") == "ball ball-1";
}

Richard Deeming 18-May-16 14:45pm

Then you can write your main code as an async method:

protected async Task DoYourFunkyThang()
{
   while (ShouldKeepDoingIt)
   {
      await WaitUntil(IsRollingIn45, TimeSpan.FromSeconds(1));
      Console.WriteLine("Rolling in 45...");
      
      await WaitUntil(HasWonOrNotRed, TimeSpan.FromSeconds(1));
      Console.WriteLine("won");
   }
}

Member 12527869 18-May-16 14:26pm

Well i have tried async, and await, i cant seem it work. await, was my alternativ, to what i try to make now :)
Do you know a solution to this??

Member 12527869 18-May-16 15:06pm

protected async Task DoYourFunkyThang()
{
while (ShouldKeepDoingIt)
{
await WaitUntil(IsRollingIn45, TimeSpan.FromSeconds(1));
Console.WriteLine("Rolling in 45...");

await WaitUntil(HasWonOrNotRed, TimeSpan.FromSeconds(1));
Console.WriteLine("won");
}
}

why should it be protected, and why should i do "console.writeline"? when it have nothing to do with console, but form application :)?

Richard Deeming 18-May-16 15:07pm

That's just an example of the sort of thing you can do once you have the helpers in place.

I don't know what your "main code" is doing, so I just had to make something up.

Member 12527869 18-May-16 15:12pm

Okay, it might be problem with my computer, but when i comes to 40.00 (yeah i have change it from 45.00) but the program freeze when it get around 40.00.

Something with the code?

and i have changed the seconds to milliseconds, because it did not react with seconds.

Richard Deeming 18-May-16 15:15pm

Probably, but I can't see what your code is doing.

Member 12527869 18-May-16 15:16pm

Do you have service like skype, we maybe could use, to see my code/screen?

Richard Deeming 18-May-16 15:18pm

If the code is too big for the comments, you could put it up on a code sharing site - eg:
GitHub Gist[^]
CodePaste[^]

Member 12527869 18-May-16 15:21pm

https://gist.github.com/anonymous/e19924cd2515312d4fa5ea402bbe9283
Here is all my code
beaware, this is my first program (expect console)
the code might be a little hard to navigate. (i can, but now sure if it easy readable)

Richard Deeming 18-May-16 15:30pm

There's nothing obvious that should cause it to freeze.

I suspect TimeSpan.FromMilliseconds(1) might be too frequent - you might be using up all the CPU checking the element text, and not giving it time to update.

I'd also be inclined to make button1_Click an async void method, and stick an await in front of the AutoBetting() method call.

When the application freezes, you'll need to break into the debugger and try to see what's going on.

Member 12527869 18-May-16 16:02pm

Well, now my screen doesnt freeze, but now my script doesnt rerun.
when it hit await WaitUntil(IsRollingIn45, TimeSpan.FromMilliseconds(1)); it just stop, it does not bet again..

Richard Deeming 18-May-16 16:06pm

Try using TimeSpan.FromMilliseconds(100) instead.

Also try logging the banner text, to make sure you're actually seeing the expected text come up.