Click here to Skip to main content
15,913,055 members
Home / Discussions / C#
   

C#

 
AnswerRe: GDI+ P/Invoke [modified] Pin
DaveyM696-Mar-10 10:21
professionalDaveyM696-Mar-10 10:21 
GeneralRe: GDI+ P/Invoke Pin
StarBP6-Mar-10 10:36
StarBP6-Mar-10 10:36 
GeneralRe: GDI+ P/Invoke Pin
DaveyM696-Mar-10 10:40
professionalDaveyM696-Mar-10 10:40 
GeneralRe: GDI+ P/Invoke Pin
StarBP6-Mar-10 10:50
StarBP6-Mar-10 10:50 
QuestionCreating a web sniffer that will browse and get data from websites Pin
melquiades_is_alive6-Mar-10 8:23
melquiades_is_alive6-Mar-10 8:23 
AnswerRe: Creating a web sniffer that will browse and get data from websites Pin
Luc Pattyn6-Mar-10 8:56
sitebuilderLuc Pattyn6-Mar-10 8:56 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
melquiades_is_alive6-Mar-10 9:05
melquiades_is_alive6-Mar-10 9:05 
AnswerRe: Creating a web sniffer that will browse and get data from websites Pin
Luc Pattyn6-Mar-10 9:38
sitebuilderLuc Pattyn6-Mar-10 9:38 
There is no need for going back; this is how I make a sniffer:

1. create a list of pages already seen; it starts out empty;
2. create a list of pages to visit; it starts out with a single URL;
3. fetch the first page in ToVisit; remove it from ToVisit and add it to AlreadySeen;
4. parse the page and add all URLs of interest to ToVisit, unless they are already in AlreadySeen;
5. if (ToVisit not empty) goto 3

remarks:
1. one advantage of this approach is it performs a breadth-first traversal, so it is not wandering off right away.
2. of course you must be careful to limit the reach of the sniffer; maybe you don't want to parse pages whose URL don't start with the URL of the very first page (so www.XXX.com will visit and scan www.XXX.com/more but will not dive into www.microsoft.com)

Smile | :)
Luc Pattyn [Forum Guidelines] [Why QA sucks] [My Articles]

I only read code that is properly formatted, adding PRE tags is the easiest way to obtain that.

modified on Saturday, March 6, 2010 4:04 PM

GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
melquiades_is_alive6-Mar-10 9:55
melquiades_is_alive6-Mar-10 9:55 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
Luc Pattyn6-Mar-10 10:02
sitebuilderLuc Pattyn6-Mar-10 10:02 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
baranils24-May-10 5:07
baranils24-May-10 5:07 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
Luc Pattyn24-May-10 5:18
sitebuilderLuc Pattyn24-May-10 5:18 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
baranils24-May-10 5:32
baranils24-May-10 5:32 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
Luc Pattyn24-May-10 6:10
sitebuilderLuc Pattyn24-May-10 6:10 
GeneralRe: Creating a web sniffer that will browse and get data from websites Pin
baranils24-May-10 7:33
baranils24-May-10 7:33 
QuestionMac OS look Pin
Wamuti6-Mar-10 5:45
Wamuti6-Mar-10 5:45 
AnswerRe: Mac OS look Pin
OriginalGriff6-Mar-10 6:18
mveOriginalGriff6-Mar-10 6:18 
GeneralRe: Mac OS look Pin
Wamuti6-Mar-10 6:25
Wamuti6-Mar-10 6:25 
AnswerRe: Mac OS look Pin
Eddy Vluggen6-Mar-10 8:53
professionalEddy Vluggen6-Mar-10 8:53 
Questionrad controls Pin
pokiri6-Mar-10 1:03
pokiri6-Mar-10 1:03 
AnswerRe: rad controls Pin
pokiri6-Mar-10 1:17
pokiri6-Mar-10 1:17 
AnswerRe: rad controls Pin
#realJSOP6-Mar-10 1:56
professional#realJSOP6-Mar-10 1:56 
QuestionChecking if string path is valid [modified] Pin
Saksida Bojan6-Mar-10 0:24
Saksida Bojan6-Mar-10 0:24 
AnswerRe: Checking if string path is valid Pin
#realJSOP6-Mar-10 1:01
professional#realJSOP6-Mar-10 1:01 
GeneralRe: Checking if string path is valid Pin
Saksida Bojan6-Mar-10 1:03
Saksida Bojan6-Mar-10 1:03 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.