Click here to Skip to main content
15,897,187 members
Home / Discussions / C / C++ / MFC
   

C / C++ / MFC

 
QuestionAnyone done any Web Scraping in C++/MFC Pin
Bryan Anslow2-Jun-14 6:26
Bryan Anslow2-Jun-14 6:26 
Hi,
I currently get data from a website like this;
Go to the webpage, wait while the page loads, "select" the data in the webpage by dragging my mouse over it, Copy to clipboard, call up my text editor, Paste the data into the editor, save the output, analyze the data using my C++/MFC Analyzer.

There must be a way I can get the data without the need to copy/paste etc.

I know something about HTTP Connections, sockets, etc., but I am at a loss to know just what parameters need to be passed to the website in the request. I tried just sending the URL of the webpage, which returned a lot of stuff which I did not want.

Does anyone have a simple example of how this is supposed to work?

Thanks so much,

Bryan.
GeneralRe: Anyone done any Web Scraping in C++/MFC Pin
Richard MacCutchan2-Jun-14 7:15
mveRichard MacCutchan2-Jun-14 7:15 
AnswerRe: Anyone done any Web Scraping in C++/MFC Pin
David Crow2-Jun-14 7:26
David Crow2-Jun-14 7:26 
GeneralRe: Anyone done any Web Scraping in C++/MFC Pin
Bryan Anslow2-Jun-14 8:36
Bryan Anslow2-Jun-14 8:36 
SuggestionRe: Anyone done any Web Scraping in C++/MFC Pin
David Crow2-Jun-14 9:22
David Crow2-Jun-14 9:22 
QuestionNewbee MFC Pin
C-P-User-31-Jun-14 14:23
C-P-User-31-Jun-14 14:23 
AnswerRe: Newbee MFC Pin
Richard MacCutchan1-Jun-14 21:49
mveRichard MacCutchan1-Jun-14 21:49 
AnswerRe: Newbee MFC Pin
jeron12-Jun-14 4:08
jeron12-Jun-14 4:08 
QuestionHOW I can pause the timer in qt Pin
sara741-Jun-14 1:42
sara741-Jun-14 1:42 
AnswerRe: HOW I can pause the timer in qt Pin
Albert Holguin2-Jun-14 5:34
professionalAlbert Holguin2-Jun-14 5:34 
Questionhow can i convert a QString to char* in QT Pin
sara741-Jun-14 1:24
sara741-Jun-14 1:24 
AnswerRe: how can i convert a QString to char* in QT Pin
Richard MacCutchan1-Jun-14 2:38
mveRichard MacCutchan1-Jun-14 2:38 
AnswerHow to convert a QString to char* (char pointer) in QT Pin
Software_Developer1-Jun-14 22:47
Software_Developer1-Jun-14 22:47 
QuestionQtimer class in Qt Pin
sara7431-May-14 20:17
sara7431-May-14 20:17 
AnswerRe: Qtimer class in Qt Pin
Richard MacCutchan31-May-14 21:03
mveRichard MacCutchan31-May-14 21:03 
AnswerThe QElapsedTimer Class has timer.elapsed( ) built in. Pin
Software_Developer31-May-14 21:13
Software_Developer31-May-14 21:13 
GeneralRe: The QElapsedTimer Class has timer.elapsed( ) built in. Pin
sara741-Jun-14 1:25
sara741-Jun-14 1:25 
QuestionThe Ultimate Toolbox file watcher links are dead Pin
Grine Amine31-May-14 5:51
Grine Amine31-May-14 5:51 
AnswerRe: The Ultimate Toolbox file watcher links are dead Pin
Richard MacCutchan31-May-14 21:01
mveRichard MacCutchan31-May-14 21:01 
AnswerRe: The Ultimate Toolbox file watcher links are dead Pin
David Crow1-Jun-14 16:58
David Crow1-Jun-14 16:58 
Questionwhy can't I use std::shared_ptr & std::unique_ptr like this? just got crash Pin
Falconapollo28-May-14 21:02
Falconapollo28-May-14 21:02 
AnswerRe: why can't I use std::shared_ptr & std::unique_ptr like this? just got crash Pin
CPallini28-May-14 22:45
mveCPallini28-May-14 22:45 
GeneralRe: why can't I use std::shared_ptr & std::unique_ptr like this? just got crash Pin
Falconapollo28-May-14 22:53
Falconapollo28-May-14 22:53 
GeneralRe: why can't I use std::shared_ptr & std::unique_ptr like this? just got crash Pin
CPallini29-May-14 0:17
mveCPallini29-May-14 0:17 
GeneralRe: why can't I use std::shared_ptr & std::unique_ptr like this? just got crash Pin
Richard MacCutchan29-May-14 0:35
mveRichard MacCutchan29-May-14 0:35 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.