Web scrapping an ebay website, but I am not getting any output in Python

Question

1.00/5 (1 vote)

See more:

The Code is ok. I am running this in Pycharm.
I ve already installed requests and beautifulsoup4 library as well.
But I am not getting the output, what do I change

Code -

import requests
from bs4 import BeautifulSoup


def scrape_ebay_puzzles():
    url = "https://www.ebay.com/b/Puzzles/2613/bn_1865244"
    page = requests.get(url)
    soup = BeautifulSoup(page.content, "html.parser")
    results = soup.find_all("li", class_="s-item")

    for result in results:
        title = result.find("h3", class_="s-item__title").text
        price = result.find("span", class_="s-item__price").text
        print(f"Title: {title}")
        print(f"Price: {price}")


if __name__ == "__main__":
    scrape_ebay_puzzles()

Output is blank.

What I have tried:

The Code is ok. I am running this in Pycharm.
I ve already installed requests and beautifulsoup4 library as well.
But I am not getting the output, what do I change

Posted 30-Jan-23 22:20pm

Shubham Guha_1007_IMCA1

Updated 1-Feb-23 13:12pm

Add a Solution

Comments

Richard MacCutchan 31-Jan-23 5:17am

Start by adding some print statements to your code to check exactly what is getting returned at each step. Alternatively, run the code in the debugger and step through it to check.

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Dave Kreskowiak · Accepted Answer · 2023-02-01T13:12:00

Solution 2

Why are you going with web scraping instead of just using eBay's API[^]?

Posted 1-Feb-23 13:12pm

Dave Kreskowiak

Maciej Los · Accepted Answer · 2023-02-01T09:54:00

I was trying your code. It's OK, but the process seems to be stuck...

I've tried to change request with adding timeout parameter:

Python

try:
    page = requests.get(url,timeout=60)
except requests.exceptions.RequestException as e:
    raise SystemExit(e)

and i get:
SystemExit: HTTPSConnectionPool(host='www.ebay.com', port=443): Read timed out. (read timeout=60)