How to get links from top 10 trending videos on youtube?

Question

0.00/5 (No votes)

See more:

I want to web scrap links from top 10 trending videos on youtube, but every time I run my program i get links to stuff about youtube (ads, copyright, policies.....).

What I have tried:

This is the code that i wrote:
import bs4
import requests
res=requests.get("https://www.youtube.com/feed/trending")
soup=bs4.BeautifulSoup(res.text,'html.parser')
for link in soup.find_all('a', href=True):
print(link['href'])

Posted 16-Oct-20 9:09am

Filip Mrsovic

Updated 16-Oct-20 9:51am

Add a Solution

Comments

ZurdoDev 16-Oct-20 15:38pm

You have to write code to remove the other stuff. Or see if someone has already done it and posted sample code.

Filip Mrsovic 16-Oct-20 15:41pm

I know how to remove the other stuff, but the thing is, i don't get links of videos at all, and I searched to see if someone had already done it, but i couldn't find anything, still thanks.....

Dave Kreskowiak 16-Oct-20 16:07pm

You have to go look at the page source. You're code was written under the assumption that every link for a video is an A tag. They're not. I think you'll be surprised at what you find.

Filip Mrsovic 16-Oct-20 16:10pm

Thank you , i will look it up.....

Filip Mrsovic 18-Oct-20 8:23am

tied, but i can't figure it out, this is the html code, it has tag 'a', and i want to get this link /watch?v=yyLxPpCi5Bk&t=1s ..... Should i add class and id to define it better?

<yt-img-shadow ftl-eligible="" class="style-scope ytd-thumbnail no-transition" style="background-color: transparent;" loaded="">

<ytd-thumbnail-overlay-resume-playback-renderer class="style-scope ytd-thumbnail"><ytd-thumbnail-overlay-time-status-renderer class="style-scope ytd-thumbnail" overlay-style="DEFAULT"><yt-icon class="style-scope ytd-thumbnail-overlay-time-status-renderer" disable-upgrade="" hidden="">
14:27
<ytd-thumbnail-overlay-now-playing-renderer class="style-scope ytd-thumbnail">
Now playing

Dave Kreskowiak 18-Oct-20 12:15pm

I don't know what you're looking at but the videos are not A tags. You might want to view the page source again and search that text for a video title.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

OriginalGriff · Answer 1 · 2020-10-16T09:51:00

Solution 1

Start by looking at what your get request actually returns: then start designing code to extract the info you want.

You can't just assume that what it returns is what you want: you have to look at what is available and work with that.

Posted 16-Oct-20 9:51am

OriginalGriff