Webscraping: Loop through multiple urls


I have successfully scrapped several websites individually.
However, now I want to have a single script so that I don’t have to run each script individually all the time.
I would like to build a for loop that goes through all websites and replaces the x with a string.
Unfortunately, there are no numbers, with which I could go through the individual pages with "for x in range", but there are just the strings mentioned.

Here is my current code:

from bs4 import BeautifulSoup
import requests
import pandas as pd

movielist = []

for x in ... ('action', 'comedy', 'thriller', 'drama', 'sport'): # what should i insert instead of ...?
    r = requests.get(f'https://movie.com/{x}', headers=headers)
    soup = BeautifulSoup(r.text, 'html.parser')
    spiele = soup.find_all('div', {'class': 'row'})

The site is not real, its just a question how to do that.

I am very happy about your help, thank you very much.

>Solution :

Just remove the …
Your tuple is iterable to you can go through every element like this:

for x in ('action', 'comedy', 'thriller', 'drama', 'sport'): # what should i insert instead of ...?



Leave a Reply Cancel reply