Scrapy

An open source and collaborative framework for extracting the data you need from websites.

In a fast, simple, yet extensible way.

See also

• Web crawler
• Selenium WebDriver (Python:Selenium)
• Beautiful Soup
• Playwright

Favorite site

• Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
• Github - scrapy/scrapy