Skip to content

Webscraping using BeautifulSoup, Selenium and Scrapy

Notifications You must be signed in to change notification settings

pierogio/Web_scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Webscraping

forthebadge made-with-python
Made withJupyter

What is the project about.

In this project we realized: Basic webscraping on "http://quotes.toscrape.com," using BeautifulSoup which is a Python library for parsing HTML and XML documents. In this context, it helps extract and manipulate data from the website's HTML content. Basic webscraping on "https://www.bolsamadrid.es," using both BeautifulSoup and Selenium, is a web testing tool that can also be used for web scraping. Finally, scraping on Amazon webpage is realized using Selenium and Scrapy. Scrapy is an open-source and powerful web scraping framework for Python. It provides a framework and a set of tools to extract data from websites, making it a popular choice for web scraping and crawling tasks. In this case is used to scrap prices of portable monitors and storing them in a dataframe.

Technologies Used

  • Python
  • Jupyter notebook

Packages Used

  • BeautfulSoup - Python
  • Pandas - Python
  • Selenium - Python
  • seaborn - Python
  • Scrapy - Python

About

Webscraping using BeautifulSoup, Selenium and Scrapy

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published