Skip to content

Car dealer website scrapper which is optimized with multiprocessing(over 80k car data in a 10 minutes)

Notifications You must be signed in to change notification settings

sonerkuyar/Car-Dealer-Scrapping

Repository files navigation

Web Scrapping Model for Car Dealer Websites

This is a web scrapping model for car dealer websites. It is a simple model that can be used to scrap data from car dealer websites. The model is built using Python and Selenium. The model is built to scrap data from the following websites: arabam.com sahibinden.com (outdated and ip rotating is needed)

Features

  • Scrap data from car dealer websites
  • Multiprocessing for faster scrapping
  • Scrap data from multiple pages
  • Scrap data from multiple websites
  • Save data to csv file

Usage Example

python preprocess_arabam_com.py

About

Car dealer website scrapper which is optimized with multiprocessing(over 80k car data in a 10 minutes)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published