Skip to content

Latest commit

 

History

History
60 lines (41 loc) · 1.65 KB

README.md

File metadata and controls

60 lines (41 loc) · 1.65 KB
Raw

Carpenter: Job Scraper

This project is a job scraping tool that extracts job listings from Jobrapido and Glassdoor. It allows users to search for job titles and export the results to CSV files.

Features

  • Scrape job listings from Jobrapido and Glassdoor (at the moment).
  • Export job listings to CSV files.
  • Command-line interface for easy usage.

Requirements

  • Python 3.10
  • pip for managing Python packages
  • Chrome installed on your PC
  • Chrome driver installed on your PC

Installation

  1. Clone the repository:

    git clone https://github.com/devgabrielsborges/Carpenter.git
cd Carpenter

  2. Install the required packages:

    pip install -r requirements.txt

  3. Download the Chrome driver from here and ensure it is in your system's PATH.

Usage

Run the script from the command line with the following syntax:

python cli.py <search_term> <choice>
  • <search_term>: The job title you want to search for.
  • <choice>: The site you want to scrape jobs from. Options are jobrapido and glassdoor.

Example

python cli.py "software engineer" jobrapido

This command will search for "software engineer" jobs on Jobrapido and export the results to a CSV file.

Project Structure

  • cli.py: The main script to run the job scraping functions.
  • jobrapido.py: Module for scraping Jobrapido.
  • glassdoor.py: Module for scraping Glassdoor.
  • commons.py: Common functions used across the project, such as exporting jobs to CSV.

License

This project is licensed under the MIT License. See the LICENSE file for more details.