This project is a job scraping tool that extracts job listings from Jobrapido and Glassdoor. It allows users to search for job titles and export the results to CSV files.
- Scrape job listings from Jobrapido and Glassdoor (at the moment).
- Export job listings to CSV files.
- Command-line interface for easy usage.
- Python 3.10
pip
for managing Python packages- Chrome installed on your PC
- Chrome driver installed on your PC
-
Clone the repository:
git clone https://github.com/devgabrielsborges/Carpenter.git cd Carpenter
-
Install the required packages:
pip install -r requirements.txt
-
Download the Chrome driver from here and ensure it is in your system's PATH.
Run the script from the command line with the following syntax:
python cli.py <search_term> <choice>
<search_term>
: The job title you want to search for.<choice>
: The site you want to scrape jobs from. Options arejobrapido
andglassdoor
.
python cli.py "software engineer" jobrapido
This command will search for "software engineer" jobs on Jobrapido and export the results to a CSV file.
cli.py
: The main script to run the job scraping functions.jobrapido.py
: Module for scraping Jobrapido.glassdoor.py
: Module for scraping Glassdoor.commons.py
: Common functions used across the project, such as exporting jobs to CSV.
This project is licensed under the MIT License. See the LICENSE
file for more details.