web-poet is a Python 3.9+ implementation of the page object pattern for
web scraping. It enables writing portable, reusable web parsing code.
See the documentation.
Setup your local Python environment via:
- pip install -r requirements-dev.txt
- pre-commit install
Now everytime you perform a git commit, these tools will run against the staged files:
- black
- isort
- flake8
You can also directly invoke pre-commit run --all-files or tox -e linters to run them without performing a commit.