llm-scraping-demo

Demo notebooks for LLM based web scraping with Scrapfly used in intro video:

Setup

To use this notebook you'll need:

• Jupyter notebook server
• httpx

All of which can be installed using the provided pyproject.toml using poetry (or any other moder python package manager):

$ poetry install
$ poetry run jupyter notebook

[I 2024-07-09 21:54:57.134 ServerApp] Serving notebooks from local directory: /home/scrapfly/llm-scraping-demo
[I 2024-07-09 21:54:57.134 ServerApp] Jupyter Server 2.14.1 is running at:
[I 2024-07-09 21:54:57.134 ServerApp] http://localhost:8888/tree?token=7a960bcb9
[I 2024-07-09 21:54:57.134 ServerApp]     http://127.0.0.1:8888/tree?token=7a960b
#                                         ^^^^^^^^^^ open this in your browser.