Skip to content

Thinkering out how to do web scraping with ADTs in javascrit

Notifications You must be signed in to change notification settings

JohanCodinha/functionalScrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Functional Web scrapping

Web scrapper with Node.js and postgresql to save the scrapped data.

Getting Started

Containerized with docker-compose using docker volume to store permanent data.

Prerequisites

Docker Docker-compose

Installing

git clone https://github.com/johanCodinha/functionalScrapper
cd functionalScrapper
docker-compose up -d
Give the example

Deployment

You can use the provided systemctl_service file to enable a systemD service

Built With

  • Node.js
  • Crocks.js
  • Postgresql
  • Docker

Contributing

Not taking in contribution

Authors

License

This project is licensed under the MIT License - see the LICENSE.md file for details

About

Thinkering out how to do web scraping with ADTs in javascrit

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published