GitHub - liydaco/cryptocurrency_social_scraper: Scrapes social platforms for cryptocurrency mentions and adds a sentiment score and trending score using google trends.

liydaco / cryptocurrency_social_scraper Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Scrapes social platforms for cryptocurrency mentions and adds a sentiment score and trending score using google trends.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
__pycache__		__pycache__
api_clients		api_clients
bin		bin
helpers		helpers
migrations		migrations
__init__.py		__init__.py
admin.py		admin.py
apps.py		apps.py
coins_cleaner.py		coins_cleaner.py
coins_scraper.py		coins_scraper.py
data_enrichment.py		data_enrichment.py
django_config.py		django_config.py
fourchan_scraper.py		fourchan_scraper.py
mentions_scraper.py		mentions_scraper.py
models.py		models.py
pyvenv.cfg		pyvenv.cfg
readme		readme
reddit_scraper.py		reddit_scraper.py
requirements.txt		requirements.txt
tests.py		tests.py
twitter_scraper.py		twitter_scraper.py
views.py		views.py

Repository files navigation

Use this to install twint on ubuntu:

pip3 install --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint

run the coins_scraper.py file to periodically scrape cmc for new tokens

run the mentions_scraper.py to scrape the mentions from various social networks and produce reports from the results

Run the data_enrichment.py file to update the sentiment and google score of the cryptocurrencies collected