HDX collector for the Financial Tracking Service (FTS) API.
hdxscraper-fts operates in the following way:
- Downloads json data from the fts API for each country
- Extracts and normalizes the data
- Places the resulting data into the following database tables:
appeal
,emergency
, andcluster
local
(You are using a virtualenv, right?)
sudo pip install -r requirements.txt
manage setup
manage init
ScraperWiki Box
make setup
manage -m Scraper init
local
manage run
ScraperWiki Box
manage -m Scraper run
The results will be stored in a SQLite database scraperwiki.sqlite
.