Skip to content
This repository has been archived by the owner on Feb 6, 2019. It is now read-only.
/ hdxscraper-fts Public archive

Collector for the Financial Tracking Service (FTS) API

License

Notifications You must be signed in to change notification settings

nerevu/hdxscraper-fts

Repository files navigation

UN OCHA FTS API Collector

HDX collector for the Financial Tracking Service (FTS) API.

Introduction

hdxscraper-fts operates in the following way:

  • Downloads json data from the fts API for each country
  • Extracts and normalizes the data
  • Places the resulting data into the following database tables: appeal, emergency, and cluster

View the live data

Setup

local

(You are using a virtualenv, right?)

sudo pip install -r requirements.txt
manage setup
manage init

ScraperWiki Box

make setup
manage -m Scraper init

Usage

local

manage run

ScraperWiki Box

manage -m Scraper run

The results will be stored in a SQLite database scraperwiki.sqlite.