Skip to content
This repository has been archived by the owner on Nov 7, 2019. It is now read-only.

Custom Crawls Chapter #19

Open
9 tasks
jeffreyliu opened this issue Aug 24, 2017 · 1 comment
Open
9 tasks

Custom Crawls Chapter #19

jeffreyliu opened this issue Aug 24, 2017 · 1 comment

Comments

@jeffreyliu
Copy link
Contributor

jeffreyliu commented Aug 24, 2017

Create a chapter introducing custom crawls on Data Together

Sections:

  1. What is custom crawling?
  • Why do some websites need custom crawls?
  • What should your custom crawler extract from the webpage?
  • Examples of sites needing custom crawlers
  1. Introduction/tutorial for Morph
  • What is morph?
  • Make a Morph acct
  • Getting a Data Together API key, and making sure morph can access it
  1. Tutorial for Archivertools package
  • What does it do?
  • Installing package
  • Using Archiver class
  1. Examples/case studies of custom crawls

cc @ebenp

@dcwalk
Copy link
Member

dcwalk commented Aug 31, 2017

Sounds great!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Development

No branches or pull requests

2 participants