Skip to content

Latest commit

 

History

History
23 lines (17 loc) · 688 Bytes

README.md

File metadata and controls

23 lines (17 loc) · 688 Bytes

A web crawler in Go

It demonstrates how easy to write a simple web crawler in Go programming language, as demonstrated in the book, The Go Programming Language.

Utility commands

  • fetch fetches the HTML document for the web site.
  • findlink finds URL links from the HTML document.
  • outline outlines the HTML DOM elements.
  • fetchlinks fetches and show found links, e.g. fetch | findlink
  • waitserver waits for the server reachability

Happy hacking!