S2Robot Overview S2Robot is a crawler library for crawling a web site and a file system. Notes The latest S2Robot releases are provided from https://github.com/codelibs/s2robot.