C implementation of the Readability algorithm (plus some goodies)

Dependencies:

libxml2
libpcre or ICU for regular expressions support

Building:

make

Building with ICU rather than pcre:

ICU=1 make

By default, both the readable program and the Python extension will be built.

Building for OS X using Xcode

Create a new directory named readable
Copy readable.h and readable.c in the newly created directory
Copy the directory named unicode from the ICU headers into your project (you can get it from the iPhoneSimulator SDK, under /usr/include/unicode)
Add the readable parent directory, the unicode parent directory and /usr/include/libxml2 to Header Search Path under Build Settings
Add libicucore.dylib and libxml2.xylib to the Link Binary with libraries Build Phase
In your code, import readable.h

Building for iOS using Xcode

Create a new directory named readable
Copy readable.h and readable.c in the newly created directory
Add the readable parent directory and /usr/include/libxml2 to Header Search Path under Build Settings
Add libicucore.dylib and libxml2.xylib to the Link Binary with libraries Build Phase
In your code, import readable.h

API:

char * readable(const char html, const char url, const char *encoding, int options)

Parses HTML to extract the interesting contents.

html: HTML code to parse
url: URL where this HTML was fetched from
encoding: HTML encoding
options: See readable.h for the avaialble options

char * next_page_url(const char html, const char url, const char *encoding);

Returns the url for the next page in a multipage article (pretty much in alpha):

html: HTML code to parse
url: URL where this HTML was fetched from
encoding: HTML encoding

License

This code is licensed under the AGPLv3. If you'd like to use the code under a different license, drop me a line to [email protected]