Skip to content
This repository has been archived by the owner on May 2, 2023. It is now read-only.

Latest commit

 

History

History
86 lines (65 loc) · 2.53 KB

README.md

File metadata and controls

86 lines (65 loc) · 2.53 KB
Raw

Freeling::Analyzer Build Status

FreeLing::Analyzer is a Ruby wrapper around analyzer, a binary tool included in FreeLing's package that allows the user to process a stream of text with FreeLing.

This has been tested with version 3.0+ only.

Usage

text = "Mi amigo Juan Mesa se mesa la barba al lado de la mesa."
analyzer = FreeLing::Analyzer.new(text, :language => :es)

analyzer.tokens.first
# => #<FreeLing::Analyzer::Token form="Mi" lemma="mi" prob=0.995536 tag="DP1CSS">

analyzer.tokens.map { |t| t.lemma }
# => ["mi", "amigo", "juan_mesa", "se", "mesar", "el", "barba", "a+el", "lado", "de", "el", "mesa", "."]

Features

  • Analyzer is lazy, it does not spawn the process until needed and it sends the input text to analyzer on demand.
  • It just works with the default instalation of FreeLing. Just set the language to use and you're good to go.
  • It supports Freeling's client/server mode. Ex: FreeLing::Analyzer.new(text, :server_host => 'localhost:50005') (analyze must be running in server mode)

Installation

Add this line to your application's Gemfile:

gem 'freeling-analyzer'

And then execute:

$ bundle

Or install it yourself as:

$ gem install freeling-analyzer

FreeLing

FreeLing is an open source suite of language analyzers written in C++.

The main services offered are:

  • Text tokenization
  • Sentence splitting
  • Morphological analysis
  • Suffix treatment
  • Retokenization of clitic pronouns
  • Flexible multiword recognition
  • Contraction splitting
  • Probabilistic prediction of unkown word categories
  • Named entity detection (NER)
  • Recognition of dates, numbers, ratios, currency, and physical magnitudes (speed, weight, temperature, density, etc.)
  • PoS tagging
  • Chart-based shallow parsing
  • Named entity classification (NEC)
  • WordNet based sense annotation and disambiguation
  • Rule-based dependency parsing
  • Nominal correference resolution.

Currently supported languages are:

  • Spanish
  • Catalan
  • Galician
  • Italian
  • English
  • Welsh
  • Portuguese
  • Asturian

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Added some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request