tokenizer 0.3.0

A simple multilingual tokenizer for NLP tasks. This tool provides a CLI and a library for linguistic tokenization which is an anavoidable step for many HLT (human language technology) tasks in the preprocessing phase for further syntactic, semantic and other higher level processing goals. Use it for tokenization of German, English and French texts.

Gemfile:
=

installation:
=

Versions:

0.3.0 January 20, 2016 (10 ko)
0.2.0 January 11, 2016 (10 ko)
0.1.2 September 03, 2015 (9,5 ko)
0.1.1 August 25, 2011 (8 ko)
0.1.0 May 19, 2011 (5,5 ko)

Voir toutes les versions (6)

Propriétaires:

Auteurs:

Andrei Beliankou

Total de contrôle SHA 256:

=

Total de téléchargements 236 335

Pour cette version 140 631

Version publiée:
January 20, 2016 3:54pm

License:
MIT

Version de Ruby requise: >= 1.9.3

Liens:

Page d'accueil Documentation Suivi de bugs Télécharger Review changes Badge RSS Signaler un abus Reverse dependencies