tokenizer | RubyGems.org | your community gem host

RubyGems

Sign in Sign up

Gemfile

install

A simple tokenizer for NLP tasks.

Required Ruby Version

>= 1.9

Authors

Andrei Beliankou

Versions

0.3.0 January 20, 2016 (10 KB)
0.2.0 January 11, 2016 (10 KB)
0.1.2 September 03, 2015 (9.5 KB)
0.1.1 August 25, 2011 (8 KB)
0.1.0 May 19, 2011 (5.5 KB)

Show all versions (6 total)

SHA 256 checksum