Package opennlp.grok.preprocess.tokenize

Class Summary
EnglishTokenizerME A tokenizer which uses default English data for the maxent model.
TokContextGenerator Generate events for maxent decisions for tokenization.
TokenizerME A Tokenizer for converting raw text into separated tokens.
TokEventCollector Generate event contexts for maxent decisions for sentence detection.

Copyright © 2003 Jason Baldridge and Gann Bierner. All Rights Reserved.