opennlp.grok.preprocess.tokenize
Class EnglishTokenizerME

java.lang.Object
  |
  +--opennlp.grok.preprocess.tokenize.TokenizerME
        |
        +--opennlp.grok.preprocess.tokenize.EnglishTokenizerME

All Implemented Interfaces:

opennlp.common.preprocess.Pipelink, opennlp.common.preprocess.Tokenizer

public class EnglishTokenizerME

extends TokenizerME

A tokenizer which uses default English data for the maxent model.

Version:

$Revision: 1.2 $, $Date: 2001/11/26 17:18:23 $

Author:

Jason Baldridge

Constructor Summary

EnglishTokenizerME()

Method Summary

static void

main(java.lang.String[] args) Trains a new model.

Methods inherited from class opennlp.grok.preprocess.tokenize.TokenizerME

process, requires, tokenize, train

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EnglishTokenizerME

public EnglishTokenizerME()

Method Detail

main

public static void main(java.lang.String[] args)

Description copied from class: TokenizerME

Trains a new model. Call from the command line with "java opennlp.grok.preprocess.tokenize.TokenizerME trainingdata modelname"