Uses of Package
opennlp.tools.tokenize

Packages that use opennlp.tools.tokenize

opennlp.tools.lang.english	Package related to the processing of English data.
opennlp.tools.namefind	Package related to finding proper names and numeric amounts.
opennlp.tools.tokenize	Package related to finding tokens or word segments.

Classes in opennlp.tools.tokenize used by opennlp.tools.lang.english

Tokenizer
The interface for tokenizers, which turn messy text into nicely segmented text tokens.

TokenizerME
A Tokenizer for converting raw text into separated tokens.

Classes in opennlp.tools.tokenize used by opennlp.tools.namefind

Tokenizer
The interface for tokenizers, which turn messy text into nicely segmented text tokens.

Classes in opennlp.tools.tokenize used by opennlp.tools.tokenize

TokenContextGenerator
Interface for TokenizerME context generators.

Tokenizer
The interface for tokenizers, which turn messy text into nicely segmented text tokens.

WhitespaceTokenizer
This tokenizer uses white spaces to tokenize the input text.