opennlp.uima.tokenize (Apache OpenNLP :: Ext :: UIMA Annotators 3.0.0-M4 API)
Description: declaration: package: opennlp.uima.tokenize

# Package opennlp.uima.tokenize

package opennlp.uima.tokenize
Package related to finding tokens or word segments.

- Class
  Description
  AbstractTokenizer
  SimpleTokenizer
  An OpenNLP-based Simple Tokenizer annotator.
  Tokenizer
  An OpenNLP-based Tokenizer annotator.
  TokenizerModelResource
  A resource encapsulating an OpenNLP `TokenizerModel` which can be shared between analysis engines and loaded via the UIMA resource model.
  TokenizerModelResourceImpl
  A default implementation of `TokenizerModelResource`.
  WhitespaceTokenizer
  An OpenNLP-based Whitespace Tokenizer annotator.