Uses of Class opennlp.tools.tokenize.TokenizerModel (Apache OpenNLP Tools 1.9.5 API)
Date: 2026-06-18

## Uses of Class
opennlp.tools.tokenize.TokenizerModel

- Packages that use TokenizerModel
  Package | Description
  --- | ---
  opennlp.tools.cmdline.tokenizer |
  opennlp.tools.formats.brat |
  opennlp.tools.tokenize | Contains classes related to finding token or words in a string.

- - ### Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer

    Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel
    Modifier and Type | Method and Description
    --- | ---
    `protected TokenizerModel` | TokenizerModelLoader.`loadModel(InputStream modelIn)`

  - ### Uses of TokenizerModel in opennlp.tools.formats.brat

    Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModel
    Constructor and Description
    `BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)` Creates a new `BratNameSampleStream`.
    `BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes)` Creates a new `BratNameSampleStream`.

  - ### Uses of TokenizerModel in opennlp.tools.tokenize

    Methods in opennlp.tools.tokenize that return TokenizerModel
    Modifier and Type | Method and Description
    --- | ---
    `static TokenizerModel` | TokenizerME.`train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)` Trains a model for the `TokenizerME`.

    Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel
    Constructor and Description
    `TokenizerME(TokenizerModel model)`
    `TokenizerME(TokenizerModel model, Factory factory)` Deprecated. use `TokenizerFactory` to extend the Tokenizer functionality

Copyright © 2026 The Apache Software Foundation. All rights reserved.