Uses of Class opennlp.tools.tokenize.TokenizerFactory (Apache OpenNLP Tools 1.9.5 API)
Date: 2026-06-18

## Uses of Class
opennlp.tools.tokenize.TokenizerFactory

- Packages that use TokenizerFactory
  Package | Description
  --- | ---
  opennlp.tools.tokenize | Contains classes related to finding token or words in a string.

- - ### Uses of TokenizerFactory in opennlp.tools.tokenize

    Methods in opennlp.tools.tokenize that return TokenizerFactory
    Modifier and Type | Method and Description
    --- | ---
    `static TokenizerFactory` | TokenizerFactory.`create(String subclassName, String languageCode, Dictionary abbreviationDictionary, boolean useAlphaNumericOptimization, Pattern alphaNumericPattern)` Factory method the framework uses create a new `TokenizerFactory`.
    `TokenizerFactory` | TokenizerModel.`getFactory()`

    Methods in opennlp.tools.tokenize with parameters of type TokenizerFactory
    Modifier and Type | Method and Description
    --- | ---
    `static TokenizerModel` | TokenizerME.`train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)` Trains a model for the `TokenizerME`.

    Constructors in opennlp.tools.tokenize with parameters of type TokenizerFactory
    Constructor and Description
    `TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners)`
    `TokenizerModel(MaxentModel tokenizerModel, Map<String,String> manifestInfoEntries, TokenizerFactory tokenizerFactory)` Initializes the current instance.

Copyright © 2026 The Apache Software Foundation. All rights reserved.