Uses of Interface opennlp.tools.tokenize.TokenContextGenerator (Apache OpenNLP Tools 1.9.5 API)
Date: 2026-06-18

## Uses of Interface
opennlp.tools.tokenize.TokenContextGenerator

- Packages that use TokenContextGenerator
  Package | Description
  --- | ---
  opennlp.tools.tokenize | Contains classes related to finding token or words in a string.
  opennlp.tools.tokenize.lang |

- - ### Uses of TokenContextGenerator in opennlp.tools.tokenize

    Classes in opennlp.tools.tokenize that implement TokenContextGenerator
    Modifier and Type | Class and Description
    --- | ---
    `class` | `DefaultTokenContextGenerator` Generate events for maxent decisions for tokenization.

    Methods in opennlp.tools.tokenize that return TokenContextGenerator
    Modifier and Type | Method and Description
    --- | ---
    `TokenContextGenerator` | TokenizerFactory.`getContextGenerator()` Gets the context generator

    Constructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator
    Constructor and Description
    `TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg)` Initializes the current instance.
    `TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)` Initializes the current instance.

  - ### Uses of TokenContextGenerator in opennlp.tools.tokenize.lang

    Methods in opennlp.tools.tokenize.lang that return TokenContextGenerator
    Modifier and Type | Method and Description
    --- | ---
    `TokenContextGenerator` | Factory.`createTokenContextGenerator(String languageCode, Set<String> abbreviations)`

Copyright © 2026 The Apache Software Foundation. All rights reserved.