TokenFeatureGenerator (Apache OpenNLP Tools 1.9.5 API)
Date: 2026-06-18

opennlp.tools.util.featuregen

## Class TokenFeatureGenerator

- java.lang.Object
- - opennlp.tools.util.featuregen.TokenFeatureGenerator

- All Implemented Interfaces:
    AdaptiveFeatureGenerator

      public class TokenFeatureGenerator
      extends Object
      implements AdaptiveFeatureGenerator

  Generates a feature which contains the token itself.

- - ### Constructor Summary

    Constructors
    Constructor and Description
    `TokenFeatureGenerator()`
    `TokenFeatureGenerator(boolean lowercase)`

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `void` | `createFeatures(List<String> features, String[] tokens, int index, String[] preds)` Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.

    - ### Methods inherited from class java.lang.Object

      `equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

    - ### Methods inherited from interface opennlp.tools.util.featuregen.AdaptiveFeatureGenerator

      `clearAdaptiveData, updateAdaptiveData`

- - ### Constructor Detail

    - #### TokenFeatureGenerator

          public TokenFeatureGenerator(boolean lowercase)

    - #### TokenFeatureGenerator

          public TokenFeatureGenerator()

  - ### Method Detail

    - #### createFeatures

          public void createFeatures(List<String> features,
                                     String[] tokens,
                                     int index,
                                     String[] preds)

      Description copied from interface: `AdaptiveFeatureGenerator`
      Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.
      Specified by:
        `createFeatures` in interface `AdaptiveFeatureGenerator`
      Parameters:
        `features` - The list of features to be added to.
        `tokens` - The tokens of the sentence or other text unit being processed.
        `index` - The index of the token which is currently being processed.
        `preds` - The outcomes for the tokens prior to the specified index.

Copyright © 2026 The Apache Software Foundation. All rights reserved.