TokenizerEvaluator (Apache OpenNLP Tools 1.9.5 API)
Date: 2026-06-18

opennlp.tools.tokenize

## Class TokenizerEvaluator

- java.lang.Object
- - opennlp.tools.util.eval.Evaluator<TokenSample>
  - - opennlp.tools.tokenize.TokenizerEvaluator

-     public class TokenizerEvaluator
      extends Evaluator<TokenSample>

  The `TokenizerEvaluator` measures the performance of the given `Tokenizer` with the provided reference `TokenSample`s.
  See Also:
    `Evaluator`, `Tokenizer`, `TokenSample`

- - ### Constructor Summary

    Constructors
    Constructor and Description
    `TokenizerEvaluator(Tokenizer tokenizer, TokenizerEvaluationMonitor... listeners)` Initializes the current instance with the given `Tokenizer`.

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `FMeasure` | `getFMeasure()`

    - ### Methods inherited from class opennlp.tools.util.eval.Evaluator

      `evaluate, evaluateSample`

    - ### Methods inherited from class java.lang.Object

      `equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- - ### Constructor Detail

    - #### TokenizerEvaluator

          public TokenizerEvaluator(Tokenizer tokenizer,
                                    TokenizerEvaluationMonitor... listeners)

      Initializes the current instance with the given `Tokenizer`.
      Parameters:
        `tokenizer` - the `Tokenizer` to evaluate.
        `listeners` - evaluation sample listeners

  - ### Method Detail

    - #### getFMeasure

          public FMeasure getFMeasure()

Copyright © 2026 The Apache Software Foundation. All rights reserved.