opennlp.tools.tokenize

Class TokSpanEventStream

java.lang.Object

opennlp.tools.util.AbstractEventStream<TokenSample>

opennlp.tools.tokenize.TokSpanEventStream

All Implemented Interfaces:

java.lang.AutoCloseable, ObjectStream<Event>

public class TokSpanEventStream
extends AbstractEventStream<TokenSample>

This class reads the TokenSamples from the given Iterator and converts the TokenSamples into Events which can be used by the maxent library for training.

Constructor Summary

Constructors

Constructor and Description
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics) Initializes the current instance.
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, java.util.regex.Pattern alphaNumeric, TokenContextGenerator cg) Initializes the current instance.
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg) Initializes the current instance.

Method Summary

Methods inherited from class opennlp.tools.util.AbstractEventStream

close, read, reset

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
                          boolean skipAlphaNumerics,
                          java.util.regex.Pattern alphaNumeric,
                          TokenContextGenerator cg)

Initializes the current instance.

Parameters:

tokenSamples -

skipAlphaNumerics -

cg -

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
                          boolean skipAlphaNumerics,
                          TokenContextGenerator cg)

Initializes the current instance.

Parameters:

tokenSamples -

skipAlphaNumerics -

cg -

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
                          boolean skipAlphaNumerics)

Initializes the current instance.

Parameters:

tokenSamples -

skipAlphaNumerics -