Package opennlp.tools.tokenize
Class TokSpanEventStream
- java.lang.Object
-
- opennlp.tools.util.AbstractEventStream<TokenSample>
-
- opennlp.tools.tokenize.TokSpanEventStream
-
- All Implemented Interfaces:
java.lang.AutoCloseable
,ObjectStream<Event>
public class TokSpanEventStream extends AbstractEventStream<TokenSample>
This class reads theTokenSample
s from the givenIterator
and converts theTokenSample
s intoEvent
s which can be used by the maxent library for training.
-
-
Constructor Summary
Constructors Constructor Description TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics)
Initializes the current instance.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, java.util.regex.Pattern alphaNumeric, TokenContextGenerator cg)
Initializes the current instance.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)
Initializes the current instance.
-
Method Summary
-
Methods inherited from class opennlp.tools.util.AbstractEventStream
close, read, reset
-
-
-
-
Constructor Detail
-
TokSpanEventStream
public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, java.util.regex.Pattern alphaNumeric, TokenContextGenerator cg)
Initializes the current instance.- Parameters:
tokenSamples
-skipAlphaNumerics
-cg
-
-
TokSpanEventStream
public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)
Initializes the current instance.- Parameters:
tokenSamples
-skipAlphaNumerics
-cg
-
-
TokSpanEventStream
public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics)
Initializes the current instance.- Parameters:
tokenSamples
-skipAlphaNumerics
-
-
-