Package opennlp.tools.tokenize
Class WhitespaceTokenStream
- java.lang.Object
-
- opennlp.tools.util.FilterObjectStream<TokenSample,java.lang.String>
-
- opennlp.tools.tokenize.WhitespaceTokenStream
-
- All Implemented Interfaces:
java.lang.AutoCloseable
,ObjectStream<java.lang.String>
public class WhitespaceTokenStream extends FilterObjectStream<TokenSample,java.lang.String>
This stream formats aTokenSample
s into whitespace separated token strings.
-
-
Constructor Summary
Constructors Constructor Description WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.lang.String
read()
Returns the next object.-
Methods inherited from class opennlp.tools.util.FilterObjectStream
close, reset
-
-
-
-
Constructor Detail
-
WhitespaceTokenStream
public WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
-
-
Method Detail
-
read
public java.lang.String read() throws java.io.IOException
Description copied from interface:ObjectStream
Returns the next object. Calling this method repeatedly until it returns null will return each object from the underlying source exactly once.- Returns:
- the next object or null to signal that the stream is exhausted
- Throws:
java.io.IOException
- if there is an error during reading
-
-