Package opennlp.tools.util.featuregen
Class FeatureGeneratorUtil
- java.lang.Object
-
- opennlp.tools.util.featuregen.FeatureGeneratorUtil
-
public class FeatureGeneratorUtil extends java.lang.Object
This class provide common utilities for feature generation.
-
-
Constructor Summary
Constructors Constructor Description FeatureGeneratorUtil()
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static java.lang.String
tokenFeature(java.lang.String token)
Generates a class name for the specified token.
-
-
-
Method Detail
-
tokenFeature
public static java.lang.String tokenFeature(java.lang.String token)
Generates a class name for the specified token. The classes are as follows where the first matching class is used:- jah - Japanese Hiragana
- jak - Japanese Katakana
- lc - lowercase alphabetic
- 2d - two digits
- 4d - four digits
- an - alpha-numeric
- dd - digits and dashes
- ds - digits and slashes
- dc - digits and commas
- dp - digits and periods
- num - digits
- sc - single capital letter
- ac - all capital letters
- ic - initial capital letter
- other - other
- Parameters:
token
- A token or word.- Returns:
- The class name that the specified token belongs in.
-
-