Class TokenizerFactory

    • Method Detail

      • forName

        public static TokenizerFactory forName​(java.lang.String name,
                                               java.util.Map<java.lang.String,​java.lang.String> args)
        looks up a tokenizer by name from context classpath
      • lookupClass

        public static java.lang.Class<? extends TokenizerFactory> lookupClass​(java.lang.String name)
        looks up a tokenizer class by name from context classpath
      • availableTokenizers

        public static java.util.Set<java.lang.String> availableTokenizers()
        returns a list of all available tokenizer names from context classpath
      • reloadTokenizers

        public static void reloadTokenizers​(java.lang.ClassLoader classloader)
        Reloads the factory list from the given ClassLoader. Changes to the factories are visible after the method ends, all iterators (availableTokenizers(),...) stay consistent.

        NOTE: Only new factories are added, existing ones are never removed or replaced.

        This method is expensive and should only be called for discovery of new factories on the given classpath/classloader!

      • create

        public final Tokenizer create​( input)
        Creates a TokenStream of the specified input using the default attribute factory.