Package ddf.catalog.pubsub.criteria.contextual

Class ContextualTokenizer

java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.apache.lucene.analysis.CharTokenizer
ddf.catalog.pubsub.criteria.contextual.ContextualTokenizer
All Implemented Interfaces:
Closeable, AutoCloseable
public class ContextualTokenizer extends org.apache.lucene.analysis.CharTokenizer
This is a workaround for https://issues.apache.org/jira/browse/LUCENE-588

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

    org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final Set<Character>
    SPECIAL_CHARACTERS_SET
     

    Fields inherited from class org.apache.lucene.analysis.Tokenizer

    input

  • Constructor Summary

    Constructors
    Constructor
    Description
    ContextualTokenizer(Reader input)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    protected boolean
    isTokenChar(char c)
     

    Methods inherited from class org.apache.lucene.analysis.CharTokenizer

    end, incrementToken, normalize, reset

    Methods inherited from class org.apache.lucene.analysis.Tokenizer

    close, correctOffset

    Methods inherited from class org.apache.lucene.analysis.TokenStream

    reset

    Methods inherited from class org.apache.lucene.util.AttributeSource

    addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

  • Field Details

    • SPECIAL_CHARACTERS_SET

      public static final Set<Character> SPECIAL_CHARACTERS_SET

  • Constructor Details

    • ContextualTokenizer

      public ContextualTokenizer(Reader input)

  • Method Details

    • isTokenChar

      protected boolean isTokenChar(char c)
      Specified by:
      isTokenChar in class org.apache.lucene.analysis.CharTokenizer