AttributeSource.State
修飾子とタイプ | フィールドと説明 |
---|---|
static java.lang.String |
DEFAULT_DELIMITERS |
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
コンストラクタと説明 |
---|
KnownWordsTokenizer(boolean ignoreCase,
FST<java.lang.Object> fst) |
KnownWordsTokenizer(java.lang.String delimiters,
boolean ignoreCase,
FST<java.lang.Object> fst) |
修飾子とタイプ | メソッドと説明 |
---|---|
boolean |
incrementToken() |
void |
reset() |
close, correctOffset, setReader
end
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
public static final java.lang.String DEFAULT_DELIMITERS
public KnownWordsTokenizer(java.lang.String delimiters, boolean ignoreCase, FST<java.lang.Object> fst)
public KnownWordsTokenizer(boolean ignoreCase, FST<java.lang.Object> fst)
public boolean incrementToken() throws java.io.IOException
incrementToken
クラス内 TokenStream
java.io.IOException
Copyright © 2009-2018 RONDHUIT Co.,Ltd. All Rights Reserved.