Module org.apache.lucene.analysis.nori

Package org.apache.lucene.analysis.ko

Class KoreanPartOfSpeechStopFilter

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.TokenFilter

org.apache.lucene.analysis.FilteringTokenFilter

org.apache.lucene.analysis.ko.KoreanPartOfSpeechStopFilter

All Implemented Interfaces:

Closeable, AutoCloseable, Unwrappable<TokenStream>

public final class KoreanPartOfSpeechStopFilter
extends FilteringTokenFilter

Removes tokens that match a set of part-of-speech tags.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

AttributeSource.State

Field Summary

Fields

Modifier and Type	Field	Description
static final Set<POS.Tag>	DEFAULT_STOP_TAGS	Default list of tags to filter.
private final PartOfSpeechAttribute	posAtt
private final Set<POS.Tag>	stopTags

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Fields inherited from class org.apache.lucene.analysis.TokenStream

DEFAULT_TOKEN_ATTRIBUTE_FACTORY

Constructor Summary

Constructors

Constructor	Description
KoreanPartOfSpeechStopFilter(TokenStream input)	Create a new KoreanPartOfSpeechStopFilter with the default list of stop tags DEFAULT_STOP_TAGS.
KoreanPartOfSpeechStopFilter(TokenStream input, Set<POS.Tag> stopTags)	Create a new KoreanPartOfSpeechStopFilter.

Method Summary

Modifier and Type	Method	Description
protected boolean	accept()	Override this method and return if the current input token should be returned by FilteringTokenFilter.incrementToken().

Methods inherited from class org.apache.lucene.analysis.FilteringTokenFilter

end, incrementToken, reset

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close, unwrap

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Details

stopTags

private final Set<POS.Tag> stopTags

posAtt

private final PartOfSpeechAttribute posAtt

DEFAULT_STOP_TAGS

public static final Set<POS.Tag> DEFAULT_STOP_TAGS

Default list of tags to filter.

Constructor Details

KoreanPartOfSpeechStopFilter

public KoreanPartOfSpeechStopFilter(TokenStream input)

Create a new KoreanPartOfSpeechStopFilter with the default list of stop tags DEFAULT_STOP_TAGS.

Parameters:

input - the TokenStream to consume

KoreanPartOfSpeechStopFilter

public KoreanPartOfSpeechStopFilter(TokenStream input,
 Set<POS.Tag> stopTags)

Create a new KoreanPartOfSpeechStopFilter.

Parameters:

input - the TokenStream to consume

stopTags - the part-of-speech tags that should be removed

Method Details

accept

protected boolean accept()

Description copied from class: FilteringTokenFilter

Override this method and return if the current input token should be returned by FilteringTokenFilter.incrementToken().

Specified by:

accept in class FilteringTokenFilter