Package org.apache.cassandra.index.sasi.analyzer

Class StandardAnalyzer

java.lang.Object

org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer

org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer

All Implemented Interfaces:

Iterator<ByteBuffer>

public class StandardAnalyzer
extends AbstractAnalyzer

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	StandardAnalyzer.TokenType

Field Summary

Fields

Modifier and Type	Field	Description
protected Reader	inputReader

Fields inherited from class org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer

next

Constructor Summary

Constructors

Constructor	Description
StandardAnalyzer()

Method Summary

Modifier and Type	Method	Description
protected String	getFilteredCurrentToken()
String	getToken()
boolean	hasNext()
final boolean	incrementToken()
void	init(Map<String,String> options, AbstractType<?> validator)
protected void	init(StandardTokenizerOptions options)
void	init(StandardTokenizerOptions tokenizerOptions, AbstractType<?> validator)
boolean	isCompatibleWith(AbstractType<?> validator)	Test whether the given validator is compatible with the underlying analyzer.
boolean	isTokenizing()
void	reset(InputStream input)
void	reset(ByteBuffer input)

Methods inherited from class org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer

next, normalize, remove, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Details

inputReader

protected Reader inputReader

Constructor Details

StandardAnalyzer

public StandardAnalyzer()

Method Details

getToken

public String getToken()

incrementToken

public final boolean incrementToken()
                             throws IOException

Throws:

IOException

getFilteredCurrentToken

protected String getFilteredCurrentToken()
                                  throws IOException

Throws:

IOException

init

public void init(Map<String,String> options,
 AbstractType<?> validator)

Specified by:

init in class AbstractAnalyzer

init

protected void init(StandardTokenizerOptions options)

init

public void init(StandardTokenizerOptions tokenizerOptions,
 AbstractType<?> validator)

hasNext

public boolean hasNext()

reset

public void reset(ByteBuffer input)

Specified by:

reset in class AbstractAnalyzer

reset

public void reset(InputStream input)

isTokenizing

public boolean isTokenizing()

Overrides:

isTokenizing in class AbstractAnalyzer

Returns:

true if current analyzer provides text tokenization, false otherwise.

isCompatibleWith

public boolean isCompatibleWith(AbstractType<?> validator)

Description copied from class: AbstractAnalyzer

Test whether the given validator is compatible with the underlying analyzer.

Specified by:

isCompatibleWith in class AbstractAnalyzer

Parameters:

validator - the validator to test the compatibility with

Returns:

true if the give validator is compatible, false otherwise