Uses of Class
org.apache.lucene.analysis.Token

Packages that use Token
org.apache.lucene.analysis API and code to convert text into indexable tokens. 
org.apache.lucene.analysis.br Analyzer for Brazilian. 
org.apache.lucene.analysis.cjk Analyzer for Chinese, Japanese and Korean. 
org.apache.lucene.analysis.cn Analyzer for Chinese. 
org.apache.lucene.analysis.de Analyzer for German. 
org.apache.lucene.analysis.el Analyzer for Greek. 
org.apache.lucene.analysis.fr Analyzer for French. 
org.apache.lucene.analysis.nl Analyzer for Dutch. 
org.apache.lucene.analysis.ru Analyzer for Russian. 
org.apache.lucene.analysis.snowball TokenFilter and Analyzer implementations that use Snowball stemmers. 
org.apache.lucene.analysis.standard A grammar-based tokenizer constructed with JavaCC. 
org.apache.lucene.index.memory High-performance single-document main memory Apache Lucene fulltext search index. 
org.apache.lucene.search.highlight The highlight package contains classes to provide "keyword in context" features typically used to highlight search terms in the text of results pages. 
 

Uses of Token in org.apache.lucene.analysis
 

Methods in org.apache.lucene.analysis that return Token
abstract  Token TokenStream.next()
          Returns the next token in the stream, or null at EOS.
 Token StopFilter.next()
          Returns the next input Token whose termText() is not a stop word.
 Token PorterStemFilter.next()
          Returns the next input Token, after being stemmed
 Token LowerCaseFilter.next()
           
 Token LengthFilter.next()
          Returns the next input Token whose termText() is the right len
 Token KeywordTokenizer.next()
           
 Token ISOLatin1AccentFilter.next()
           
 Token CharTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.analysis.br
 

Methods in org.apache.lucene.analysis.br that return Token
 Token BrazilianStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.cjk
 

Methods in org.apache.lucene.analysis.cjk that return Token
 Token CJKTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.analysis.cn
 

Methods in org.apache.lucene.analysis.cn that return Token
 Token ChineseTokenizer.next()
           
 Token ChineseFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.de
 

Methods in org.apache.lucene.analysis.de that return Token
 Token GermanStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.el
 

Methods in org.apache.lucene.analysis.el that return Token
 Token GreekLowerCaseFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.fr
 

Methods in org.apache.lucene.analysis.fr that return Token
 Token FrenchStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.nl
 

Methods in org.apache.lucene.analysis.nl that return Token
 Token DutchStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.ru
 

Methods in org.apache.lucene.analysis.ru that return Token
 Token RussianStemFilter.next()
           
 Token RussianLowerCaseFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.snowball
 

Methods in org.apache.lucene.analysis.snowball that return Token
 Token SnowballFilter.next()
          Returns the next input Token, after being stemmed
 

Uses of Token in org.apache.lucene.analysis.standard
 

Methods in org.apache.lucene.analysis.standard that return Token
 Token StandardTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 Token StandardFilter.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.index.memory
 

Methods in org.apache.lucene.index.memory that return Token
protected  Token SynonymTokenFilter.createToken(String synonym, Token current)
          Creates and returns a token for the given synonym of the current input token; Override for custom (stateless or stateful) behaviour, if desired.
 Token SynonymTokenFilter.next()
          Returns the next token in the stream, or null at EOS.
 

Methods in org.apache.lucene.index.memory with parameters of type Token
protected  Token SynonymTokenFilter.createToken(String synonym, Token current)
          Creates and returns a token for the given synonym of the current input token; Override for custom (stateless or stateful) behaviour, if desired.
 

Uses of Token in org.apache.lucene.search.highlight
 

Methods in org.apache.lucene.search.highlight that return Token
 Token TokenGroup.getToken(int index)
           
 

Methods in org.apache.lucene.search.highlight with parameters of type Token
 float Scorer.getTokenScore(Token token)
          Called for each token in the current fragment
 float QueryScorer.getTokenScore(Token token)
           
 boolean SimpleFragmenter.isNewFragment(Token token)
           
 boolean NullFragmenter.isNewFragment(Token token)
           
 boolean Fragmenter.isNewFragment(Token nextToken)
          Test to see if this token from the stream should be held in a new TextFragment
 



Copyright © 2000-2008 Apache Software Foundation. All Rights Reserved.