fr.gouv.culture.sdx.search.lucene.analysis
Class Analyzer_cz

java.lang.Object
  extended byorg.apache.lucene.analysis.Analyzer
      extended byfr.gouv.culture.sdx.search.lucene.analysis.AbstractAnalyzer
          extended byfr.gouv.culture.sdx.search.lucene.analysis.DefaultAnalyzer
              extended byfr.gouv.culture.sdx.search.lucene.analysis.Analyzer_cz
All Implemented Interfaces:
Analyzer, org.apache.avalon.framework.configuration.Configurable, org.apache.avalon.framework.logger.LogEnabled, java.io.Serializable

public final class Analyzer_cz
extends DefaultAnalyzer

Analyzer for Czech language. Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified, the exclusion list is empty by default.

Author:
Lukas Zapletal [lzap@root.cz]
See Also:
Serialized Form

Field Summary
static java.lang.String[] DEFAULT_STOP_WORDS
          List of typical stopwords.
 
Fields inherited from class fr.gouv.culture.sdx.search.lucene.analysis.DefaultAnalyzer
ANALYZER_TYPE, ATTRIBUTE_EXCLUDE_STEMS, ATTRIBUTE_USE_STOP_WORDS, EXCLUDE_STEM_ELEMENT, EXCLUDE_STEMS_ELEMENT, excludeTable, stopTable
 
Fields inherited from class fr.gouv.culture.sdx.search.lucene.analysis.AbstractAnalyzer
logger
 
Constructor Summary
Analyzer_cz()
          Builds an analyzer.
Analyzer_cz(java.io.File stopwords)
          Builds an analyzer with the given stop words.
Analyzer_cz(java.util.Hashtable stopwords)
          Builds an analyzer with the given stop words.
Analyzer_cz(java.lang.String[] stopwords)
          Builds an analyzer with the given stop words.
 
Method Summary
 void loadStopWords(java.io.InputStream wordfile, java.lang.String encoding)
          Loads stopwords hash from resource stream (file, database...).
 org.apache.lucene.analysis.TokenStream tokenStream(java.lang.String fieldName, java.io.Reader reader)
          Creates a TokenStream which tokenizes all the text in the provided Reader.
 
Methods inherited from class fr.gouv.culture.sdx.search.lucene.analysis.DefaultAnalyzer
buildExcludeTable, buildStopTable, configure, getAnalyzerType, getDefaultStopWords
 
Methods inherited from class fr.gouv.culture.sdx.search.lucene.analysis.AbstractAnalyzer
enableLogging
 
Methods inherited from class org.apache.lucene.analysis.Analyzer
tokenStream
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface fr.gouv.culture.sdx.search.lucene.analysis.Analyzer
tokenStream
 

Field Detail

DEFAULT_STOP_WORDS

public static final java.lang.String[] DEFAULT_STOP_WORDS
List of typical stopwords.

Constructor Detail

Analyzer_cz

public Analyzer_cz()
Builds an analyzer.


Analyzer_cz

public Analyzer_cz(java.lang.String[] stopwords)
Builds an analyzer with the given stop words.


Analyzer_cz

public Analyzer_cz(java.util.Hashtable stopwords)
Builds an analyzer with the given stop words.


Analyzer_cz

public Analyzer_cz(java.io.File stopwords)
Builds an analyzer with the given stop words.

Method Detail

loadStopWords

public void loadStopWords(java.io.InputStream wordfile,
                          java.lang.String encoding)
Loads stopwords hash from resource stream (file, database...).

Parameters:
wordfile - File containing the wordlist
encoding - Encoding used (win-1250, iso-8859-2, ...}, null for default system encoding

tokenStream

public final org.apache.lucene.analysis.TokenStream tokenStream(java.lang.String fieldName,
                                                                java.io.Reader reader)
Creates a TokenStream which tokenizes all the text in the provided Reader.

Specified by:
tokenStream in interface Analyzer
Overrides:
tokenStream in class DefaultAnalyzer
Returns:
A TokenStream build from a StandardTokenizer filtered with StandardFilter, StopFilter, GermanStemFilter and LowerCaseFilter


Copyright © 2000-2004 Ministere de la culture et de la communication / AJLSM. All Rights Reserved.