fr.gouv.culture.sdx.search.lucene.analysis.filter
Class ChineseFilter
java.lang.Object
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
fr.gouv.culture.sdx.search.lucene.analysis.filter.ChineseFilter
- public final class ChineseFilter
- extends org.apache.lucene.analysis.TokenFilter
Title: ChineseFilter
Description: Filter with a stop word table
Rule: No digital is allowed.
English word/token should larger than 1 character.
One Chinese character as one Chinese word.
TO DO:
1. Add Chinese stop words, such as
2. Dictionary based Chinese word extraction
3. Intelligent Chinese word extraction
Copyright: Copyright (c) 2001
Company:
- Version:
- 1.0
- Author:
- Yiyi Sun
Field Summary |
static java.lang.String[] |
STOP_WORDS
|
Fields inherited from class org.apache.lucene.analysis.TokenFilter |
input |
Constructor Summary |
ChineseFilter(org.apache.lucene.analysis.TokenStream in)
|
ChineseFilter(org.apache.lucene.analysis.TokenStream in,
java.util.Hashtable stopWords)
|
Method Summary |
org.apache.lucene.analysis.Token |
next()
|
Methods inherited from class org.apache.lucene.analysis.TokenFilter |
close |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
STOP_WORDS
public static final java.lang.String[] STOP_WORDS
ChineseFilter
public ChineseFilter(org.apache.lucene.analysis.TokenStream in)
ChineseFilter
public ChineseFilter(org.apache.lucene.analysis.TokenStream in,
java.util.Hashtable stopWords)
next
public final org.apache.lucene.analysis.Token next()
throws java.io.IOException
- Throws:
java.io.IOException
Copyright © 2000-2004 Ministere de la culture et de la communication / AJLSM. All Rights Reserved.