How can I find the effect of an analyzer on a given text ? Write a simple test code that creates a TokenStream over a string (using java.io.StringReader) and prints its output.
Here is a sample (non tested) code:
final java.io.Reader reader = new StringReader("Testing Test Tester"); final TokenStream in = myAnalyzer.tokenStream(reader); for(;;) { final Token token = in.next(); if (token == null) { break; } System.out.println("[" + token.termText() + "]"); } Trackback: http://tb.donews.net/TrackBack.aspx?PostId=123040