## Uses of Class
org.apache.lucene.analysis.Tokenizer

Packages that use Tokenizer
Package | Description
--- | ---
org.apache.lucene.analysis | API and code to convert text into indexable/searchable tokens.

### Uses of Tokenizer in org.apache.lucene.analysis

Fields in org.apache.lucene.analysis declared as Tokenizer
Modifier and Type | Field and Description
--- | ---
`protected Tokenizer` | Analyzer.TokenStreamComponents.`source` Original source of the tokens.

Methods in org.apache.lucene.analysis that return Tokenizer
Modifier and Type | Method and Description
--- | ---
`Tokenizer` | Analyzer.TokenStreamComponents.`getTokenizer()` Returns the component's `Tokenizer`

Constructors in org.apache.lucene.analysis with parameters of type Tokenizer
Constructor and Description
`Analyzer.TokenStreamComponents(Tokenizer source)` Creates a new `Analyzer.TokenStreamComponents` instance.
`Analyzer.TokenStreamComponents(Tokenizer source, TokenStream result)` Creates a new `Analyzer.TokenStreamComponents` instance.