| FlagsAttribute | This attribute can be used to pass different flags down the Tokenizer chain, eg from one TokenFilter to another one. | code | html |
| OffsetAttribute | The start and end character offset of a Token. | code | html |
| PayloadAttribute | The payload of a Token. See also Payload . | code | html |
| PositionIncrementAttribute | The positionIncrement determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. | code | html |
| TermAttribute | The term text of a Token. | code | html |
| TypeAttribute | A Token's lexical type. The Default value is "word". | code | html |
| FlagsAttributeImpl | This attribute can be used to pass different flags down the tokenizer chain, eg from one TokenFilter to another one. | code | html |
| OffsetAttributeImpl | The start and end character offset of a Token. | code | html |
| PayloadAttributeImpl | The payload of a Token. See also Payload . | code | html |
| PositionIncrementAttributeImpl | The positionIncrement determines the position of this token relative to the previous Token in a TokenStream , used in phrase searching. | code | html |
| TermAttributeImpl | The term text of a Token. | code | html |
| TypeAttributeImpl | A Token's lexical type. The Default value is "word". | code | html |