uk.ac.bham.gloss
Interface Tokenizer
- All Superinterfaces:
- Locator
- All Known Implementing Classes:
- StreamTokenizer, TokenTokenizer
public interface Tokenizer
- extends Locator
The Tokenizer interface represents an object that reads a stream of data
and converts it into tokens.
Copyright Richard Kaye 2007-8 for GLOSS, http://gloss.bham.ac.uk
Usage permitted according to the GPL. No waranty.
ungetToken
void ungetToken()
throws GlossException
- Throws:
GlossException
getToken
Token getToken(java.lang.String accept)
throws GlossException
- Throws:
GlossException