uk.ac.bham.gloss
Interface Tokenizer

All Superinterfaces:
Locator
All Known Implementing Classes:
StreamTokenizer, TokenTokenizer

public interface Tokenizer
extends Locator

The Tokenizer interface represents an object that reads a stream of data and converts it into tokens. Copyright Richard Kaye 2007-8 for GLOSS, http://gloss.bham.ac.uk Usage permitted according to the GPL. No waranty.


Method Summary
 Token getToken(java.lang.String accept)
           
 void ungetToken()
           
 
Methods inherited from interface uk.ac.bham.gloss.Locator
col, doc, line
 

Method Detail

ungetToken

void ungetToken()
                throws GlossException
Throws:
GlossException

getToken

Token getToken(java.lang.String accept)
               throws GlossException
Throws:
GlossException