StreamTokenizer : Java Glossary
java.io.StreamTokenizer breaks up the
ASCII (American Standard Code for Information Interchange) text in a file into chunks at delimiters and hands
them to you one at a time, preconverted to a binary double for numerics. See this
example. Watch the American spelling. Using StreamTokenizer
on an InputStream is now deprecated. You are supposed to convert your InputStream to
a BufferedReader then use it. Beware! resetSyntax does not
behave as advertised. To clear all characters to behave as ordinary characters,
rather than delimiters, you must use ordinaryChars(0,255)
then start your modifications, with methods like: commentChar,
quoteChar, whitespaceChars, wordChars. Make sure your files have a terminal
CrLf when using StreamTokenizer. java.io.StringTokenizer is
Reading Numeric Data From an ASCII
Java has no built-in methods for reading data of the form: 123 456,-4.
You have to roll your own method. Use java.io.StreamTokenizer or java.util.StringTokenizer, perhaps in combination with readLine to get your data into strings. StreamTokenizer has bells and whistles to deal with parsing source
code, including white space, comments and numbers. StringTokenizer just splits the text up based on delimiter characters.
Then use the conversion methods in the conversion table to convert to integers etc.
StreamTokenizer Method of Reading Integers From An ASCII
Oracle’s Javadoc on StreamTokenizer
class : available: