StreamTokenizer : Java Glossary
home S words local find no local find frame, full screen Google search web for topic jump to footer translate with Babelfish by Roedy Green ©1996-2008 Canadian Mind Products
Go to : punctuation 0-9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z (all)
StreamTokenizer
java.io.StreamTokenizer breaks up the ASCII text in a file into chunks at delimiters and hands them to you one at a time, preconverted to a binary double for numerics. See this StreamTokenizer code example. Watch the American spelling. Using StreamTokenizer on an InputStream is now deprecated. You are supposed to convert your InputStream to a BufferedReader then use it. Beware! resetSyntax does not behave as advertised. To clear all characters to behave as ordinary characters, rather than delimiters, you must use ordinaryChars(0,255) then start your modifications, with methods like: commentChar, quoteChar, whitespaceChars, wordChars . Make sure your files have a terminal CrLf when using StreamTokenizer. java.io.StringTokenizer is much simpler.

Reading Numeric Data From an ASCII file

Java has no built-in methods for reading data of the form: 123 456,-4.

You have to roll your own method. Use java.io.StreamTokenizer or java.util.StringTokenizer, perhaps in combination with readLine to get your data into strings. StreamTokenizer has bells and whistles to deal with parsing source code, including white space, comments and numbers. StringTokenizer just splits the text up based on delimiter characters. Then use the conversion methods in the conversion table to convert to integers etc.

StreamTokenizer Method Of Reading Integers From An ASCII File

Learning More

Sun’s Javadoc on the StreamTokenizer class : available:

CMP_homejump to top
CMP logo
feedback Please email your feedback for publication, errors, omissions, broken/redirected link reports
and suggestions to improve this page to Roedy Green : feedback email
made with CSS
HTML Checked!
ICRA ratings logo
mindprod.com IP:[65.110.21.43]
Your face IP:[38.103.63.18] The information on this page is for non-military use only.
You are visitor number 19,469. Military use includes use by defence contractors.
You can get a fresh copy of this page from: or possibly from your local J: drive (Java virtual drive/Mindprod website mirror)
http://mindprod.com/jgloss/streamtokenizer.html J:\mindprod\jgloss\streamtokenizer.html