token : Java Glossary

*0-9ABCDEFGHIJKLMNOPQRSTUVWXYZ (all)

token
When you break a string up into words, each chunk is called a token. In parsing source Java code a token would be a name, keyword or an operator. java.util.StringTokenizer lets you define your own simple rules for what counts as a new token. For more advanced tokenizing you need a tool like LEX.

This page is posted
on the web at:

http://mindprod.com/jgloss/token.html

Optional Replicator mirror
of mindprod.com
on local hard disk J:

J:\mindprod\jgloss\token.html
logo
Please the feedback from other visitors, or your own feedback about the site.
Contact Roedy. Please feel free to link to this page without explicit permission.
Blog
IP:[65.110.21.43]
Your face IP:[107.21.152.198]
You are visitor number