token : Java Glossary


When you break a string up into words, each chunk is called a token. In parsing source Java code a token would be a name, keyword or an operator. java.util.StringTokenizer lets you define your own simple rules for what counts as a new token. For more advanced tokenizing you need a tool like LEX.

This page is posted
on the web at:

Optional Replicator mirror
on local hard disk J:

Please the feedback from other visitors, or your own feedback about the site.
Contact Roedy. Please feel free to link to this page without explicit permission.

Your face IP:[]
You are visitor number