token : Java Glossary

home page go to the Java Glossary Home go to the Computer Buyer’s Glossary up jump to foot of page Google search web for more information on this topic Pinterest pin button
* 0-9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z (all)
©1996-2017 Roedy Green of Canadian Mind Products

token
When you break a string up into words, each chunk is called a token. In parsing source Java code a token would be a name, keyword or an operator. java.util.StringTokenizer lets you define your own simple rules for what counts as a new token. For more advanced tokenizing you need a tool like LEX.

This page is posted
on the web at:

 http://mindprod.com/jgloss/token.html

Optional Replicator mirror
of mindprod.com
on local hard disk J:

 J:\mindprod\jgloss\token.html
Canadian Mind Products
Please the feedback from other visitors, or your own feedback about the site.
Contact Roedy. Please feel free to link to this page without explicit permission.

IP:[65.110.21.43]
Your face IP:[3.21.104.109]
You are visitor number