Java StringTokenizer

Tokens can be used where we want to break an application into tokens.

Java StringTokenizer

In this tutorial we will discuss about String Tokenizer in java. String Tokenizer allows an application to break into token. Java provide a way to break a line of text into token which is inside java.util  package. Token is smaller piece of a String. Let's say we wanted to break up the following line of text:

"Hello and Welcome to Rose India"

For breaking string into token,  first create a object of the StringTokenizer class, pass the string and the delimited string you want.

StringTokenizer str = new StringTokenizer(String,delimeter);

The set of delimiter may be specified at creation time or on token basis. Here delimiter is the character that separate tokens. StringTokenizer internally maintain a current position within the string to be tokenized. The following is one  example of use of the StringTokenizer.

StringTokenizer st = new StringTokenizer("Welcome Rose India");
     while (st.hasMoreTokens()) {

Output will be as follows :


StringTokenizer has following constructors as follows :

  • StringTokenizer(String str) : Create a String tokenizer for the specified string.
  • StringTokenizer(String str, String delim) : Create a String tokenizer for the specified String, the delim is the delimiter to break the string into tokens.
  • StringTokenizer(String str, String delim, boolean delim ): Create a String tokenizer for the specified, String, delim is the delimiter to break the string  into tokens.

And, Some of the methods of String Tokenizer are as follows:

  • countTokens() : Count the number of times the tokenizer nextToken method can be called before it raise an exception and returns integer value.
  • hasMoreElements() : Returns the value same as nextToken method.
  • hasMoreTokens() : Check if there are more token available in string tokenizer.
  • nextElement() : Returns the same value as nextToken method but return value is object rather than String.
  • nextToken() : Returns the next token from this String tokenizer.
  • nextToken() : Returns the next token in this string tokenizer string.

A simple code using StringTokenizer is as follows :

import java.util.StringTokenizer;

public class StringTokenizerDemo {
	public static void main(String a[]) {
		String msg = "Welcome Rose India";
		StringTokenizer st = new StringTokenizer(msg);
		while (st.hasMoreTokens()) {


When you compile and run this program Output will be as follows:

Download Source Code

Share on Google+Share on Google+

Java StringTokenizer

Posted on: June 29, 2013 If you enjoyed this post then why not add us on Google+? Add us to your Circles



Discuss: Java StringTokenizer  

Post your Comment

Your Name (*) :
Your Email :
Subject (*):
Your Comment (*):
  Reload Image