Scanner vs. StringTokenizer vs. String.Split

by

They’re essentially horses for courses.

  • Scanner is designed for cases where you need to parse a string, pulling out data of different types. It’s very flexible, but arguably doesn’t give you the simplest API for simply getting an array of strings delimited by a particular expression.
  • String.split() and Pattern.split() give you an easy syntax for doing the latter, but that’s essentially all that they do. If you want to parse the resulting strings, or change the delimiter halfway through depending on a particular token, they won’t help you with that.
  • StringTokenizer is even more restrictive than String.split(), and also a bit fiddlier to use. It is essentially designed for pulling out tokens delimited by fixed substrings. Because of this restriction, it’s about twice as fast as String.split(). (See my comparison of String.split() and StringTokenizer.) It also predates the regular expressions API, of which String.split() is a part.

You’ll note from my timings that String.split() can still tokenize thousands of strings in a few milliseconds on a typical machine. In addition, it has the advantage over StringTokenizer that it gives you the output as a string array, which is usually what you want. Using an Enumeration, as provided by StringTokenizer, is too “syntactically fussy” most of the time. From this point of view, StringTokenizer is a bit of a waste of space nowadays, and you may as well just use String.split().

More Related Contents:

  1. How to split a string if any chracter is found in java
  2. Tokenizing Error: java.util.regex.PatternSyntaxException, dangling metacharacter ‘*’
  3. Java’s Scanner vs String.split() vs StringTokenizer; which should I use?
  4. How to split command params with quotes? [duplicate]
  5. Scanner is skipping nextLine() after using next() or nextFoo()?
  6. Scanner is skipping nextLine() after using next() or nextFoo()?
  7. How to split a string with any whitespace chars as delimiters
  8. Using scanner.nextLine() [duplicate]
  9. Take a char input from the Scanner
  10. Splitting a string at every n-th character
  11. How to split a string in Java
  12. How can I use “.” as the delimiter with String.split() in java [duplicate]
  13. Scanner method to get a char
  14. Exception in thread “main” java.util.NoSuchElementException
  15. Why does hasNextLine() never end?
  16. Extracting pairs of words using String.split()
  17. Java String.split() Regex
  18. Extract Integer Part in String
  19. Java String.split() sometimes giving blank strings
  20. how to take user input in Array using java?
  21. Java: String split(): I want it to include the empty strings at the end [duplicate]
  22. Scanner input validation in while loop
  23. Split string into sentences
  24. hasNext() – when does it block and why?
  25. Splitting words into letters in Java [duplicate]
  26. How to test for blank line with Java Scanner?
  27. Integer.parseInt(scanner.nextLine()) vs scanner.nextInt()
  28. split string only on first instance – java
  29. How can split a string which contains only delimiter?
  30. How to use Scanner to read silently from STDIN in Java?

Leave a Comment