Java OutOfMemoryError in reading a large text file

by

Try to use java.nio.MappedByteBuffer.

http://docs.oracle.com/javase/7/docs/api/java/nio/MappedByteBuffer.html

You can map a file’s content onto memory without copying it manually. High-level Operating Systems offer memory-mapping and Java has API to utilize the feature.

If my understanding is correct, memory-mapping does not load a file’s entire content onto memory (meaning “loaded and unloaded partially as necessary”), so I guess a 10GB file won’t eat up your memory.

More Related Contents:

  1. Java read file and store text in an array
  2. Why Java Only Allows String[] args as Main method Argument? [duplicate]
  3. Type mismatch: cannot convert from double to double[]
  4. I have a function in java which may have bug and I can not find it [closed]
  5. getResourceAsStream() vs FileInputStream
  6. Arrays.asList() not working as it should?
  7. How to convert jsonString to JSONObject in Java
  8. How do I remove objects from an array in Java?
  9. Array or List in Java. Which is faster?
  10. A quick and easy way to join array elements with a separator (the opposite of split) in Java [duplicate]
  11. How to convert an ArrayList containing Integers to primitive int array?
  12. How to supply value to an annotation from a Constant java
  13. What is this: [Ljava.lang.Object;?
  14. Creating an array of objects in Java
  15. Lambda expression to convert array/List of String to array/List of Integers
  16. Using GSON to parse a JSON array
  17. Java byte array contains negative numbers
  18. How to delete a folder with files using Java
  19. String array initialization in Java [duplicate]
  20. Read .txt file into 2D Array
  21. Why is using BufferedInputStream to read a file byte by byte faster than using FileInputStream?
  22. Read CSV file column by column
  23. Print array without brackets and commas
  24. Multi-dimensional array transposing
  25. Sort a parallel array using Arrays.sort()
  26. Java: are 1-d arrays always contiguous in memory?
  27. Create an array of ArrayList elements
  28. Finding the median value of an array?
  29. Read large CSV in java
  30. Java: Checking equality of arrays (order doesn’t matter)

Leave a Comment