Streaming large files in a java servlet

by

When possible, you should not store the entire contents of a file to be served in memory. Instead, aquire an InputStream for the data, and copy the data to the Servlet OutputStream in pieces. For example:

ServletOutputStream out = response.getOutputStream();
InputStream in = [ code to get source input stream ];
String mimeType = [ code to get mimetype of data to be served ];
byte[] bytes = new byte[FILEBUFFERSIZE];
int bytesRead;

response.setContentType(mimeType);

while ((bytesRead = in.read(bytes)) != -1) {
    out.write(bytes, 0, bytesRead);
}

// do the following in a finally block:
in.close();
out.close();

I do agree with toby, you should instead “point them to the S3 url.”

As for the OOM exception, are you sure it has to do with serving the image data? Let’s say your JVM has 256MB of “extra” memory to use for serving image data. With Google’s help, “256MB / 200KB” = 1310. For 2GB “extra” memory (these days a very reasonable amount) over 10,000 simultaneous clients could be supported. Even so, 1300 simultaneous clients is a pretty large number. Is this the type of load you experienced? If not, you may need to look elsewhere for the cause of the OOM exception.

Edit – Regarding:

In this use case the images can contain sensitive data…

When I read through the S3 documentation a few weeks ago, I noticed that you can generate time-expiring keys that can be attached to S3 URLs. So, you would not have to open up the files on S3 to the public. My understanding of the technique is:

  1. Initial HTML page has download links to your webapp
  2. User clicks on a download link
  3. Your webapp generates an S3 URL that includes a key that expires in, lets say, 5 minutes.
  4. Send an HTTP redirect to the client with the URL from step 3.
  5. The user downloads the file from S3. This works even if the download takes more than 5 minutes – once a download starts it can continue through completion.

More Related Contents:

  1. How to get the current working directory in Java?
  2. How to list the files inside a JAR file?
  3. java.io.Console support in Eclipse IDE
  4. Correct way to close nested streams and writers in Java [duplicate]
  5. Getting java.net.SocketTimeoutException: Connection timed out in android
  6. Java InputStream blocking read
  7. Best Way to Write Bytes in the Middle of a File in Java
  8. What does System.in.read actually return?
  9. How to create a new java.io.File in memory? [duplicate]
  10. how to File.listFiles in alphabetical order?
  11. java IO to copy one File to another
  12. How to get just the parent directory name of a specific file
  13. Alternative to File.exists() in Java
  14. Using java.io library in eclipse so FileInputStream can read a dat file
  15. Java difference between FileWriter and BufferedWriter
  16. Process Builder waitFor() issue and Open file limitations
  17. Converting transparent gif / png to jpeg using java
  18. com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
  19. How do I get the CellRow when there is an ItemEvent in the JComboBox within the cell
  20. How do you import classes in JSP?
  21. How returns XxxSize from JComponent(s) added to the JLabel
  22. Difference between @Valid and @Validated in Spring
  23. JAXB marshalling XMPP stanzas
  24. Why does InputStream#read() return an int and not a byte?
  25. why do we have to use @Modifying annotation for queries in Data Jpa
  26. Writing a new refactoring plugin for Eclipse?
  27. Difference between @MapKey, @MapKeyColumn and @MapKeyJoinColumn in JPA and Hibernate
  28. java.sql.SQLException: No database selected – why?
  29. Autoboxing can’t convert an int to an Integer
  30. C++ ifstream.getline() significantly slower than Java’s BufferedReader.readLine()?

Leave a Comment