Find the size of the file inside a GZIP file

by

There is no truly reliable way, other than gunzipping the stream. You do not need to save the result of the decompression, so you can determine the size by simply reading and decoding the entire file without taking up space with the decompressed result.

There is an unreliable way to determine the uncompressed size, which is to look at the last four bytes of the gzip file, which is the uncompressed length of that entry modulo 232 in little endian order.

It is unreliable because a) the uncompressed data may be longer than 232 bytes, and b) the gzip file may consist of multiple gzip streams, in which case you would find the length of only the last of those streams.

If you are in control of the source of the gzip files, you know that they consist of single gzip streams, and you know that they are less than 232 bytes uncompressed, then and only then can you use those last four bytes with confidence.

pigz (which can be found at http://zlib.net/pigz/ ) can do it both ways. pigz -l will give you the unreliable length very quickly. pigz -lt will decode the entire input and give you the reliable lengths.

More Related Contents:

  1. Using GZIP compression with Spring Boot/MVC/JavaConfig with RESTful
  2. compression and decompression of string data in java
  3. Is gzip format supported in Spark?
  4. GZip POST request with HTTPClient in Java
  5. HTTP request compression
  6. How to Compress/Decompress tar.gz files in java
  7. Does Apache Commons HttpClient support GZIP?
  8. Why is subtracting these two times (in 1927) giving a strange result?
  9. How to check if a Date falls in a certain week or Quarter [closed]
  10. how to replace display array list equals another array list values
  11. How to get the user input in Java?
  12. Can I add jars to Maven 2 build classpath without installing them?
  13. Convert ArrayList to String[] array [duplicate]
  14. Difference between ProcessBuilder and Runtime.exec()
  15. findviewbyid returns null in a dialog
  16. How large is the Integer cache?
  17. Java – why no return type based method overloading?
  18. JavaFX Application Icon
  19. Mockito – @Spy vs @Mock
  20. Spring JpaRepository – Detach and Attach entity
  21. What does ‘URI has an authority component’ mean?
  22. How to make another thread sleep in Java
  23. How to add test coverage to a private constructor?
  24. Why does Maven have such a bad rep? [closed]
  25. Java Enums: Two enum types, each containing references to each other?
  26. Get the number of days, weeks, and months, since Epoch in Java
  27. JUnit 4 @BeforeClass & @AfterClass when using Suites
  28. How to URL encode a URL in JSP / JSTL?
  29. Methods With Same Name as Constructor – Why?
  30. java.util.Timer: Is it deprecated?

Leave a Comment