packing and unpacking variable length array/string using the struct module in python

by

The struct module does only support fixed-length structures. For variable-length strings, your options are either:

  • Dynamically construct your format string (a str will have to be converted to a bytes before passing it to pack()): 

    s = bytes(s, 'utf-8')    # Or other appropriate encoding
struct.pack("I%ds" % (len(s),), len(s), s)

  • Skip struct and just use normal string methods to add the string to your pack()-ed output: struct.pack("I", len(s)) + s

For unpacking, you just have to unpack a bit at a time:

(i,), data = struct.unpack("I", data[:4]), data[4:]
s, data = data[:i], data[i:]

If you’re doing a lot of this, you can always add a helper function which uses calcsize to do the string slicing:

def unpack_helper(fmt, data):
    size = struct.calcsize(fmt)
    return struct.unpack(fmt, data[:size]), data[size:]

More Related Contents:

  1. How to convert ‘binary string’ to normal string in Python3?
  2. Regular expression parsing a binary file?
  3. Convert binary string to bytearray in Python 3
  4. Discord Py on_message bot=False blocked?
  5. How to use global variables in Python?
  6. What does a b prefix before a python string mean?
  7. Why is dictionary ordering non-deterministic?
  8. How to run Spyder in virtual environment?
  9. What’s the difference between str.isdigit, isnumeric and isdecimal in python?
  10. Scrolling to element using webdriver?
  11. How to prevent iterator getting exhausted?
  12. How to match any string from a list of strings in regular expressions in python?
  13. TypeError: ‘range’ object does not support item assignment
  14. Is it bad practice to use a built-in function name as an attribute or method identifier?
  15. How can I get the domain name of my site within a Django template?
  16. How do I install theano in Anaconda ver. 2.1 Windows 64 bit for Python 3.4?
  17. Sending a password over SSH or SCP with subprocess.Popen
  18. Finding the nearest value and return the index of array in Python
  19. How to Open a file through python
  20. Error in Python script “Expected 2D array, got 1D array instead:”?
  21. multiprocessing vs multithreading vs asyncio
  22. Difference between AbstractUser and AbstractBaseUser in Django?
  23. Pip is not working for Python 3.10 on Ubuntu
  24. How to expire Django session in 5minutes?
  25. requests.get returns 403 while the same url works in browser
  26. How to force Sphinx to use Python 3.x interpreter
  27. sys.stdin.readline() and input(): which one is faster when reading lines of input, and why?
  28. exec() not working inside function python3.x
  29. Weird MRO result when inheriting directly from typing.NamedTuple
  30. How to combine Celery with asyncio?

Leave a Comment