How to read a v7.3 mat file via h5py?

by

Matlab 7.3 file format is not extremely easy to work with h5py. It relies on HDF5 reference, cf. h5py documentation on references.

>>> import h5py
>>> f = h5py.File('test.mat')
>>> list(f.keys())
['#refs#', 'struArray']
>>> struArray = f['struArray']
>>> struArray['name'][0, 0]  # this is the HDF5 reference
<HDF5 object reference>
>>> f[struArray['name'][0, 0]].value  # this is the actual data
array([[111],
       [110],
       [101]], dtype=uint16)

To read struArray(i).id:

>>> f[struArray['id'][0, 0]][0, 0]
1.0
>>> f[struArray['id'][1, 0]][0, 0]
2.0
>>> f[struArray['id'][2, 0]][0, 0]
3.0

Notice that Matlab stores a number as an array of size (1, 1), hence the final [0, 0] to get the number.

To read struArray(i).data:

>>> f[struArray['data'][0, 0]].value
array([[  1.],
       [  2.],
       [  3.],
       [  4.],
       [  5.],
       [  6.],
       [  7.],
       [  8.],
       [  9.],
       [ 10.]])

To read struArray(i).name, it is necessary to convert the array of integers to string:

>>> f[struArray['name'][0, 0]].value.tobytes()[::2].decode()
'one'
>>> f[struArray['name'][1, 0]].value.tobytes()[::2].decode()
'two'
>>> f[struArray['name'][2, 0]].value.tobytes()[::2].decode()
'three'

More Related Contents:

  1. Optimal HDF5 dataset chunk shape for reading rows
  2. Incremental writes to hdf5 with h5py
  3. Error opening file in H5PY (File signature not found)
  4. Pandas can’t read hdf5 file created with h5py
  5. read matlab v7.3 file into python list of numpy arrays via h5py
  6. Is there an analysis speed or memory usage advantage to using HDF5 for large array storage (instead of flat binary files)?
  7. What is the difference between the two ways of accessing the hdf5 group in SVHN dataset?
  8. Read .mat files in Python
  9. Call Python function from MATLAB
  10. Saving to hdf5 is very slow (Python freezing)
  11. Sampling uniformly distributed random points inside a spherical volume
  12. Segmenting License Plate Characters
  13. pytables writes much faster than h5py. Why?
  14. h5py not sticking to chunking specification?
  15. Color matplotlib plot_surface command with surface gradient
  16. HDF5 – concurrency, compression & I/O performance [closed]
  17. Storing numpy sparse matrix in HDF5 (PyTables)
  18. Numpy loading csv TOO slow compared to Matlab
  19. Performance: Matlab vs Python
  20. Selecting close matches from one array based on another reference array
  21. Why does numpy std() give a different result to matlab std()?
  22. Input and output numpy arrays to h5py
  23. Pandas ParserError EOF character when reading multiple csv files to HDF5
  24. Complex matlab-like data structure in python (numpy/scipy)
  25. Is MATLAB faster than Python?
  26. 2D Convolution in Python similar to Matlab’s conv2
  27. Numpy equivalent of MATLAB’s cell array
  28. Improve performance of converting numpy array to MATLAB double
  29. Comparing Matlab and Numpy code that uses random number generation
  30. Why does numpy.histogram (Python) leave off one element as compared to hist in Matlab?

Leave a Comment