Input and output numpy arrays to h5py

by

h5py provides a model of datasets and groups. The former is basically arrays and the latter you can think of as directories. Each is named. You should look at the documentation for the API and examples:

http://docs.h5py.org/en/latest/quick.html

A simple example where you are creating all of the data upfront and just want to save it to an hdf5 file would look something like:

In [1]: import numpy as np
In [2]: import h5py
In [3]: a = np.random.random(size=(100,20))
In [4]: h5f = h5py.File('data.h5', 'w')
In [5]: h5f.create_dataset('dataset_1', data=a)
Out[5]: <HDF5 dataset "dataset_1": shape (100, 20), type "<f8">

In [6]: h5f.close()

You can then load that data back in using:
‘

In [10]: h5f = h5py.File('data.h5','r')
In [11]: b = h5f['dataset_1'][:]
In [12]: h5f.close()

In [13]: np.allclose(a,b)
Out[13]: True

Definitely check out the docs:

http://docs.h5py.org

Writing to hdf5 file depends either on h5py or pytables (each has a different python API that sits on top of the hdf5 file specification). You should also take a look at other simple binary formats provided by numpy natively such as np.save, np.savez etc:

http://docs.scipy.org/doc/numpy/reference/routines.io.html

More Related Contents:

  1. How to print the full NumPy array, without truncation?
  2. Convert Python sequence to NumPy array, filling missing values
  3. Numpy array assignment with copy
  4. numpy matrix vector multiplication [duplicate]
  5. Repeating each element of a numpy array 5 times
  6. how does multiplication differ for NumPy Matrix vs Array classes?
  7. Ambiguity in Pandas Dataframe / Numpy Array “axis” definition
  8. How to split/partition a dataset into training and test datasets for, e.g., cross validation?
  9. How to create a numpy array of arbitrary length strings?
  10. Numpy modify array in place?
  11. Subsetting a 2D numpy array
  12. How to normalize a 2-dimensional numpy array in python less verbose?
  13. What is the difference between ndarray and array in NumPy?
  14. Removing elements from an array that are in another array
  15. Creating same random number sequence in Python, NumPy and R
  16. Stocking large numbers into numpy array
  17. check for identical rows in different numpy arrays
  18. pd.Timestamp versus np.datetime64: are they interchangeable for selected uses?
  19. Numpy: For every element in one array, find the index in another array
  20. Prevent numpy from creating a multidimensional array
  21. Numpy isnan() fails on an array of floats (from pandas dataframe apply)
  22. Concatenate range arrays given start, stop numbers in a vectorized way – NumPy
  23. read matlab v7.3 file into python list of numpy arrays via h5py
  24. Numpy – Replace a number with NaN
  25. Python: how to store a numpy multidimensional array in PyTables?
  26. Numpy shuffle multidimensional array by row only, keep column order unchanged
  27. Randomly select from numpy array
  28. How to “scale” a numpy array?
  29. Generate random array of floats between a range
  30. Numpy `ValueError: operands could not be broadcast together with shape …`

Leave a Comment