Save / load scipy sparse csr_matrix in portable data format

by

edit: scipy 0.19 now has scipy.sparse.save_npz and scipy.sparse.load_npz.

from scipy import sparse

sparse.save_npz("yourmatrix.npz", your_matrix)
your_matrix_back = sparse.load_npz("yourmatrix.npz")

For both functions, the file argument may also be a file-like object (i.e. the result of open) instead of a filename.

Got an answer from the Scipy user group:

A csr_matrix has 3 data attributes that matter: .data, .indices, and .indptr. All are simple ndarrays, so numpy.save will work on them. Save the three arrays with numpy.save or numpy.savez, load them back with numpy.load, and then recreate the sparse matrix object with:

new_csr = csr_matrix((data, indices, indptr), shape=(M, N))

So for example:

def save_sparse_csr(filename, array):
    np.savez(filename, data=array.data, indices=array.indices,
             indptr=array.indptr, shape=array.shape)

def load_sparse_csr(filename):
    loader = np.load(filename)
    return csr_matrix((loader['data'], loader['indices'], loader['indptr']),
                      shape=loader['shape'])

More Related Contents:

  1. Computing the correlation coefficient between two multi-dimensional arrays
  2. How does condensed distance matrix work? (pdist)
  3. A tool to convert MATLAB code to Python [closed]
  4. ImportError in importing from sklearn: cannot import name check_build
  5. binning data in python with scipy/numpy
  6. Compute a confidence interval from sample data
  7. Import Error: No module named numpy
  8. calling dot products and linear algebra operations in Cython?
  9. matplotlib – extracting data from contour lines
  10. ImportError: cannot import name NUMPY_MKL
  11. Fitting a Normal distribution to 1D data
  12. Installing NumPy and SciPy on 64-bit Windows (with Pip)
  13. How to add a new row to an empty numpy array
  14. Interpolation over an irregular grid
  15. Overflow Error in Python’s numpy.exp function
  16. How can I efficiently process a numpy array in blocks similar to Matlab’s blkproc (blockproc) function
  17. How to calculate cumulative normal distribution?
  18. How do I plot list of tuples in Python?
  19. Concatenate sparse matrices in Python using SciPy/Numpy
  20. How to display progress of scipy.optimize function?
  21. Fitting a Weibull distribution using Scipy
  22. How to convert a column or row matrix to a diagonal matrix in Python?
  23. How to do a polynomial fit with fixed points
  24. How to smooth a curve for a dataset
  25. How to transform numpy.matrix or array to scipy sparse matrix
  26. Matplotlib – Finance volume overlay
  27. sparse 3d matrix/array in Python?
  28. Convert Pandas dataframe to Sparse Numpy Matrix directly
  29. Structure of inputs to scipy minimize function
  30. ValueError: Dimension mismatch

Leave a Comment