What is the way data is stored in *.npy?

by

The npy file format is documented in numpy’s NEP 1 — A Simple File Format for NumPy Arrays.

For instance, the code 

>>> dt=numpy.dtype([('outer','(3,)<i4'),
...                 ('outer2',[('inner','(10,)<i4'),('inner2','f8')])])
>>> a=numpy.array([((1,2,3),((10,11,12,13,14,15,16,17,18,19),3.14)),
...                ((4,5,6),((-1,-2,-3,-4,-5,-6,-7,-8,-9,-20),6.28))],dt)
>>> numpy.save('1.npy', a)

results in the file:

93 4E 55 4D 50 59                      magic ("\x93NUMPY")
01                                     major version (1)
00                                     minor version (0)

96 00                                  HEADER_LEN (0x0096 = 150)
7B 27 64 65 73 63 72 27 
3A 20 5B 28 27 6F 75 74 
65 72 27 2C 20 27 3C 69 
34 27 2C 20 28 33 2C 29 
29 2C 20 28 27 6F 75 74 
65 72 32 27 2C 20 5B 28 
27 69 6E 6E 65 72 27 2C 
20 27 3C 69 34 27 2C 20 
28 31 30 2C 29 29 2C 20 
28 27 69 6E 6E 65 72 32                Header, describing the data structure
27 2C 20 27 3C 66 38 27                "{'descr': [('outer', '<i4', (3,)),
29 5D 29 5D 2C 20 27 66                            ('outer2', [
6F 72 74 72 61 6E 5F 6F                               ('inner', '<i4', (10,)), 
72 64 65 72 27 3A 20 46                               ('inner2', '<f8')]
61 6C 73 65 2C 20 27 73                            )],
68 61 70 65 27 3A 20 28                  'fortran_order': False,
32 2C 29 2C 20 7D 20 20                  'shape': (2,), }"
20 20 20 20 20 20 20 20 
20 20 20 20 20 0A 

01 00 00 00 02 00 00 00 03 00 00 00    (1,2,3)
0A 00 00 00 0B 00 00 00 0C 00 00 00
0D 00 00 00 0E 00 00 00 0F 00 00 00
10 00 00 00 11 00 00 00 12 00 00 00
13 00 00 00                            (10,11,12,13,14,15,16,17,18,19)
1F 85 EB 51 B8 1E 09 40                3.14

04 00 00 00 05 00 00 00 06 00 00 00    (4,5,6)
FF FF FF FF FE FF FF FF FD FF FF FF
FC FF FF FF FB FF FF FF FA FF FF FF
F9 FF FF FF F8 FF FF FF F7 FF FF FF 
EC FF FF FF                            (-1,-2,-3,-4,-5,-6,-7,-8,-9,-20)
1F 85 EB 51 B8 1E 19 40                6.28

More Related Contents:

  1. Simple Digit Recognition OCR in OpenCV-Python
  2. surface plots in matplotlib
  3. How to install python modules without root access?
  4. Histogram Matplotlib
  5. float64 with pandas to_csv
  6. Fastest way to grow a numpy numeric array
  7. How to check BLAS/LAPACK linkage in NumPy and SciPy?
  8. Pandas finding local max and min
  9. How to find first non-zero value in every column of a numpy array?
  10. Convert NumPy array to Python list
  11. Saving to hdf5 is very slow (Python freezing)
  12. numpy array dtype is coming as int32 by default in a windows 10 64 bit machine
  13. How do I install SciPy on 64 bit Windows?
  14. Removing duplicate columns and rows from a NumPy 2D array
  15. Numpy: efficient way to generate combinations from given ranges
  16. Why is `np.sum(range(N))` very slow?
  17. How to fix ‘numpy.ndarray’ object has no attribute ‘get_figure’ when plotting subplots
  18. deleting rows in numpy array
  19. Make distutils look for numpy header files in the correct place
  20. LogisticRegression: Unknown label type: ‘continuous’ using sklearn in python
  21. Python: slicing a multi-dimensional array
  22. Concat DataFrame Reindexing only valid with uniquely valued Index objects
  23. Load just part of an image in python
  24. convert a grayscale image to a 3-channel image [duplicate]
  25. Convert numpy array to tuple
  26. What does “ValueError: object too deep for desired array” mean and how to fix it?
  27. Store numpy.array in cells of a Pandas.DataFrame
  28. Resample time series in pandas to a weekly interval
  29. numpy.sum() giving strange results on large arrays
  30. Avoid overflow when adding numpy arrays

Leave a Comment