How to display progress of scipy.optimize function?

by

As mg007 suggested, some of the scipy.optimize routines allow for a callback function (unfortunately leastsq does not permit this at the moment). Below is an example using the “fmin_bfgs” routine where I use a callback function to display the current value of the arguments and the value of the objective function at each iteration.

import numpy as np
from scipy.optimize import fmin_bfgs

Nfeval = 1

def rosen(X): #Rosenbrock function
    return (1.0 - X[0])**2 + 100.0 * (X[1] - X[0]**2)**2 + \
           (1.0 - X[1])**2 + 100.0 * (X[2] - X[1]**2)**2

def callbackF(Xi):
    global Nfeval
    print '{0:4d}   {1: 3.6f}   {2: 3.6f}   {3: 3.6f}   {4: 3.6f}'.format(Nfeval, Xi[0], Xi[1], Xi[2], rosen(Xi))
    Nfeval += 1

print  '{0:4s}   {1:9s}   {2:9s}   {3:9s}   {4:9s}'.format('Iter', ' X1', ' X2', ' X3', 'f(X)')   
x0 = np.array([1.1, 1.1, 1.1], dtype=np.double)
[xopt, fopt, gopt, Bopt, func_calls, grad_calls, warnflg] = \
    fmin_bfgs(rosen, 
              x0, 
              callback=callbackF, 
              maxiter=2000, 
              full_output=True, 
              retall=False)

The output looks like this:

Iter    X1          X2          X3         f(X)      
   1    1.031582    1.062553    1.130971    0.005550
   2    1.031100    1.063194    1.130732    0.004973
   3    1.027805    1.055917    1.114717    0.003927
   4    1.020343    1.040319    1.081299    0.002193
   5    1.005098    1.009236    1.016252    0.000739
   6    1.004867    1.009274    1.017836    0.000197
   7    1.001201    1.002372    1.004708    0.000007
   8    1.000124    1.000249    1.000483    0.000000
   9    0.999999    0.999999    0.999998    0.000000
  10    0.999997    0.999995    0.999989    0.000000
  11    0.999997    0.999995    0.999989    0.000000
Optimization terminated successfully.
         Current function value: 0.000000
         Iterations: 11
         Function evaluations: 85
         Gradient evaluations: 17

At least this way you can watch as the optimizer tracks the minimum

More Related Contents:

  1. How do I read CSV data into a record array in NumPy?
  2. Working with big data in python and numpy, not enough ram, how to save partial results on disc?
  3. Python out of memory on large CSV file (numpy)
  4. Histogram Matplotlib
  5. python numpy/scipy curve fitting
  6. Multiple linear regression in Python
  7. Plotting a fast Fourier transform in Python
  8. How to create a density plot in matplotlib?
  9. How to do n-D distance and nearest neighbor calculations on numpy arrays
  10. matplotlib – extracting data from contour lines
  11. Fitting a Normal distribution to 1D data
  12. Populate a Pandas SparseDataFrame from a SciPy Sparse Matrix
  13. Installing NumPy and SciPy on 64-bit Windows (with Pip)
  14. How to extend an array in-place in Numpy?
  15. How do I install SciPy on 64 bit Windows?
  16. Interpolation over an irregular grid
  17. fitting exponential decay with no initial guessing
  18. Overflow Error in Python’s numpy.exp function
  19. How to plot line (polygonal chain) with numpy/scipy/matplotlib with minimal smoothing
  20. Storing numpy sparse matrix in HDF5 (PyTables)
  21. How can I efficiently process a numpy array in blocks similar to Matlab’s blkproc (blockproc) function
  22. How do I plot list of tuples in Python?
  23. generalized cumulative functions in NumPy/SciPy?
  24. Fit plane to a set of points in 3D: scipy.optimize.minimize vs scipy.linalg.lstsq
  25. Principal component analysis in Python
  26. Parse a Pandas column to Datetime when importing table from SQL database and filtering rows by date
  27. Numpy transpose of 1D array not giving expected result
  28. Fit mixture of two gaussian/normal distributions to a histogram from one set of data, python
  29. Computing cross-correlation function?
  30. Speedup scipy griddata for multiple interpolations between two irregular grids

Leave a Comment