Run an OLS regression with Pandas Data Frame

by

I think you can almost do exactly what you thought would be ideal, using the statsmodels package which was one of pandas‘ optional dependencies before pandas‘ version 0.20.0 (it was used for a few things in pandas.stats.)

>>> import pandas as pd
>>> import statsmodels.formula.api as sm
>>> df = pd.DataFrame({"A": [10,20,30,40,50], "B": [20, 30, 10, 40, 50], "C": [32, 234, 23, 23, 42523]})
>>> result = sm.ols(formula="A ~ B + C", data=df).fit()
>>> print(result.params)
Intercept    14.952480
B             0.401182
C             0.000352
dtype: float64
>>> print(result.summary())
                            OLS Regression Results                            
==============================================================================
Dep. Variable:                      A   R-squared:                       0.579
Model:                            OLS   Adj. R-squared:                  0.158
Method:                 Least Squares   F-statistic:                     1.375
Date:                Thu, 14 Nov 2013   Prob (F-statistic):              0.421
Time:                        20:04:30   Log-Likelihood:                -18.178
No. Observations:                   5   AIC:                             42.36
Df Residuals:                       2   BIC:                             41.19
Df Model:                           2                                         
==============================================================================
                 coef    std err          t      P>|t|      [95.0% Conf. Int.]
------------------------------------------------------------------------------
Intercept     14.9525     17.764      0.842      0.489       -61.481    91.386
B              0.4012      0.650      0.617      0.600        -2.394     3.197
C              0.0004      0.001      0.650      0.583        -0.002     0.003
==============================================================================
Omnibus:                          nan   Durbin-Watson:                   1.061
Prob(Omnibus):                    nan   Jarque-Bera (JB):                0.498
Skew:                          -0.123   Prob(JB):                        0.780
Kurtosis:                       1.474   Cond. No.                     5.21e+04
==============================================================================

Warnings:
[1] The condition number is large, 5.21e+04. This might indicate that there are
strong multicollinearity or other numerical problems.

More Related Contents:

  1. Fixed effect in Pandas or Statsmodels
  2. Why does the following code cant get value of n_fold = 1?
  3. Label encoding across multiple columns in scikit-learn
  4. How to one-hot-encode from a pandas column containing a list?
  5. ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject
  6. scikit-learn & statsmodels – which R-squared is correct?
  7. Find p-value (significance) in scikit-learn LinearRegression
  8. ValueError: numpy.dtype has the wrong size, try recompiling
  9. How to one hot encode variant length features?
  10. How to convert a Scikit-learn dataset to a Pandas dataset
  11. pandas dataframe columns scaling with sklearn
  12. scikit-learn cross validation, negative values with mean squared error
  13. Efficiently create sparse pivot tables in pandas?
  14. Impute categorical missing values in scikit-learn
  15. Can You Consistently Keep Track of Column Labels Using Sklearn’s Transformer API?
  16. Custom transformer for sklearn Pipeline that alters both X and y
  17. Scikit Learn OneHotEncoder fit and transform Error: ValueError: X has different shape than during fitting
  18. Time Series Analysis – unevenly spaced measures – pandas + statsmodels
  19. LabelEncoder: TypeError: ‘>’ not supported between instances of ‘float’ and ‘str’
  20. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  21. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  22. How to iterate over columns of pandas dataframe to run regression
  23. How to use sklearn fit_transform with pandas and return dataframe instead of numpy array?
  24. Stratified Sampling in Pandas
  25. Got continuous is not supported error in RandomForestRegressor
  26. How to split a dataframe string column into two columns?
  27. Comparing two dataframes and getting the differences [duplicate]
  28. How to reorder indexed rows based on a list in Pandas data frame
  29. How can I count the number of consecutive TRUEs in a DataFrame?
  30. Why apply sometimes isn’t faster than for-loop in a Pandas dataframe?

Leave a Comment