Recovering features names of explained_variance_ratio_ in PCA with sklearn

by

This information is included in the pca attribute: components_. As described in the documentation, pca.components_ outputs an array of [n_components, n_features], so to get how components are linearly related with the different features you have to:

Note: each coefficient represents the correlation between a particular pair of component and feature

import pandas as pd
import pylab as pl
from sklearn import datasets
from sklearn.decomposition import PCA

# load dataset
iris = datasets.load_iris()
df = pd.DataFrame(iris.data, columns=iris.feature_names)

# normalize data
from sklearn import preprocessing
data_scaled = pd.DataFrame(preprocessing.scale(df),columns = df.columns) 

# PCA
pca = PCA(n_components=2)
pca.fit_transform(data_scaled)

# Dump components relations with features:
print(pd.DataFrame(pca.components_,columns=data_scaled.columns,index = ['PC-1','PC-2']))

      sepal length (cm)  sepal width (cm)  petal length (cm)  petal width (cm)
PC-1           0.522372         -0.263355           0.581254          0.565611
PC-2          -0.372318         -0.925556          -0.021095         -0.065416

IMPORTANT: As a side comment, note the PCA sign does not affect its interpretation since the sign does not affect the variance contained in each component. Only the relative signs of features forming the PCA dimension are important. In fact, if you run the PCA code again, you might get the PCA dimensions with the signs inverted. For an intuition about this, think about a vector and its negative in 3-D space – both are essentially representing the same direction in space.
Check this post for further reference.

More Related Contents:

  1. Feature/Variable importance after a PCA analysis
  2. How to extract the decision rules from scikit-learn decision-tree?
  3. scikit-learn & statsmodels – which R-squared is correct?
  4. Save classifier to disk in scikit-learn
  5. Principal Component Analysis (PCA) in Python
  6. How to get most informative features for scikit-learn classifiers?
  7. Why is Random Forest with a single tree much better than a Decision Tree classifier?
  8. How to get precision, recall and f-measure from confusion matrix in Python [duplicate]
  9. Custom transformer for sklearn Pipeline that alters both X and y
  10. What is exactly sklearn.pipeline.Pipeline?
  11. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  12. Save MinMaxScaler model in sklearn
  13. confusion matrix error “Classification metrics can’t handle a mix of multilabel-indicator and multiclass targets”
  14. Scikit-learn: How to obtain True Positive, True Negative, False Positive and False Negative
  15. Can anyone explain me StandardScaler?
  16. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  17. How to find the importance of the features for a logistic regression model?
  18. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  19. scikit-learn random state in splitting dataset
  20. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  21. scikit-learn: how to scale back the ‘y’ predicted result
  22. Tensorflow Precision / Recall / F1 score and Confusion matrix
  23. confused about random_state in decision tree of scikit learn
  24. In sklearn.decomposition.PCA, why are components_ negative?
  25. Can I send callbacks to a KerasClassifier?
  26. How to get most informative features for scikit-learn classifier for different class?
  27. Model help using Scikit-learn when using GridSearch
  28. Does the SVM in sklearn support incremental (online) learning?
  29. Determining the most contributing features for SVM classifier in sklearn
  30. scikit-learn .predict() default threshold

Leave a Comment