Keep same dummy variable in training and testing data

by

You can also just get the missing columns and add them to the test dataset:

# Get missing columns in the training test
missing_cols = set( train.columns ) - set( test.columns )
# Add a missing column in test set with default value equal to 0
for c in missing_cols:
    test[c] = 0
# Ensure the order of column in the test set is in the same order than in train set
test = test[train.columns]

This code also ensure that column resulting from category in the test dataset but not present in the training dataset will be removed

More Related Contents:

  1. Why does the following code cant get value of n_fold = 1?
  2. Accuracy Score ValueError: Can’t Handle mix of binary and continuous target
  3. pandas dataframe columns scaling with sklearn
  4. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  5. Got continuous is not supported error in RandomForestRegressor
  6. How to identify and label similar rows in a pandas data frame
  7. Renaming column names in Pandas
  8. How can I use the apply() function for a single column?
  9. Filtering Pandas DataFrames on dates
  10. How can I map True/False to 1/0 in a Pandas DataFrame?
  11. Pandas select rows and columns based on boolean condition
  12. How to export a table dataframe in PySpark to csv?
  13. Changing multiple column names but not all of them – Pandas Python
  14. How to get the last N rows of a pandas DataFrame?
  15. python pandas flatten a dataframe to a list
  16. LabelEncoder for categorical features?
  17. How to create a dictionary of two pandas DataFrame columns
  18. Impute categorical missing values in scikit-learn
  19. Should I use `random.seed` or `numpy.random.seed` to control random number generation in `scikit-learn`?
  20. Can You Consistently Keep Track of Column Labels Using Sklearn’s Transformer API?
  21. AttributeError: ‘DataFrame’ object has no attribute ‘ix’
  22. What is dtype(‘O’), in pandas?
  23. Writing large Pandas Dataframes to CSV file in chunks
  24. Create Spark DataFrame. Can not infer schema for type
  25. How to merge a Series and DataFrame
  26. dataframe to dict such that one column is the key and the other is the value [duplicate]
  27. Transpose the data in a column every nth rows in PANDAS
  28. What values are valid in Pandas ‘Freq’ tags?
  29. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  30. Model help using Scikit-learn when using GridSearch

Leave a Comment