Why am I getting X. in my column names when reading a data frame?

by

read.csv() is a wrapper around the more general read.table() function. That latter function has argument check.names which is documented as:

check.names: logical.  If ‘TRUE’ then the names of the variables in the
         data frame are checked to ensure that they are syntactically
         valid variable names.  If necessary they are adjusted (by
         ‘make.names’) so that they are, and also to ensure that there
         are no duplicates.

If your header contains labels that are not syntactically valid then make.names() will replace them with a valid name, based upon the invalid name, removing invalid characters and possibly prepending X:

R> make.names("$Foo")
[1] "X.Foo"

This is documented in ?make.names:

Details:

    A syntactically valid name consists of letters, numbers and the
    dot or underline characters and starts with a letter or the dot
    not followed by a number.  Names such as ‘".2way"’ are not valid,
    and neither are the reserved words.

    The definition of a _letter_ depends on the current locale, but
    only ASCII digits are considered to be digits.

    The character ‘"X"’ is prepended if necessary.  All invalid
    characters are translated to ‘"."’.  A missing value is translated
    to ‘"NA"’.  Names which match R keywords have a dot appended to
    them.  Duplicated values are altered by ‘make.unique’.

The behaviour you are seeing is entirely consistent with the documented way read.table() loads in your data. That would suggest that you have syntactically invalid labels in the header row of your CSV file. Note the point above from ?make.names that what is a letter depends on the locale of your system; The CSV file might include a valid character that your text editor will display but if R is not running in the same locale that character may not be valid there, for example?

I would look at the CSV file and identify any non-ASCII characters in the header line; there are possibly non-visible characters (or escape sequences; \t?) in the header row also. A lot may be going on between reading in the file with the non-valid names and displaying it in the console which might be masking the non-valid characters, so don’t take the fact that it doesn’t show anything wrong without check.names as indicating that the file is OK.

Posting the output of sessionInfo() would also be useful.

More Related Contents:

  1. Specifying column names in a data.frame changes spaces to “.”
  2. Combine several data frames in the global environment by row (rbind)
  3. Quickly reading very large tables as dataframes
  4. Reshape three column data frame to matrix (“long” to “wide” format) [duplicate]
  5. Counting unique / distinct values by group in a data frame
  6. Convert a list to a data frame
  7. cbind a dataframe with an empty dataframe – cbind.fill?
  8. Split a large dataframe into a list of data frames based on common value in column
  9. Splitting a dataframe string column into multiple different columns [duplicate]
  10. Conditional replacement of values in a data.frame
  11. Convert data.frame column format from character to factor
  12. How to convert a table to a data frame
  13. How do I combine two data-frames based on two columns? [duplicate]
  14. R Apply() function on specific dataframe columns
  15. Count NAs per row in dataframe [duplicate]
  16. Add (insert) a column between two columns in a data.frame
  17. Add a prefix to column names
  18. Change value of variable with dplyr
  19. Creating a new variable from a lookup table
  20. How to initialize empty data frame (lot of columns at the same time) in R
  21. rbind data frames based on a common pattern in data frame name
  22. Read and rbind multiple csv files
  23. Count number of zeros per row, and remove rows with more than n zeros
  24. How I can select rows from a dataframe that do not match?
  25. Select last non-NA value in a row, by row
  26. Join two data frames in R based on closest timestamp
  27. How to append a whole dataframe to a CSV in R
  28. Difference between `names(df[1])
  29. How to create a new variable in a data.frame based on a condition?
  30. Interpolating timeseries

Leave a Comment