How can you read a CSV file in R with different number of columns

by

Deep in the ?read.table documentation there is the following:

The number of data columns is determined by looking at the first five
lines of input (or the whole file if it has less than five lines), or
from the length of col.names if it is specified and is longer. This
could conceivably be wrong if fill or blank.lines.skip are true, so
specify col.names if necessary (as in the ‘Examples’).

Therefore, let’s define col.names to be length X (where X is the max number of fields in your dataset), and set fill = TRUE:

dat <- textConnection("12223, University
12227, bridge, Sky
12828, Sunset
13801, Ground
14853, Tranceamerica
14854, San Francisco
15595, shibuya, Shrine
16126, fog, San Francisco
16520, California, ocean, summer, golden gate, beach, San Francisco")

read.table(dat, header = FALSE, sep = ",", 
  col.names = paste0("V",seq_len(7)), fill = TRUE)

     V1             V2             V3      V4           V5     V6             V7
1 12223     University                                                          
2 12227         bridge            Sky                                           
3 12828         Sunset                                                          
4 13801         Ground                                                          
5 14853  Tranceamerica                                                          
6 14854  San Francisco                                                          
7 15595        shibuya         Shrine                                           
8 16126            fog  San Francisco                                           
9 16520     California          ocean  summer  golden gate  beach  San Francisco

If the maximum number of fields is unknown, you can use the nifty utility function count.fields (which I found in the read.table example code):

count.fields(dat, sep = ',')
# [1] 2 3 2 2 2 2 3 3 7
max(count.fields(dat, sep = ','))
# [1] 7

Possibly helpful related reading: Only read limited number of columns in R

More Related Contents:

  1. read.csv warning ‘EOF within quoted string’ prevents complete reading of file
  2. How do I import a CSV file in R? [closed]
  3. How to avoid: read.table truncates numeric values beginning with 0
  4. Reading multiple csv files from a folder into a single dataframe in R [duplicate]
  5. How to check if CSV file has a comma or a semicolon as separator?
  6. Issue when importing dataset: `Error in scan(…): line 1 did not have 145 elements`
  7. Preserving large numbers
  8. Trying to merge multiple csv files in R
  9. Reading a CSV file organized horizontally
  10. Importing “csv” file with multiple-character separator to R?
  11. how to use loop to subset 1000 csv files and do co-integration test in R?
  12. Quickly reading very large tables as dataframes
  13. Read multiple CSV files into separate data frames
  14. Subset of rows containing NA (missing) values in a chosen column of a data frame
  15. Prevent row names to be written to file when using write.csv
  16. Delete “” from csv values and change column names when writing to a CSV
  17. Download a file from HTTPS using download.file()
  18. How to index an element of a list object in R
  19. Read and rbind multiple csv files
  20. Cannot read unicode .csv into R
  21. How to read csv file in R where some values contain the percent symbol (%)
  22. write.csv for large data.table
  23. Is it possible to get the number of rows in a CSV file without opening it?
  24. How can I read the header but also skip lines – read.table()?
  25. How to append a whole dataframe to a CSV in R
  26. Using R to download zipped data file, extract, and import .csv
  27. Calculate the mean of one column from several CSV files
  28. Correct number of decimal places reading in a .csv
  29. How to read specific rows of CSV file with fread function
  30. Override column types when importing data using readr::read_csv() when there are many columns

Leave a Comment