Read a text file in R line by line

by

You should take care with readLines(...) and big files. Reading all lines at memory can be risky. Below is a example of how to read file and process just one line at time:

processFile = function(filepath) {
  con = file(filepath, "r")
  while ( TRUE ) {
    line = readLines(con, n = 1)
    if ( length(line) == 0 ) {
      break
    }
    print(line)
  }

  close(con)
}

Understand the risk of reading a line at memory too. Big files without line breaks can fill your memory too.

More Related Contents:

  1. How to escape backslashes in R string
  2. Editing legend (text) labels in ggplot
  3. Escaping backslash (\) in string or paths in R
  4. How to source() .R file saved using UTF-8 encoding?
  5. Why and where are \n newline characters getting introduced to c()?
  6. Convert written number to number in R
  7. Reading 40 GB csv file into R using bigmemory
  8. agrep: only return best match(es)
  9. Reading two-line headers in R
  10. Moving files between folders
  11. bigrams instead of single words in termdocument matrix using R and Rweka
  12. How to make geom_text plot within the canvas’s bounds
  13. write.csv for large data.table
  14. How do I scrape / automatically download PDF files from a document search web interface in R?
  15. Override column types when importing data using readr::read_csv() when there are many columns
  16. Repeat each row of data.frame the number of times specified in a column
  17. How to get summary statistics by group
  18. How to calculate cumulative sum? [duplicate]
  19. Scatterplot with too many points
  20. Finding Overlaps between interval sets / Efficient Overlap Joins
  21. Select columns based on string match – dplyr::select
  22. Using row-wise column indices in a vector to extract values from data frame [duplicate]
  23. How can a non-imported method in a not-attached package be found by calls to functions not having it in their namespace?
  24. How to add table of contents in Rmarkdown?
  25. How to hold figure position with figure caption in pdf output of knitr?
  26. Recognize PDF table using R
  27. as.Date(as.POSIXct()) gives the wrong date?
  28. Convert scientific notation to numeric, preserving decimals
  29. Rcpp function check if missing value
  30. Give name to list variable

Leave a Comment