Efficiently counting the number of lines of a text file. (200mb+)

by

This will use less memory, since it doesn’t load the whole file into memory:

$file="largefile.txt";
$linecount = 0;
$handle = fopen($file, "r");
while(!feof($handle)){
  $line = fgets($handle);
  $linecount++;
}

fclose($handle);

echo $linecount;

fgets loads a single line into memory (if the second argument $length is omitted it will keep reading from the stream until it reaches the end of the line, which is what we want). This is still unlikely to be as quick as using something other than PHP, if you care about wall time as well as memory usage.

The only danger with this is if any lines are particularly long (what if you encounter a 2GB file without line breaks?). In which case you’re better off doing slurping it in in chunks, and counting end-of-line characters:

$file="largefile.txt";
$linecount = 0;
$handle = fopen($file, "r");
while(!feof($handle)){
  $line = fgets($handle, 4096);
  $linecount = $linecount + substr_count($line, PHP_EOL);
}

fclose($handle);

echo $linecount;

More Related Contents:

  1. Read a plain text file with php
  2. Replace string in text file using PHP
  3. How to save memory when reading a file in Php?
  4. PHP Upload fails for Video but not Image [closed]
  5. PHP create file with specific name [closed]
  6. How to force file download with PHP
  7. How to write into a file in PHP?
  8. How to extract text from the PDF document? [closed]
  9. including php file from another server with php
  10. Move_uploaded_file() function is not working
  11. PHP: Check if a file is loaded directly instead of including?
  12. Manipulate an Archive in memory with PHP (without creating a temporary file on disk)
  13. Read a file backwards line by line using fseek
  14. Save current page as HTML to server
  15. limit text length in php and provide ‘Read more’ link
  16. uploading a file in chunks using html5
  17. PHP: Read Specific Line From File
  18. How to convert text to SVG paths?
  19. Fatal error: Out of memory, but I do have plenty of memory (PHP)
  20. How can I view/open a word document in my browser using with PHP or HTML
  21. PHP move_uploaded_file() error?
  22. List and download clicked file from FTP
  23. Max file number can php upload at same time
  24. Difference between file, file_get_contents, and fopen in PHP
  25. A PHP script to let users download a file from my website without revealing the actual file link in my website?
  26. $_FILE upload large file gives error 1 even though upload_max_size is bigger than the file size
  27. Pull random line from TXT file as string
  28. Copy large files (over 2 GB) in PHP
  29. What is the difference between $_FILES[“file”][“type”] and end(explode(“.”, $_FILES[“file”][“name”])) [closed]
  30. Increasing PHP memory_limit. At what point does it become insane?

Leave a Comment