split file on Nth occurrence of delimiter

by

Using awk you could:

awk '/^\+$/ { delim++ } { file = sprintf("chunk%s.txt", int(delim / 50000)); print >> file; }' < input.txt

Update:

To not include the delimiter, try this:

awk '/^\+$/ { if(++delim % 50000 == 0) { next } } { file = sprintf("chunk%s.txt", int(delim / 50000)); print > file; }' < input.txt

The next keyword causes awk to halt processing rules for this record and and advance to the next (line). I also changed the >> to > since if you run it more than once you probably don’t want to append the old chunk files.

More Related Contents:

  1. Why should text files end with a newline?
  2. Rename multiple files based on pattern in Unix
  3. How can I find encoding of a file via a script on Linux?
  4. How to create a custom magic file database
  5. Batch files: How to read a file?
  6. How to force Logstash to reparse a file?
  7. Changing Vim indentation behavior by file type
  8. Symfony2 file upload step by step
  9. Batch: Remove file extension
  10. How do I find files that do not contain a given string pattern?
  11. Splitting large text file into smaller text files by line numbers using Python
  12. How can I convert a file pointer ( FILE* fp ) to a file descriptor (int fd)?
  13. Powershell: Check if a file is locked
  14. batch file: list rar file in specific folder and write result into text file
  15. Has Windows 7 Fixed the 255 Character File Path Limit?
  16. character showing up in files. How to remove them?
  17. Convert DOS/Windows line endings to Linux line endings in Vim
  18. How to find the largest file in a directory and its subdirectories?
  19. Is the MIME type ‘image/jpg’ the same as ‘image/jpeg’?
  20. How to split a file into equal parts, without breaking individual lines? [duplicate]
  21. File Uri Scheme and Relative Files
  22. Download file from url, save to phones storage
  23. Print a file’s last modified date in Bash
  24. How to check if a file exists in Go?
  25. Printing the last column of a line in a file
  26. Reading a .pdb file
  27. What are the pros and cons of parquet format compared to other formats?
  28. Haskell file reading
  29. Windows 2008 R2 – Kernel (System Process PID=4) is locking files and folders
  30. Deny access to specific file types in specific directory

Leave a Comment