How to get the part of a file after the first line that matches a regular expression

by

The following will print the line matching TERMINATE till the end of the file:

sed -n -e '/TERMINATE/,$p'

Explained: -n disables default behavior of sed of printing each line after executing its script on it, -e indicated a script to sed, /TERMINATE/,$ is an address (line) range selection meaning the first line matching the TERMINATE regular expression (like grep) to the end of the file ($), and p is the print command which prints the current line.

This will print from the line that follows the line matching TERMINATE till the end of the file:
(from AFTER the matching line to EOF, NOT including the matching line)

sed -e '1,/TERMINATE/d'

Explained: 1,/TERMINATE/ is an address (line) range selection meaning the first line for the input to the 1st line matching the TERMINATE regular expression, and d is the delete command which delete the current line and skip to the next line. As sed default behavior is to print the lines, it will print the lines after TERMINATE to the end of input.

If you want the lines before TERMINATE:

sed -e '/TERMINATE/,$d'

And if you want both lines before and after TERMINATE in two different files in a single pass:

sed -e '1,/TERMINATE/w before
/TERMINATE/,$w after' file

The before and after files will contain the line with terminate, so to process each you need to use:

head -n -1 before
tail -n +2 after

IF you do not want to hard code the filenames in the sed script, you can:

before=before.txt
after=after.txt
sed -e "1,/TERMINATE/w $before
/TERMINATE/,\$w $after" file

But then you have to escape the $ meaning the last line so the shell will not try to expand the $w variable (note that we now use double quotes around the script instead of single quotes).

I forgot to tell that the new line is important after the filenames in the script so that sed knows that the filenames end.

How would you replace the hardcoded TERMINATE by a variable?

You would make a variable for the matching text and then do it the same way as the previous example:

matchtext=TERMINATE
before=before.txt
after=after.txt
sed -e "1,/$matchtext/w $before
/$matchtext/,\$w $after" file

to use a variable for the matching text with the previous examples:

## Print the line containing the matching text, till the end of the file:
## (from the matching line to EOF, including the matching line)
matchtext=TERMINATE
sed -n -e "/$matchtext/,\$p"

## Print from the line that follows the line containing the
## matching text, till the end of the file:
## (from AFTER the matching line to EOF, NOT including the matching line)
matchtext=TERMINATE
sed -e "1,/$matchtext/d"

## Print all the lines before the line containing the matching text:
## (from line-1 to BEFORE the matching line, NOT including the matching line)
matchtext=TERMINATE
sed -e "/$matchtext/,\$d"

The important points about replacing text with variables in these cases are:

  1. Variables ($variablename) enclosed in single quotes ['] won’t “expand” but variables inside double quotes ["] will. So, you have to change all the single quotes to double quotes if they contain text you want to replace with a variable.
  2. The sed ranges also contain a $ and are immediately followed by a letter like: $p, $d, $w. They will also look like variables to be expanded, so you have to escape those $ characters with a backslash [\] like: \$p, \$d, \$w.

More Related Contents:

  1. How do I split a string on a delimiter in Bash?
  2. Correct Bash and shell script variable capitalization
  3. How to urlencode data for curl command?
  4. Why equal to operator does not work if it is surrounded by space?
  5. sudo echo “something” >> /etc/privilegedFile doesn’t work [duplicate]
  6. How can I declare and use Boolean variables in a shell script?
  7. Test for non-zero length string in Bash: [ -n “$var” ] or [ “$var” ]
  8. Capturing Groups From a Grep RegEx
  9. How can I suppress all output from a command using Bash?
  10. Random number from a range in a Bash Script
  11. How to get a password from a shell script without echoing
  12. How to process each output line in a loop?
  13. Checking if output of a command contains a certain string in a shell script
  14. Colorized grep — viewing the entire file with highlighted matches
  15. Copy folder recursively, excluding some folders
  16. How to check if a file contains a specific string using Bash
  17. Piping tail output though grep twice
  18. Passing arguments by reference
  19. Get just the filename from a path in a Bash script [duplicate]
  20. How to resolve symbolic links in a shell script
  21. Waiting for background processes to finish before exiting script
  22. Why equal to operator does not work if it is not surrounded by space?
  23. Extract version number from a string
  24. How to tell if a string is not defined in a Bash shell script
  25. Is there a way to avoid positional arguments in bash?
  26. How to strip out all of the links of an HTML file in Bash or grep or batch and store them in a text file
  27. How to grep for case insensitive string in a file?
  28. What does `kill -0 $pid` in a shell script do?
  29. How to append output to the end of a text file
  30. In bash, is there an equivalent of die “error msg”

Leave a Comment