extracting unique values between 2 sets/files

by 
$ awk 'FNR==NR {a[$0]++; next} !($0 in a)' file1 file2
6
7

Explanation of how the code works:

  • If we’re working on file1, track each line of text we see.
  • If we’re working on file2, and have not seen the line text, then print it.

Explanation of details:

  • FNR is the current file’s record number
  • NR is the current overall record number from all input files
  • FNR==NR is true only when we are reading file1
  • $0 is the current line of text
  • a[$0] is a hash with the key set to the current line of text
  • a[$0]++ tracks that we’ve seen the current line of text
  • !($0 in a) is true only when we have not seen the line text
  • Print the line of text if the above pattern returns true, this is the default awk behavior when no explicit action is given

More Related Contents:

  1. How to count lines in a document? [closed]
  2. How to change the output color of echo in Linux
  3. How do I write a bash script to restart a process if it dies?
  4. How do I prompt for Yes/No/Cancel input in a Linux shell script?
  5. How does “cat
  6. The ‘eval’ command in Bash and its typical uses
  7. Fastest way to find lines of a file from another larger file in Bash
  8. Expanding a bash array only gives the first element
  9. How do I know the script file name in a Bash script?
  10. How can I quickly sum all numbers in a file?
  11. Why do you need to put #!/bin/bash at the beginning of a script file?
  12. Raise error in a Bash script
  13. How to find out line-endings in a text file?
  14. Bash script: bad interpreter
  15. Separately redirecting and recombining stderr/stdout without losing ordering
  16. Difference between ${} and $() in Bash [duplicate]
  17. Get the Perl rename utility instead of the built-in rename
  18. What does `set -x` do?
  19. Shell/Bash shortcut for bulk renaming of files in a folder
  20. Perl command line multi-line replace
  21. how to get MouseMove and MouseClick in bash?
  22. How can I run a function from a script in command line?
  23. How to run a script at a certain time on Linux? [closed]
  24. Execute command after every command in bash
  25. How do I get cURL to not show the progress bar?
  26. How do I remove newlines from a text file?
  27. How do I script a “yes” response for installing programs?
  28. How do you filter out all unique lines in a file?
  29. Counter increment in Bash loop not working
  30. How to convert hex to ASCII characters in the Linux shell?

Leave a Comment