How to delete rows from a csv file based on a list values from another file?

by

What about the following:

 awk -F, '(NR==FNR){a[$1];next}!($1 in a)' blacklist.csv candidates.csv

How does this work?

An awk program is a series of pattern-action pairs, written as:

condition { action }
condition { action }
...

where condition is typically an expression and action a series of commands. Here, the first condition-action pairs read:

  • (NR==FNR){a[$1];next} if the total record count NR equals the record count of the file FNR (i.e. if we are reading the first file), store all values in array a and skip to the next record (do not do anything else)
  • !($1 in a) if the first field is not in the array a then perform the default action which is print the line. This will only work on the second file as the condition of the first condition-action pair does not hold.

More Related Contents:

  1. How can I manipulate text in bash? [closed]
  2. How to merge every two lines into one from the command line?
  3. Grep output with multiple Colors?
  4. using bash (sed/awk) to extract rows AND columns in CSV files?
  5. How to grep for case insensitive string in a file?
  6. Convert 11/2/1998 to 110298 [duplicate]
  7. Some troubles with using sed and awk [closed]
  8. How can I do a recursive find/replace of a string with awk or sed?
  9. Bash tool to get nth line from a file
  10. Extraction of data from a simple XML file
  11. Remove first N lines of a file in place in unix command line
  12. How to add to the end of lines containing a pattern with sed or awk?
  13. Check if all of multiple strings or regexes exist in a file
  14. Parsing a CSV file using gawk
  15. Split CSV files into smaller files but keeping the headers?
  16. Bash: Parse CSV with quotes, commas and newlines
  17. How to remove double-quotes in jq output for parsing json files in bash?
  18. How to find/replace and increment a matched number with sed/awk?
  19. find difference between two text files with one item per line [duplicate]
  20. Using grep to search for hex strings in a file
  21. How to append a string at end of a specific line in a file in bash [duplicate]
  22. How to strip out all of the links of an HTML file in Bash or grep or batch and store them in a text file
  23. Capturing Groups From a Grep RegEx
  24. Fastest way to find lines of a file from another larger file in Bash
  25. Recursively rename files using find and sed
  26. Using sed to mass rename files
  27. Sort a text file by line length including spaces
  28. Colorized grep — viewing the entire file with highlighted matches
  29. Getting “sed error – illegal byte sequence” (in bash) [duplicate]
  30. how to delete the duplicate lines in file except the first matched line

Leave a Comment