print unique lines based on field

by

You put your test for “seen” in the action part of the script instead of the condition part. Change it to:

awk -F, '!seen[$1]++' Input.csv

Yes, that’s the whole script:

$ cat Input.csv
10,15-10-2014,abc
20,12-10-2014,bcd
10,09-10-2014,def
40,06-10-2014,ghi
10,15-10-2014,abc
$
$ awk -F, '!seen[$1]++' Input.csv
10,15-10-2014,abc
20,12-10-2014,bcd
40,06-10-2014,ghi

More Related Contents:

  1. How do you delete all lines that contain no letters from the alphabet using either grep, sed, or awk? [closed]
  2. substitute words on a line only before first delimeter using sed or awk
  3. Printing with sed or awk a line following a matching pattern
  4. What are NR and FNR and what does “NR==FNR” imply?
  5. How do I find the text that matches a pattern?
  6. Escaping separator within double quotes, in awk
  7. Is a /start/,/end/ range expression ever useful in awk?
  8. Can we use shell variables in awk?
  9. Summing values of a column using awk command
  10. Using multiple delimiters in awk
  11. Print all but the first three columns
  12. Using AWK to Process Input from Multiple Files
  13. Assigning system command’s output to variable
  14. Why does “1” in awk print the current line?
  15. How to split a delimited string into an array in awk?
  16. How to escape a single quote inside awk
  17. Random numbers generation with awk in BASH shell
  18. How to show only next line after the matched one?
  19. Print second-to-last column/field in `awk`
  20. How can I make awk not use scientific notation when printing small values?
  21. ignorecase in AWK
  22. Using awk to pull specific lines from a file
  23. get the user input in awk
  24. How to preserve the original whitespace between fields in awk?
  25. Awk – replace coumn 2 in table 1 from coumn 2 in table 2 based on matching data in column 1 (common between tables)
  26. Save modifications in place with awk
  27. How can I shuffle the lines of a text file on the Unix command line or in a shell script?
  28. Can awk patterns match multiple lines?
  29. How to use awk variables in regular expressions?
  30. How to get the PID of a process in a pipeline

Leave a Comment