Extract specific columns from delimited file using Awk

by

I don’t know if it’s possible to do ranges in awk. You could do a for loop, but you would have to add handling to filter out the columns you don’t want. It’s probably easier to do this:

awk -F, '{OFS=",";print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$20,$21,$22,$23,$24,$25,$30,$33}' infile.csv > outfile.csv

something else to consider – and this faster and more concise:

cut -d "," -f1-10,20-25,30-33 infile.csv > outfile.csv

As to the second part of your question, I would probably write a script in perl that knows how to handle header rows, parsing the columns names from stdin or a file and then doing the filtering. It’s probably a tool I would want to have for other things. I am not sure about doing in a one liner, although I am sure it can be done.

More Related Contents:

  1. How to delete duplicate lines in a file without sorting it in Unix
  2. Why does my tool output overwrite itself and how do I fix it?
  3. Is there a Unix utility to prepend timestamps to stdin?
  4. sed or awk: delete n lines following a pattern
  5. Print lines in one file matching patterns in another file
  6. Explain awk command
  7. Get last field using awk substr
  8. Unix:merge multiple CSV files with same header by keeping the header of the first file
  9. properly join two files based on 2 columns in common
  10. Remove line breaks in a FASTA file
  11. How to remove blank lines from a Unix file
  12. Enhancement of unix script [closed]
  13. What’s the most robust way to efficiently parse CSV using awk?
  14. Remove carriage return in Unix
  15. What does ^M character mean in Vim?
  16. Grep for literal strings
  17. Use grep –exclude/–include syntax to not grep through certain files
  18. How do I use the nohup command without getting nohup.out?
  19. How to do a mass rename?
  20. How to split CSV files as per number of rows specified?
  21. GROUP BY/SUM from shell
  22. Parsing a CSV file using gawk
  23. Why always ./configure; make; make install; as 3 separate steps?
  24. What is special about /dev/tty? [closed]
  25. unix command line execute with . (dot) vs. without
  26. How to strip leading “./” in unix “find”?
  27. Display filename before matching line
  28. grep a tab in UNIX
  29. How to pipe list of files returned by find command to cat to view all the files
  30. Differences between System V and Posix semaphores

Leave a Comment