Need to remove the count from the output when using “uniq -c” command

by

The count from uniq is preceded by spaces unless there are more than 7 digits in the count, so you need to do something like:

uniq -c | sort -nr | cut -c 9-

to get columns (character positions) 9 upwards. Or you can use sed:

uniq -c | sort -nr | sed 's/^.\{8\}//'

or:

uniq -c | sort -nr | sed 's/^ *[0-9]* //'

This second option is robust in the face of a repeat count of 10,000,000 or more; if you think that might be a problem, it is probably better than the cut alternative. And there are undoubtedly other options available too.

Caveat: the counts were determined by experimentation on Mac OS X 10.7.3 but using GNU uniq from coreutils 8.3. The BSD uniq -c produced 3 leading spaces before a single digit count. The POSIX spec says the output from uniq -c shall be formatted as if with:

printf("%d %s", repeat_count, line);

which would not have any leading blanks. Given this possible variance in output formats, the sed script with the [0-9] regex is the most reliable way of dealing with the variability in observed and theoretical output from uniq -c:

uniq -c | sort -nr | sed 's/^ *[0-9]* //'

More Related Contents:

  1. When should I wrap quotes around a shell variable?
  2. What’s the magic of “-” (a dash) in command-line parameters?
  3. Aborting a shell script if any command returns a non-zero value
  4. What does $@ mean in a shell script?
  5. Better way to rename files based on multiple patterns
  6. Forcing bash to expand variables in a string loaded from a file
  7. Linux: copy and create destination dir if it does not exist
  8. What is the difference between using `sh` and `source`?
  9. Setting environment variables in Linux using Bash
  10. What is the difference between “#!/usr/bin/env bash” and “#!/usr/bin/bash”?
  11. Does “argument list too long” restriction apply to shell builtins?
  12. Given two directory trees, how can I find out which files differ by content? [closed]
  13. How to sort a file in-place?
  14. How to run a shell script on a Unix console or Mac terminal?
  15. Using the passwd command from within a shell script
  16. Is it OK to use the same input file as output of a piped command?
  17. When to wrap quotes around a shell variable?
  18. How do you normalize a file path in Bash?
  19. Linux/Unix command to determine if process is running?
  20. Running shell script in parallel
  21. Difference between shell and environment variables
  22. What’s the point of eval/bash -c as opposed to just evaluating a variable?
  23. How do you run a script on login in *nix?
  24. Get exit code of a background process
  25. How to get overall CPU usage (e.g. 57%) on Linux [closed]
  26. Get last dirname/filename in a file path argument in Bash
  27. Exit code of variable assignment to command substitution in Bash
  28. Using `date` command to get previous, current and next month
  29. How to convert hex to ASCII characters in the Linux shell?
  30. What are the rules for valid identifiers (e.g. functions, vars, etc) in Bash?

Leave a Comment