Run a shell command when a file is added

by

I don’t know how people are uploading content to this folder, but you might want to use something lower-tech than monitoring the directory with inotify.

If the protocol is FTP and you have access to your FTP server’s log, I suggest tailing that log to watch for successful uploads. This sort of event-triggered approach will be faster, more reliable, and less load than a polling approach with traditional cron, and more portable and easier to debug than something using inotify.

The way you handle this will of course depend on your FTP server. I have one running vsftpd whose logs include lines like this:

Fri May 25 07:36:02 2012 [pid 94378] [joe] OK LOGIN: Client "10.8.7.16"
Fri May 25 07:36:12 2012 [pid 94380] [joe] OK UPLOAD: Client "10.8.7.16", "/path/to/file.zip", 8395136 bytes, 845.75Kbyte/sec
Fri May 25 07:36:12 2012 [pid 94380] [joe] OK CHMOD: Client "10.8.7.16", "/path/to/file.zip 644"

The UPLOAD line only gets added when vsftpd has successfully saved the file. You could parse this in a shell script like this:

#!/bin/sh

tail -F /var/log/vsftpd.log | while read line; do
  if echo "$line" | grep -q 'OK UPLOAD:'; then
    filename=$(echo "$line" | cut -d, -f2)
    if [ -s "$filename" ]; then
      # do something with $filename
    fi
  fi
done

If you’re using an HTTP upload tool, see if that tool has a text log file it uses to record incoming files. If it doesn’t consider adding some sort of logger function to it, so it’ll produce logs that you can tail.

More Related Contents:

  1. sh: 1: Syntax error: "(" unexpected error
  2. When should I wrap quotes around a shell variable?
  3. How do I write a bash script to restart a process if it dies?
  4. How do I test if a variable is a number in Bash?
  5. What does set -e mean in a bash script?
  6. How to declare 2D array in bash
  7. What does $@ mean in a shell script?
  8. Forcing bash to expand variables in a string loaded from a file
  9. Script parameters in Bash
  10. Bash script processing limited number of commands in parallel
  11. Raise error in a Bash script
  12. Avoid gnome-terminal close after script execution?
  13. How can I kill a process by name instead of PID, on Linux? [duplicate]
  14. ‘find -exec’ a shell function in Linux
  15. Managing log files created by cron jobs
  16. How to run a shell script on a Unix console or Mac terminal?
  17. How to preserve line breaks when storing command output to a variable?
  18. How to use sed to remove the last n lines of a file
  19. Use sudo without password INSIDE a script
  20. How do I run multiple background commands in bash in a single line?
  21. Round a divided number in Bash
  22. Bash: wait with timeout
  23. Multithreading in Bash [duplicate]
  24. Randomly shuffling lines in Linux / Bash
  25. Difference between shell and environment variables
  26. Replacing Control Character in sed
  27. SUID not working with shell script
  28. Linux shell script to add leading zeros to file names
  29. How to avoid race condition when using a lock-file to avoid two instances of a script running simultaneously?
  30. Need to remove the count from the output when using “uniq -c” command

Leave a Comment