Parsing apache log files

by

This is a job for regular expressions.

For example:

line="172.16.0.3 - - [25/Sep/2002:14:04:19 +0200] "GET / HTTP/1.1" 401 - "" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.1) Gecko/20020827""
regex = '([(\d\.)]+) - - \[(.*?)\] "(.*?)" (\d+) - "(.*?)" "(.*?)"'

import re
print re.match(regex, line).groups()

The output would be a tuple with 6 pieces of information from the line (specifically, the groups within parentheses in that pattern):

('172.16.0.3', '25/Sep/2002:14:04:19 +0200', 'GET / HTTP/1.1', '401', '', 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.1) Gecko/20020827')

More Related Contents:

  1. Create or open file in python [closed]
  2. Find all files in a directory with extension .txt in Python
  3. Lazy Method for Reading Big File in Python?
  4. Reading binary file and looping over each byte
  5. open() gives FileNotFoundError/IOError: Errno 2 No such file or directory
  6. How to open a file for both reading and writing?
  7. Print string to text file
  8. Python recursive folder read
  9. Read file from line 2 or skip header row
  10. How might I remove duplicate lines from a file?
  11. Writing a list to a file with Python, with newlines
  12. Difference between parsing a text file in r and rb mode
  13. File read using “open()” vs “with open()” [duplicate]
  14. How do I create an incrementing filename in Python?
  15. Inline CSV File Editing with Python
  16. Python write to a file returns empty file
  17. Python Pandas: How to read only first n rows of CSV files in?
  18. How to safely open/close files in python 2.4
  19. Python not recognising directories os.path.isdir() [duplicate]
  20. Reading a file with a specified delimiter for newline
  21. How to read a single character at a time from a file in Python?
  22. How to read lines from a file in python starting from the end
  23. Undo a file readline() operation so file-pointer is back in original state
  24. Write file with specific permissions in Python
  25. Is it possible to get writing access to raw devices using python with windows?
  26. pickle.load() raising EOFError in Windows
  27. Treat binary data as a file object?
  28. Change file to read-only mode in Python
  29. Unicode encoding for filesystem in Mac OS X not correct in Python?
  30. Mixing read() and write() on Python files in Windows

Leave a Comment