Finding and counting the frequency of known pairs of words in multiple files [closed]

by

When using combinations() you are getting all pairs, even the non-adjacent ones. You can create a function that will return the adjacent pairs. I’ve tried the following code and it worked, maybe it can give you some insight:

import os
import re
from collections import Counter

def pairs(text):
    ans = re.findall(r'[A-Za-z]+', text)
    return (tuple(ans[i:i+2]) for i in xrange(len(ans)-1))

mypairs = tuple([ tuple(line.split()[-2:]) for line in open('results.txt')])

c = Counter()
folderpath="path/to/directory"
for dirpath, dnames, fnames in os.walk(folderpath):
    for f in fnames:
        if not '.txt' in f: continue
        for line in open(os.path.join(dirpath, f)):
            c += Counter(p for p in pairs(line) if p in mypairs)

for item in c.most_common():
    print item

More Related Contents:

  1. How to handle special cases in my Python code?
  2. Convert bytes to a string
  3. How can I concatenate str and int objects?
  4. Which is the preferred way to concatenate a string in Python?
  5. TypeError: not all arguments converted during string formatting python
  6. String formatting in Python 3
  7. Find column whose name contains a specific string
  8. Pandas Extract Number from String
  9. How to convert ‘binary string’ to normal string in Python3?
  10. Extract Number from String in Python
  11. Why are str.count(”) and len(str) giving different output?
  12. Python – difference between two strings
  13. Most pythonic way to interleave two strings
  14. Removing control characters from a string in python
  15. Count number of words per row
  16. How to explain the str.maketrans function in Python 3.6?
  17. What is a clean way to convert a string percent to a float?
  18. How can I split a string of a mathematical expressions in python?
  19. Why do numbers in a string become “x0n” when a backslash precedes them?
  20. can only concatenate str (not “bytes”) to str
  21. What’s the difference between str.isdigit(), isnumeric() and isdecimal() in Python?
  22. Print without b’ prefix for bytes in Python 3
  23. “TypeError: a bytes-like object is required, not ‘str'” when handling file content in Python 3
  24. How can I use f-string with a variable, not with a string literal?
  25. String-based enum in Python
  26. Deleting consonants from a string in Python
  27. What is internal representation of string in Python 3.x
  28. Finding the position of a word in a string
  29. Why are str.count(”) and len(str) giving different outputs when used on an empty string?
  30. Convert bytes to a string in python 3

Leave a Comment