how to use a regular expression to extract json fields?

by 
/"(url|title|tags)":"((\\"|[^"])*)"/i

I think this is what you’re asking for. I’ll provide an explanation momentarily. This regular expression (delimited by / – you probably won’t have to put those in editpad) matches:

"

A literal ".

(url|title|tags)

Any of the three literal strings “url”, “title” or “tags” – in Regular Expressions, by default Parentheses are used to create groups, and the pipe character is used to alternate – like a logical ‘or’. To match these literal characters, you’d have to escape them.

":"

Another literal string.

(

The beginning of another group. (Group 2)

    (

Another group (3)

        \\"

The literal string \" – you have to escape the backslash because otherwise it will be interpreted as escaping the next character, and you never know what that’ll do.

        |

or…

        [^"]

Any single character except a double quote The brackets denote a Character Class/Set, or a list of characters to match. Any given class matches exactly one character in the string. Using a carat (^) at the beginning of a class negates it, causing the matcher to match anything that’s not contained in the class.

    )

End of group 3…

    *

The asterisk causes the previous regular expression (in this case, group 3), to be repeated zero or more times, In this case causing the matcher to match anything that could be inside the double quotes of a JSON string.

)"

The end of group 2, and a literal ".

I’ve done a few non-obvious things here, that may come in handy:

  1. Group 2 – when dereferenced using Backreferences – will be the actual string assigned to the field. This is useful when getting the actual value.
  2. The i at the end of the expression makes it case insensitive.
  3. Group 1 contains the name of the captured field.

EDIT: So I see that the tags are an array. I’ll update the regular expression here in a second when I’ve had a chance to think about it.

Your new Regex is:

/"(url|title|tags)":("(\\"|[^"])*"|\[("(\\"|[^"])*"(,"(\\"|[^"])*")*)?\])/i

All I’ve done here is alternate the string regular expression I had been using ("((\\"|[^"])*)"), with a regular expression for finding arrays (\[("(\\"|[^"])*"(,"(\\"|[^"])*")*)?\]). No so easy to Read, is it? Well, substituting our String Regex out for the letter S, we can rewrite it as:

\[(S(,S)*)?\]

Which matches a literal opening bracket (hence the backslashes), optionally followed by a comma separated list of strings, and a closing bracket. The only new concept I’ve introduced here is the question mark (?), which is itself a type of repetition. Commonly referred to as ‘making the previous expression optional’, it can also be thought of as exactly 0 or 1 matches.

With our same S Notation, here’s the whole dirty Regular Expression:

/"(url|title|tags)":(S|\[(S(,S)*)?\])/i

If it helps to see it in action, here’s a view of it in action.

More Related Contents:

  1. Regex to validate JSON
  2. Replace single backslash in R
  3. What flavor of Regex does Visual Studio Code use?
  4. Jmeter extracting fields/parsing JSON response
  5. powershell: how to escape all regex characters from a string
  6. Regular expression search replace in Sublime Text 2
  7. Remove duplicates from text file based on second text file
  8. How do I perform a Perl substitution on a string while keeping the original?
  9. Replace a word with multiple lines using sed?
  10. How to search and replace with a counter-based expression in Vim?
  11. Eclipse, regular expression search and replace
  12. Eliminate newlines in google app script using regex
  13. What’s the best tool to find and replace regular expressions over multiple files?
  14. How to replace only part of found text?
  15. Regular expression to remove special characters in JSTL tags
  16. How to use different separators (/ , |) in a regular expression
  17. bash regex with quotes?
  18. Regular expression to match any character being repeated more than 10 times
  19. Parsing scientific notation sensibly?
  20. Why is a character class faster than alternation?
  21. Mail::RFC822::Address Regex
  22. Regular Expressions- Match Anything
  23. What is the Regular Expression For “Not Whitespace and Not a hyphen”
  24. Mass string replace in python?
  25. Split a string on whitespace in Go?
  26. Grammatical inference of regular expressions for given finite list of representative strings?
  27. Regex with replace in Golang
  28. Regex empty string or email
  29. extract number after specific string
  30. Extracting text after last period in string [duplicate]

Leave a Comment