Issue with merging multiple JSON files in Python

by

You can’t just concatenate two JSON strings to make valid JSON (or combine them by tacking ',\n' to the end of each).
Instead, you could combine the two (as Python objects) into a Python list, then use json.dump to write it to a file as JSON:

import json
import glob

result = []
for f in glob.glob("*.json"):
    with open(f, "rb") as infile:
        result.append(json.load(infile))

with open("merged_file.json", "wb") as outfile:
     json.dump(result, outfile)

If you wanted to do it without the (unnecesssary) intermediate step of parsing each JSON file, you could merge them into a list like this:

import glob

read_files = glob.glob("*.json")
with open("merged_file.json", "wb") as outfile:
    outfile.write('[{}]'.format(
        ','.join([open(f, "rb").read() for f in read_files])))

More Related Contents:

  1. How to read a single object from a json file containing multiple objects using python? [closed]
  2. How do I write JSON data to a file?
  3. How to get string objects instead of Unicode from JSON?
  4. Single vs double quotes in JSON
  5. Reading rather large JSON files [duplicate]
  6. How to JSON serialize sets?
  7. json.dumps vs flask.jsonify
  8. Python/Json:Expecting property name enclosed in double quotes
  9. Python read JSON file and modify
  10. How to get JSON from webpage into Python script
  11. Python’s json module, converts int dictionary keys to strings
  12. Django REST Framework POST nested objects
  13. Serializing a Python namedtuple to json
  14. flattening nested Json in pandas data frame
  15. Python: Trying to Deserialize Multiple JSON objects in a file with each object spanning multiple but consistently spaced number of lines
  16. How to convert to a Python datetime object with JSON.loads?
  17. Cast Flask form value to int
  18. Check if key exists and iterate the JSON array using Python
  19. Serialising an Enum member to JSON
  20. Dump to JSON adds additional double quotes and escaping of quotes
  21. How to return data in JSON format using FastAPI?
  22. Python JSON TypeError list indices must be integers or slices, not str
  23. How to send JSON as part of multipart POST-request
  24. How to create a FastAPI endpoint that can accept either Form or JSON body?
  25. Python JSON encoder to support datetime?
  26. json reading error json.decoder.JSONDecodeError: Invalid \escape
  27. Converting Flask form data to JSON only gets first value
  28. How to flatten a nested json array?
  29. Python and JSON – TypeError list indices must be integers not str
  30. How to convert csv to json in python?

Leave a Comment