Pandas update sql

by

Consider a temp table which would be exact replica of your final table, cleaned out with each run:

engine = create_engine('postgresql+psycopg2://user:pswd@mydb')
df.to_sql('temp_table', engine, if_exists="replace")

sql = """
    UPDATE final_table AS f
    SET col1 = t.col1
    FROM temp_table AS t
    WHERE f.id = t.id
"""

with engine.begin() as conn:     # TRANSACTION
    conn.execute(sql)

More Related Contents:

  1. How to write DataFrame to postgres table
  2. How to upsert pandas DataFrame to PostgreSQL table?
  3. How do I make a function in python which takes a list of integers as an input and outputs smaller lists with only two values?
  4. Convert columns into rows with Pandas
  5. Pandas – How to flatten a hierarchical index in columns
  6. How to replace NaN values by Zeroes in a column of a Pandas Dataframe?
  7. Custom sorting in pandas dataframe
  8. How to pass another entire column as argument to pandas fillna()
  9. What rules does Pandas use to generate a view vs a copy?
  10. Change one value based on another value in pandas
  11. Pandas read_sql with parameters
  12. Sorting columns in pandas dataframe based on column name [duplicate]
  13. Pandas ‘count(distinct)’ equivalent
  14. What is the performance impact of non-unique indexes in pandas?
  15. What is the difference between using loc and using just square brackets to filter for columns in Pandas/Python?
  16. Executing multiple statements with Postgresql via SQLAlchemy does not persist changes
  17. pandas groupby, then sort within groups
  18. Pandas: Cast column to string does not work
  19. How to query MultiIndex index columns values in pandas
  20. Add multiple empty columns to pandas DataFrame
  21. multi index plotting
  22. No numeric types to aggregate – change in groupby() behaviour?
  23. OSError: Initializing from file failed on csv in Pandas
  24. Pandas in AWS lambda gives numpy error
  25. Pandas: Reading Excel with merged cells
  26. Pandas groupby with categories with redundant nan
  27. Datetime conversion – How to extract the inferred format?
  28. Python numpy: cannot convert datetime64[ns] to datetime64[D] (to use with Numba)
  29. Slicing multiple ranges of columns in Pandas, by list of names
  30. SQLAlchemy func.count on boolean column

Leave a Comment