You’re being mislead by output — the second approach you’re taking actually does what you want, you just aren’t believing it. 🙂
>>> foo = 'baz "\\"'
>>> foo
'baz "\\"'
>>> print(foo)
baz "\"
Incidentally, there’s another string form which might be a bit clearer:
>>> print(r'baz "\"')
baz "\"