To be on the safe side, you can add a git attribute
(see here for an example) for those private files.
That way, you can define a script (a “merge manager”) which will ensure the file including private informations will remain empty (or with a public content) if merged on the public branch, while keeping its local content if merged to the private branch.
It means you can merge/rebase without thinking about that file.