You can mitigate this error without having to change your data or remove duplicates. Just create a new index with DataFrame.reset_index:
df = df.reset_index()
The old index is kept as a column in your dataframe, but if you don’t need it you can do:
df = df.reset_index(drop=True)
Some prefer:
df.reset_index(inplace=True, drop=True)