In the end my workaround was to execute remove() of the previous fragment and add() the new one. Although that’s what replace() method was meant to do.
But I am still guessing why replace() method didn’t work properly in this case. It is really weird and I want to discard that it is because I am misunderstanding something or doing something wrong.