Suppose there is a self. I have to ask why such a (spiritual) self exists in a (physical) body rather than without a body.
The memories of a self is always memories of an embodied self and none other. The thought of an identity without a body is always done from within a body. No experience is out-of-body. Sometimes it is seemingly out-of-body but seemingly-out-of-body is not the same as out-of-body.