Unlink xrefs properly when struct is deleted.