Rigidbody MoveTo considering collisions

I have a cube with collider and rigidbody on it. Rigidbody collision detection setted on “Continious Speculative” (as i need it to be for another purpose). Walls have colliders on them, and in usual conditions collision detections works ok.

So, the problem is I’m trying to move my rigidbody on fixed calculated distance at one frame (to destination point), considering collisions with colliders. After one fixed frame I disable rigidbody and object don’t move anymore. But the problem is it stops before it reach the wall. If I try to move it in this direction again, it come closer. After few attempts it reach it’s destination, but I need to do it in one frame.

Moving works ok with “Discreate” collision detection, but it’s not considering collisions.

Metod I use to move rigidbody to certain position (vector is calculated for fixed update)

public void MoveIn(Vector3 direction)
{
    this._rigidbody.velocity = (direction) / Time.fixedDeltaTime;
}

How can I solve the problem with early stopping?

Try rigidbody.addforce because modifying the velocity directly does not yield good results sometimes.