New input system doesn't recognize Oculus Rift after exiting play mode?

Hi there, I'm currently testing out the new input system with my Oculus Rift, and all works well after pressing play. However when I exit play mode and then press play again, I get this error:

 Could not create a device for 'Oculus Tracking Reference 0 (XRInputV1) (Exception: System.IndexOutOfRangeException: Index was outside the bounds of the array)

The headset is on and nothing changes about it. I have tried with my Oculus Quest + Link cable and I don't get the issue at all. Just with Rift. Any thoughts? Thanks!