Mouse and Oculus Touch Controller Inputs

I'm working on a simulation that requires input from the mouse and keyboard on the monitor view, and touch inputs from the Oculus Touch controllers in VR.

The problem is, if I have the canvas in ScreenSpace render mode, the mouse input works- but the Oculus view can't see it.

If the canvas is in WorldSpace view, the Oculus Touch controllers can see and interact, and the monitor can see- but won't interact with the mouse inputs.

So I tried creating two UI's. On in ScreenSpace for the monitor, and one in WorldSpace for the Oculus. It almost works, except at this point only one canvas can be acted upon. So the oculus won't interact with the WorldSpace UI.

The idea is that same UI is show in both the monitor and the Oculus, and both can interact with it. Sometimes the person at the monitor will want to click something to better help the person using the Oculus. And other times the person at the monitor needs to be hands off and let the person with the Oculus be the driver.

Any help would be great. Thanks!