canvas screen space camera rotation issue

I have a canvas on a camera set to it's screen space (not as a child of the camera)

I have my camera rotate on the y and x axises but whenever I move it on the x axis (up and down) the canvas doesn't follow it's rotation and is seen from a weird perspective from where the camera rotated.

On the y axis it works fine and follows the camera.

Anyone else had this issue?