Animation Layer Weight Issue

I have two animation layers, one for my body and one for my arms.

I want to deactivate the one on my arms and then rotate them manually when a button is pressed.

However, when I set the layer weight to 0 it still stops me from moving the objects as they are still technically being animated.

Does anyone know a solution to this?

You can use LateUpdate() instead of Update() for already animated objects. That way, your script can make changes after the Animator has done its thing.