Camera collision with mesh object

I'm having an issue setting up collisions between a game object with a custom mesh (terrain) and my camera. Here is the situation: I have a dynamically created mesh which represents a landscape, and a camera which can be moved. I want the camera to be able to collide with the mesh so that the camera doesn't move through the landscape.

Here is what I've done:

1. Attach a rigidbody to the GameObject (Terrain) with the custom mesh, turned off gravity.

2. Created an empty GameObject (CameraController) with a rigid body.

3. Set CameraController to the same position as the camera.

4. Set CameraController as the parent of the camera.

I figured this would work, but my camera and CameraController object still passes through the Terrain object. What have I done wrong?