Hinge Joint not Arcing

I have a hinge joint connected to an object that can move freely and has a rigidbody with default attributes (other than movement/rotation on Z is disabled). Whenever I enable a hinge joint between it and a target location, the object doesn't arc freely, but slides back and forth as if on a spring. I don't mind the springiness but I wish to have the object behave more like a pendulum than a floating oscillating object. The hinge joint I'm using has all default characteristics except for the connected anchor, which is automatically configured.