How do I stop a hinge joint 2d from spinning when I change the local scale?

Let me elaborate: In my game I have a player character with an object that I can spin around them uses forces and a hinge joint connected to its center. However, I use local scale to flip the character in the direction I am moving; and when I do that from one direction to another, it makes the hinge joint spin around from its bottom limit to its top limit, even though there should be no issue with it going outside the bounds. I have been struggling with coding a fix for a while, thanks to anyone who finds a solution