Set direction of rotation C#

Hello. i am trying to make a spin wheel that is divided to 6 sections. Each section is marked with a gameObject that is centered in that section. after the player spins the wheel, it will rotate until its starts stopping and then the wheel moves and stops in the center based on the section that was selected (Randomly). i at using the following code to rotate the wheel towards the 0 on X axis. this code works fine and the wheel rotates fine, but only if the selected section was on the positive X axis.

 float rotateFloat = (((randomReward + 1) * 60) - 30) - transform.rotation.z;
 Quaternion targetRotation = Quaternion.Euler(new Vector3(0, 0, rotateFloat));
 transform.rotation = Quaternion.RotateTowards(transform.rotation, targetRotation, f_difX * Time.deltaTime);

i did some digging and found that Quaternion.RotateTowards()finds the closest way towards the target and rotates using that direction (This caused a problem with the direction of rotation).

Example (Follow image): The player swipes and randomReward (Number 5 on spin wheel) and the wheel starts rotating when the wheel slows down, it starts moving towards the center. Then it will stop spinning along the direction of the swipe and will rotate towards the other side (Because the distance to the center is closer from the left side).

How can i set it to follow the same direction of the swipe regardless of which is closer to the center. And maybe if there is a better way to do this, please enlighten me. Thanks.