Raycasthit2D detect 2 collision in one touch

there are two collider in my screen. first collider is ball’s collider and second collider is floor’s collider. The game mentality is if you touch to ball, ball destroyed and you gain scores if you touch to floor you lose and the game restart

The problem is that when i touch to ball, the ball was destroying but the game restart so the raycasthit contact floor but i don’t want that only when i touch to floor so the game restar please help me