How to create a dirt cleaning effect on a 3d object?

I'm making a game where you spray water at an object and it should clean the dirt off but i can't find a way to remove the dirt texture only where the cleaning action is happening

I'm currently raycasting from the cleaning jet and create particles at the location it hits so i have the info of where in the object it should change the texture just don't know how to do it