Have players NavMeshAgent ignore Enemy NavMeshObstacle carving

Hello,

I'm building a point & click game using the Unity NavMesh for pathfinding. I've set it up so when an enemy stops to attack a player I enable the NavMeshObstacle component attached to it so that other enemies can navigate around it to also attack the player. The problem with this system is that it messes with my interaction system and the player will try to find a way around the non-moving enemy to attack it. So, is there any way for only the player to ignore the NavMeshObstacles attached to the enemies?

Thanks!