Closing Visual Studio While viewing Script Crashes Unity / Unity Not Responding

So if I open a script from the Unity UI, it will open it in visual studio. Unity will remain working fine. However, as soon as I close the visual Studio instance looking at the script, Unity will freeze, and the task manager on Windows states that it is "not responding". I then have to force kill Unity. Any leads on why this is happening or if anyone else have had this issue?