Odd Point Light Shadows

So I have a scene made up of multiple blocks. Every 4 meters is a new block/wall however due to there being no space between the blocks makes the scene look like that it's made up of large blocks. However I found that the Point Light was reaching into walled of areas.

In the screenshot above you can see a transparent wall. I made that wall material transparent so that you can see that there is a light in the other room however the light it still reaching the blue room through the wall despite the fact that there is a wall in between (the transparent wall does have shadows enabled). The light has hard shadows enabled.