3d map of all colliders in scene

Hi everyone! I was wondering if anyone has a solution to this... I have previously been using barrages of raycasts in all directions to generate a 3D bitmap (rasterization) of all the colliders for certain buildings. This 3D bitmap was further compressed and then used by my game server because the server itself does not use Unity and does not contain scene information. I'm getting very frustrated because my routine isn't perfect and is proving to have fatal flaws as I play test my game. I used a round-about method to circumvent Unity's bug with RaycastAll and BoxcastAll not picking up multiple enter/exit points in a convex mesh collider. There are other issues as well. So, my question is, is there a way to just loop through my X/Y/Z ranges and check if certain points are inside any collider? OR, perhaps it would be better to loop through the building's COLLIDER list, instead, and punch out bits in my 3D bitmap of where they lie. Unfortunately, I don't know enough to do this on my own because it's not just simple box colliders that are involved. They could be any kind of collider, including mesh colliders, and in any orientation.

Please help! :) Thanks in advance!