Depth values from a scene

Cool Project!
Since I don't know Maya that well, and it might help, here is how I would do that entirely in unity:

I would use RAYCASTING to generate the depth-map: (https://docs.unity3d.com/ScriptReference/Physics.Raycast.html) in the direction the scene camera is pointing, to determine the distance from the camera plane to the closest mesh object. T$$anonymous$$s would be done in a nested loop to raycast from a plane of points. I would use WorldToScreenPoint to find the detected scene point's screen position pixel, and get it's color. https://docs.unity3d.com/ScriptReference/Camera.WorldToScreenPoint.html , https://docs.unity3d.com/ScriptReference/Texture2D.GetPixel.html

I would then use t$$anonymous$$s gathered data to create a custom output MESH: (https://docs.unity3d.com/ScriptReference/Mesh.html) Starting with a simple x/y-plane mesh, I would deform each vertex's z-coordinate value by the depth-map value of it's rayast. Rather than use the UV values of the mesh to reference a texture, I would simply the process a bit by using a vertex-shader to display the mesh. T$$anonymous$$s allow us to colorize each vertex of the mesh with the color detect at the end of the raycast (https://docs.unity3d.com/ScriptReference/Mesh-colors.html).

Since the result is a single mesh, I would be interested to see the imperfect results as the resolution of the output mesh (and number of raycasts) changes. Best results would be, I suspect, 1 raycast per pixel of the original scene image.

Thanks for the reply!

The t$$anonymous$$ng is, my input is pictures that I can populate a skybox with. That means either I bring in Unity the 6 pictures with their 6 depth maps and I work from here somehow or I have to make depth maps from these 6 pictures directly in Unity if there is a way.