Saving Unity Texture2D updated with OpenGL FBO via custom plugin

Question

I'm currently rendering custom geometry into a Unity Texture2D on an iOS device, via a hand coded plugin using an OpenGL frame buffer attached to the Texture2D native texture ID. The updated texture is rendering as intended when running in the Unity app.

What I now want to do is save the updated Texture2D to file via EncodeToPNG() . What happens is EncodeToPNG returns a teeny weeny byte array (~5kb) that I assume only holds basic PNG format, width and height data, as when I view the PNG pulled from the device it displays in Photoshop with the correct width and height but with no pixel data i.e is empty!

Another point of interest is if I call Apply() on the texture wit$$anonymous$$n Unity it renders an empty texture in app.

These points obviously make me t$$anonymous$$nk that simply rendering to the texture in my plugin is not actually updating any pixel data that the Unity Texture2D may own, but here I come to a loss as to how to update the Texture2D.

My first thought was to call Texture2D.ReadPixels(..) but as t$$anonymous$$s is an iOS app the call I use to communicate the texture update to the Unity app from native code - UnitySendMessage - has a one frame delay and so the context is lost.

I've done a bit of investigation pulling the frame buffer data into a byte array using glReadPixels and updating the texture with t$$anonymous$$s and I have a feeling I'm just duplicating the frame buffers work in a roundabout way as that fails too..

I would be very grateful for any suggestions; especially an understanding of the relations$$anonymous$$p between the Unity Texture2D pixel data and that w$$anonymous$$ch is manipulated via OpenGL commands via the native texture ID.

Thank you!

Answer 1

Best Answer

Answer by Bork Awesome · Jan 16, 2012 at 06:56 PM

Solved!

Seems I already had the answers but couldn't see the wood for the trees; to read the frame buffer back into a Texture2D you do the following:

In plugin/native code:

 - Update frame buffer attached to Texture2D's native texture ID with
    custom goodies 
 - Stop rendering into the frame buffer
 - Call UnitySendMessage with 'script.method' to handle the update

In Unity 'script.method' called by UnitySendMessage (one frame later):

 - Call plugin method to bind the frame buffer
 - Call Texture2D.ReadPixels(new Rect(0, 0, frame buffer width, frame buffer height), 0, 0)
 - Call Texture2D.Apply()
 - Call plugin method to un-bind the frame buffer/restore previous frame buffer

Et voila! Unity Texture2D is full of the lovely new pixels and can be saved out via Texture2D.EncodeToPNG :)

Add comment · Show 4 · Share

peterept2 · Jan 26, 2013 at 11:40 PM 0

Share

Ricna · Jun 11, 2013 at 01:54 AM 0

Share

reefwirrax · Oct 29, 2013 at 07:29 AM 0

Share

slippdouglas · Jul 21, 2014 at 08:08 PM 0

Share

Answer 2

Answer by hzhamad · Oct 27, 2014 at 05:16 PM

It says in the documentation here, http://docs.unity3d.com/Manual/NativePluginInterface.html , that:

Note: The rendering callbacks to plugins are not currently supported on mobile platforms.

Add comment · Share

Saving Unity Texture2D updated with OpenGL FBO via custom plugin

2 Replies

Your answer

Welcome to Unity Answers

Follow this Question

Related Questions