• Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
  • Asset Store
  • Get Unity

UNITY ACCOUNT

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account
  • Blog
  • Forums
  • Answers
  • Evangelists
  • User Groups
  • Beta Program
  • Advisory Panel

Navigation

  • Home
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
    • Blog
    • Forums
    • Answers
    • Evangelists
    • User Groups
    • Beta Program
    • Advisory Panel

Unity account

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account

Language

  • Chinese
  • Spanish
  • Japanese
  • Korean
  • Portuguese
  • Ask a question
  • Spaces
    • Default
    • Help Room
    • META
    • Moderators
    • Topics
    • Questions
    • Users
    • Badges
  • Home /
avatar image
Question by enio_orqafpv · Jul 23, 2021 at 02:36 PM · streamingstreamlibrarieslive

Decode H.264 stream and display in Unity

I'm trying to do raw decoding of H.264 stream, whose packages I'm getting from an active UDP connection those are groups of 4 packages which are making an buffer which is representing one video frame. I don't know much about H.264 decoding but I'm trying to have input which is accepting mentioned buffer from UDP connection, decoding it and applying it to the texture inside Unity.

I tried following things: - Vive Media Decoder asset (https://assetstore.unity.com/packages/tools/video/vive-media-decoder-63938), it's doing great job while working with protocols like rtmp, rtsp etc. but for raw decoding from incoming buffer can't do much as it's wrapped around ffmpeg and other decoding tools - C written H.264 decoder (https://github.com/shengbinmeng/ffmpeg-h264-dec), depends on many libav libraries which I'm unable to track and adjust and later than convert into .dll which will be accessible from C# inside Unity - C++ written H.264 decoder (https://www.roxlu.com/2014/039/decoding-h264-and-yuv420p-playback), similar as above I'm getting compile time errors for unkown functions which again depends on libav/ffmpeg libraries - C# written H.264 decoder (https://github.com/pansk/cscodec), seems to be working with url's but still not sure if I could send buffer direct to it and not sure how to include whole visual studio c# project into unity project and make it work - Also I have looked at https://github.com/Ruslan-B/FFmpeg.AutoGen but was unable to find a way to solve my problem

Basiclly, what I'm looking for is an written .dll (C/C++ program) file which is accepting H.264 encoded frames (buffers) and returning RGB array, which is used and called inside Unity project.

Comment

People who like this

0 Show 2
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image ShaneReynolds · Sep 28, 2021 at 03:04 PM 0
Share

@enio_orqafpv - Did you ever get this figured out? I am trying the same thing. Any info would be appreciated. Thanks

avatar image ZeoWorks · Nov 01, 2021 at 03:15 PM 0
Share

Also need a solution thanks

0 Replies

  • Sort: 

Unity Answers is in Read-Only mode

Unity Answers content will be migrated to a new Community platform and we are aiming to launch a public beta by June 9. Please note, Unity Answers is now in read-only so we can prepare for the final data migration.

For more information and updates, please read our full announcement thread in the Unity Forum.

Follow this Question

Answers Answers and Comments

126 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

360 cam live streaming questions 0 Answers

Unable to stream Assetbundles from web... 1 Answer

Would it be possible to write an ONVIF Profile S plugin - Give Unity app ability to control IP network PTZ cameras? 1 Answer

Streaming data (point cloud ) to Unity? 4 Answers

Send live camera from Unity game play to youtube or vimeo 2 Answers


Enterprise
Social Q&A

Social
Subscribe on YouTube social-youtube Follow on LinkedIn social-linkedin Follow on Twitter social-twitter Follow on Facebook social-facebook Follow on Instagram social-instagram

Footer

  • Purchase
    • Products
    • Subscription
    • Asset Store
    • Unity Gear
    • Resellers
  • Education
    • Students
    • Educators
    • Certification
    • Learn
    • Center of Excellence
  • Download
    • Unity
    • Beta Program
  • Unity Labs
    • Labs
    • Publications
  • Resources
    • Learn platform
    • Community
    • Documentation
    • Unity QA
    • FAQ
    • Services Status
    • Connect
  • About Unity
    • About Us
    • Blog
    • Events
    • Careers
    • Contact
    • Press
    • Partners
    • Affiliates
    • Security
Copyright © 2020 Unity Technologies
  • Legal
  • Privacy Policy
  • Cookies
  • Do Not Sell My Personal Information
  • Cookies Settings
"Unity", Unity logos, and other Unity trademarks are trademarks or registered trademarks of Unity Technologies or its affiliates in the U.S. and elsewhere (more info here). Other names or brands are trademarks of their respective owners.
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Default
  • Help Room
  • META
  • Moderators
  • Explore
  • Topics
  • Questions
  • Users
  • Badges