• Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
  • Asset Store
  • Get Unity

UNITY ACCOUNT

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account
  • Blog
  • Forums
  • Answers
  • Evangelists
  • User Groups
  • Beta Program
  • Advisory Panel

Navigation

  • Home
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
    • Blog
    • Forums
    • Answers
    • Evangelists
    • User Groups
    • Beta Program
    • Advisory Panel

Unity account

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account

Language

  • Chinese
  • Spanish
  • Japanese
  • Korean
  • Portuguese
  • Ask a question
  • Spaces
    • Default
    • Help Room
    • META
    • Moderators
    • Topics
    • Questions
    • Users
    • Badges
  • Home /
  • Help Room /
avatar image
0
Question by chilly17 · May 21, 2017 at 12:42 AM · animationavatarhumanoidspeechinteractive

interactive talking head with emotions and speech

I am a newbie to Unity, and not sure if it is the appropriate tool for this project, but I am trying to create an avatar from a photo that can speak, show emotions, and recognize / respond to speech input.

I am C# developer, and know that some of my requirements can be accomplished with Microsoft Cognitive Services (and possibly Cortana as well on Windows 10). My greater concern the selection of a tool that will allow me to seamlessly import the finished avatar into Unity, and be able to wire up its various animations and emotions and lip syncing.

Comment
Add comment
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

2 Replies

· Add your reply
  • Sort: 
avatar image
0

Answer by theANMATOR2b · May 21, 2017 at 02:05 AM

Seemless is a point of view. Shaders, lighting, and setup will still be needed for avatar import on ANY tool you end up using for your final product. Unity provides mecanim or code ability to get the animations, and lip sync setup as desired.

Unity can accomplish the task you desire, but other dedicated talking avatar tools can also accomplish this task. I've seen dedicated talking avatar tools on the market for over 10 years, in various forms of quality and complexity.
It'll be up to you to decide to use one of these tools or go with Unity which will not limit you, but require you to set up a system that works for your unique output. This is a common requirement for most game developers as well.

Comment
Add comment · Share
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image
0

Answer by chilly17 · May 21, 2017 at 11:54 AM

Thank you for your prompt response @theANMATOR2b . I have honestly not explored other 3D rendering engines as yet. My attraction to Unity is the fact that it seems to be built on Mono (like Xamarin, it is cross-platform), and provides scripting access in C#, which I imagine would allow me to dynamically manage animations, emotions, and speech input.

From the avatar creation end, I started looking at CrazyTalk 8, which seems like a good fit, but I am a little bit concerned about their product history and roadmap. I have quite a bit of learning ahead of me, so I am just trying to ensure I start out in the right direction with the correct toolset.

Comment
Add comment · Show 1 · Share
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image theANMATOR2b · May 22, 2017 at 12:35 AM 0
Share

Yeah - a lot of homework for sure. Unity fits your requirement well, however it is a blank slate so there will be a lot of 'stuff' you don't need, but will probably have to investigate. Talking avatar tools really only do exactly what you are interested in, but they are limited to the scope of the developers own purpose to serve their own customers. In this case you will be the developer of the tool within Unity as well as the customer that is creating the content.

The talking cat or dog - I have a terrible memory - Talking $$anonymous$$ essentially does the same thing, but reacts to touch - was created in Unity, along with all their other products.

Your answer

Hint: You can notify a user about this post by typing @username

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Welcome to Unity Answers

The best place to ask and answer questions about development with Unity.

To help users navigate the site we have posted a site navigation guide.

If you are a new user to Unity Answers, check out our FAQ for more information.

Make sure to check out our Knowledge Base for commonly asked Unity questions.

If you are a moderator, see our Moderator Guidelines page.

We are making improvements to UA, see the list of changes.



Follow this Question

Answers Answers and Comments

198 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Replace / Modify Humanoid Avatar during Runtime 0 Answers

Mixamo animations get weird when set to humanoid 2 Answers

Humanoid Avatar Muscle Pose Issue 1 Answer

Animations donn't get imported properly without Mesh. 1 Answer

Root motion - Animation type generic-humanoid 2 Answers


Enterprise
Social Q&A

Social
Subscribe on YouTube social-youtube Follow on LinkedIn social-linkedin Follow on Twitter social-twitter Follow on Facebook social-facebook Follow on Instagram social-instagram

Footer

  • Purchase
    • Products
    • Subscription
    • Asset Store
    • Unity Gear
    • Resellers
  • Education
    • Students
    • Educators
    • Certification
    • Learn
    • Center of Excellence
  • Download
    • Unity
    • Beta Program
  • Unity Labs
    • Labs
    • Publications
  • Resources
    • Learn platform
    • Community
    • Documentation
    • Unity QA
    • FAQ
    • Services Status
    • Connect
  • About Unity
    • About Us
    • Blog
    • Events
    • Careers
    • Contact
    • Press
    • Partners
    • Affiliates
    • Security
Copyright © 2020 Unity Technologies
  • Legal
  • Privacy Policy
  • Cookies
  • Do Not Sell My Personal Information
  • Cookies Settings
"Unity", Unity logos, and other Unity trademarks are trademarks or registered trademarks of Unity Technologies or its affiliates in the U.S. and elsewhere (more info here). Other names or brands are trademarks of their respective owners.
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Default
  • Help Room
  • META
  • Moderators
  • Explore
  • Topics
  • Questions
  • Users
  • Badges