Click here to Skip to main content
15,891,248 members
Please Sign up or sign in to vote.
5.00/5 (1 vote)
See more:
How to convert natural gestures into Audio ?
What are all the components needed?
Waiting for your reply
Pls help me
--
From
B.Thiraviaraj
thiraviaraj1990@gmail.com
III CSE,
Sudharsan engineering college
Posted
Comments
Sergey Alexandrovich Kryukov 2-Jul-11 2:06am    
The word "convert" is not appropriate. What do you want to achieve, exactly?
--SA
Thiraviaraj 2-Jul-11 2:51am    
i am planning to do a project for dumb
they speak only though actions(gestures)
its difficult for us to understand their actions
so i am planning to make a device that can translate their actions into sound :)
Sergey Alexandrovich Kryukov 3-Jul-11 2:07am    
Great plan! My 5 for the question.
I provided some answer for you, please see.
--SA
Thiraviaraj 3-Jul-11 15:52pm    
Thanks for ur reoly that was useful
after completion of this project i will show u...
Sergey Alexandrovich Kryukov 3-Jul-11 16:39pm    
If you think it makes sense please formally accept the answer (green button).
Thank you,
--SA

About natural gesture recognition: please look at this article: Hands Gesture Recognition[^]. The author, Andrew Kirillov is the author of AForge.NET (http://en.wikipedia.org/wiki/AForge.NET[^], http://www.aforgenet.com/[^]) and a very knowledgeable person, you could see his articles and ask for the advice (from the articles' pages).

I'm not sure, maybe this article may help: Finger Gesture Support for the Compact Framework[^].

Also, there are many CodeProject articles on mouse gesture recognition. (It could also be applicable in principle?) If interested, just search in CodeProject articles.

Now, the speech generation. This is relatively simple. Just use the assembly "System.Speech.dll" and the class System.Speech.Synthesis.SpeechSynthesizer, see:
http://msdn.microsoft.com/en-us/library/system.speech.synthesis.speechsynthesizer.aspx[^],
http://msdn.microsoft.com/en-us/library/system.speech.synthesis.aspx[^].

—SA
 
Share this answer
 
I would assume the components are a web cam, code to work out gestures, and then a mapping of gestures to the audio files you want to play.
 
Share this answer
 

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900