Sign language Recognition Problem

Question

5.00/5 (1 vote)

See more:

VS2010

Hi,i am an undergraduate student and our group hope to do a research on sign language Recognition area.In there we have a problem of breaking down a sentence into words which is shown by a deaf student.

ex: He goes to school

we want to track above sentence word by word.but the problem is they show the next sign soon after the current sign is finished.

Below link shows an example.

http://www.start-american-sign-language.com/free-sign-language-asl1.html[^]

Any Suggestions?

Posted 5-Jan-13 1:58am

Dilan Shaminda

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

BupeChombaDerrick · Answer 1 · 2013-01-09T22:42:00

Solution 1

Is there any specific spatial and temporal pattern for a single word?if the answer is yes, then just train your system on those smaller patterns which you have to identify manually during the training phase, but it also seems that sign language appears continuous, static recognition of gestures in sign language might not be a good choice, I suggest using a combination of spatial and temporal classification methods, probably using a kinetic sensor.

So have you started the implementation yet? That's an interesting project.

Hope this helps. :)

Posted 9-Jan-13 22:42pm

BupeChombaDerrick

Comments

Dilan Shaminda 10-Jan-13 12:25pm

Hi,thanks for your reply :-) ...you are correct sign language appears continuously..that is the difficulty there...can you plz explain me how do i use the kinect sensor for spatial and temporal classification methods...because we are still doing background study for this research...we have to start our implementation by next month...Thank you again for your reply... :)

BupeChombaDerrick 10-Jan-13 15:04pm

You can use openCV to access kinetic RGB-D image,where D = depth, so I was assuming that using the depth map or channel can help in segmenting out the human from the background and then you can train neural networks on specific spatial and temporal signals from the segmented training examples. I have not done much of neural networks with temporal pattern recognition but maybe these two links below can help you with the kinetic sensor and openCv and spatial and temporal pattern recognition respectively.

http://opencv.willowgarage.com/wiki/Kinect

http://www.bu.edu/asllrp/stp.pdf

Dilan Shaminda 11-Jan-13 11:36am

Thank you very much....it is so helpful :-)

BupeChombaDerrick 12-Jan-13 4:08am

You are welcome. :-)