One of the “world’s first machines” capable of turning British Sign Language (BSL) into written English is set to be built by the University of Surrey as part of a project funded by the Engineering and Physical Sciences Research Council, the public research university announced.
BSL is a language in its own right, with its own grammar, and it is said to be “very different” from English. BSL is said to use several parts of the body simultaneously to fully express a range of phrases, ideas, and emotions.
The project, worth just under £1million (about $1.3 million USD), will see the Centre for Vision Speech and Signal Processing (CVSSP) at the University of Surrey develop a new system that will look to recognize not only hand motion and shape, but also the facial expression and body posture of the signer. This machine will then work out how these aspects can be put together into phrases and how these phrases can then be translated into written and spoken language.
The project is being carried out in partnership with linguists from the Deafness Cognition and Language Research Centre at University College London, and the Engineering Science team at the University of Oxford.
Richard Bowden, professor of computer vision at the University of Surrey, said: “We believe that this project will be seen as an important landmark for deaf-hearing communications—allowing the deaf community to fully participate in the digital revolution that we are all currently enjoying.
“We are passionate about sign language at CVSSP, so much so that everyone who works in this area within our lab is asked to learn how to sign.”
For more details on the project, visit: http://cvssp.org/projects/extol/
Earlier this year, Bowden’s team published a paper detailing the first AI and deep learning system that can perform end-to-end translation directly from sign language to spoken language. This paper was published at IEEE Computer Vision and Pattern Recognition in Salt Lake City, a conference for computer vision.
Source: University of Surrey
Image: University of Surrey