A new sign language translation platform, based on artificial intelligence (AI) has been introduced by the leading AI cloud provider, Baidu AI. Live interpretation of sign language and the generation of digital avatars can be done quickly using the new platform. The platform was launched as an addition to its digital avatar platform, XiLing, helps deaf-and hard-of-hearing (DHH) community by enabling the automated sign language translation.

Two all-in-one AI sign language translators were also added to the platform, providing one-stop solutions with a faster set-up procedure and plug-and-play capabilities. The translators were designed to be used in a variety of settings that allow for large-scale public service deployment.

Tian Wu, Vice President of Baidu Corporate added that “With the technology enablement brought by AI, the production and operational costs of digital avatars have been reduced to a significant degree, making it possible for AI sign language to go scale and serve more deaf and hard-of-hearing individuals.”

This large gap experienced by hearing disabled community is filled by the XiLing AI sign language platform and all-in-one sign language translators. The technology can be quickly integrated into regularly used mobile applications for DHH people who wish to learn or interact online without obstacles. Several functions such as sign language video and livestream synthesis, and sign language to text and audio translations are available in platform.

The all-in-one translators are available in a full offline version (V3) and a cloud-connected version (P3), which is designed to enhance public service accessibility. The platform provides enormous support to the DHH community through core features like ASR speech recognition, speech translation, and portrait rendering. The DHH community will be able to travel, work, and go out to restaurants independently using this platform.