How-to China: AI anchor to help the deaf community enjoy the Games more

    By Yang Cheng | chinadaily.com.cn | Updated: 2022-01-26 06:30
    Share
    Share - WeChat
    An AI TV anchor will debut at the upcoming Winter Olympics to broadcast the Games to Chinese audience with hearing difficulties on a CCTV app. [Photo provided to chinadaily.com.cn]

    Q: The country's first AI sign language anchor will serve the targeted audience during the Winter Olympics and the Winter Paralympics. The world's biggest corpus behind the AI TV anchor was created by your team. Could you explain to us the leading technologies of the database? During your research in the past six years, were there any difficulties you faced? Were there any shining moments you could share with us?

    Yuan: Let me first explain two basic technologies – the "sign language recognition" and "sign language generation" – the key points I use to explain to outsiders the technological arena.

    The "sign language generation" refers to the technology that helps generate the sign language for the audience.

    However, our technology is in the area of the sign language recognition – recognizing the sign language with the particular word order from the people with the hearing difficulties and then transforming them into the word order. 

    Here I have to stress their word order is different from us. For example, they place the predicate at the end of the sentence, while we put them in the middle of the sentence, just between the subject and the object in modern Chinese.

    For example, when those people write down some messages, their word order sometimes mislead us.

    So the AI hostess needs to express with the audience group's word orders.

    The sign language recognition and generation technologies are complementary with each other.

    We are dealing with the sign language recognition part: we process the information from the word orders of people with hearing difficulties, transfer them into ours.

    And then the sign language generation technology transfers our word order into the word order of the people with hearing difficulties; and it drives the AI anchor to show the right sign language.

    The international research circle concluded that the sign language recognition is much more difficult than the generation in various technologies involved.

    Our process includes transforming the video of the sign language movements into the text in their word order.

    We have at least three channels, namely expression, limb and hand gesture.

    We also conducted research on action recognition and the analysis of their intention. The limb has 18 points to analyze, a hand -- 21 points and a face -- more than 100 points to analyze. All those are challenging AI and algorithm.

    Many domestic and international companies hope to join the forces, but when they find sign language recognition is much more difficult than sign language generation, they retreat.

    The voice recognition is easier.

    In terms of the shining moments during the studies, I think, I really hope to express that it was the support and contributions from a great number of the people with hearing difficulties that impressed all of us.

    They provided their sign language to us to accumulate the database and the database, turning it into the world's largest and helping make it ever growing.

    As the senior prefer to use sign language more than the younger generations, who prefer to use voice recognition, they have made great contributions for us to form the database.

    When we told them that we needed to form the database, many elderly, despite of their age and health conditions, were very enthusiastic to help us to show their sign language…we have been extremely moved.

    It was the kindness and warmth from the group of the enthusiastic and kind people, who volunteered to provide their sign language in different fields, including some very nice elderly people, that enhanced our confidence and gave us strength to go ahead with the challenging studies.

    |<< Previous 1 2 3 4 5 Next   >>|
    Top
    BACK TO THE TOP
    English
    Copyright 1995 - . All rights reserved. The content (including but not limited to text, photo, multimedia information, etc) published in this site belongs to China Daily Information Co (CDIC). Without written authorization from CDIC, such content shall not be republished or used in any form. Note: Browsers with 1024*768 or higher resolution are suggested for this site.
    License for publishing multimedia online 0108263

    Registration Number: 130349
    FOLLOW US
    色综合久久综合中文综合网| 中文字幕亚洲乱码熟女一区二区| 狠狠精品久久久无码中文字幕| 狠狠躁天天躁中文字幕无码| 全球中文成人在线| 人妻丰满熟妇无码区免费 | 人妻少妇乱子伦无码视频专区 | 中文字幕亚洲码在线| 性无码专区无码片| 国产成人无码区免费内射一片色欲 | 国产成A人亚洲精V品无码性色| 亚洲一日韩欧美中文字幕欧美日韩在线精品一区二 | 波多野结衣中文在线播放| YY111111少妇无码理论片| 亚洲一区无码中文字幕| 亚洲欧美中文日韩V在线观看| 91中文在线视频| 中文字幕AV中文字无码亚| 久久久无码精品亚洲日韩软件| 日韩精品无码一区二区中文字幕| 国产AⅤ无码专区亚洲AV| 欧美成人中文字幕在线看| 暖暖日本免费中文字幕| 中文字幕人妻无码一区二区三区| YY111111少妇无码理论片| 国产V亚洲V天堂A无码| 无码AV岛国片在线播放| 亚洲AV无码成人精品区蜜桃| 一本加勒比HEZYO无码资源网 | 精品欧洲av无码一区二区| 无码一区二区三区老色鬼| 亚洲精品无码永久中文字幕| 久久AV无码精品人妻糸列| 中文字幕无码AV波多野吉衣| av无码人妻一区二区三区牛牛| 日韩人妻无码精品专区| 日韩精品无码免费专区午夜| 内射人妻少妇无码一本一道| 麻豆国产精品无码视频| 亚洲AV无码一区二区三区系列 | 少妇人妻偷人精品无码视频新浪|