TY - GEN
T1 - ChatGPT, Let Us Chat Sign Language
T2 - 2023 International Symposium on Networks, Computers and Communications, ISNCC 2023
AU - Shahin, Nada
AU - Ismail, Leila
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - ChatGPT is a language model based on Generative AI. Existing research work on ChatGPT focused on its use in various domains. However, its potential for Sign Language Translation (SLT) is yet to be explored. This paper addresses this void. Therefore, we present GPT's evolution aiming a retrospective analysis of the improvements to its architecture for SLT. We explore ChatGPT's capabilities in translating different sign languages in paving the way to better accessibility for deaf and hard-of-hearing community. Our experimental results indicate that ChatGPT can accurately translate from English to American (ASL), Australian (AUSLAN), and British (BSL) sign languages and from Arabic Sign Language (ArSL) to English with only one prompt iteration. However, the model failed to translate from Arabic to ArSL and ASL, AUSLAN, and BSL to Arabic. Consequently, we present challenges and derive insights for future research directions.
AB - ChatGPT is a language model based on Generative AI. Existing research work on ChatGPT focused on its use in various domains. However, its potential for Sign Language Translation (SLT) is yet to be explored. This paper addresses this void. Therefore, we present GPT's evolution aiming a retrospective analysis of the improvements to its architecture for SLT. We explore ChatGPT's capabilities in translating different sign languages in paving the way to better accessibility for deaf and hard-of-hearing community. Our experimental results indicate that ChatGPT can accurately translate from English to American (ASL), Australian (AUSLAN), and British (BSL) sign languages and from Arabic Sign Language (ArSL) to English with only one prompt iteration. However, the model failed to translate from Arabic to ArSL and ASL, AUSLAN, and BSL to Arabic. Consequently, we present challenges and derive insights for future research directions.
KW - AI
KW - ChatGPT
KW - Decoder
KW - Encoder
KW - NLP
KW - Sign Language Translation
KW - Transformer
UR - http://www.scopus.com/inward/record.url?scp=85179854463&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85179854463&partnerID=8YFLogxK
U2 - 10.1109/ISNCC58260.2023.10323974
DO - 10.1109/ISNCC58260.2023.10323974
M3 - Conference contribution
AN - SCOPUS:85179854463
T3 - 2023 International Symposium on Networks, Computers and Communications, ISNCC 2023
BT - 2023 International Symposium on Networks, Computers and Communications, ISNCC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 23 October 2023 through 26 October 2023
ER -