Enhancing Accessibility for Sign Language Users

Abstract

Language serves as a powerful tool facilitating effective communication across diverse cultures globally. However, individuals facing language barriers, such as those with hearing disabilities, encounter difficulties expressing themselves to the world [15]. The existence of multiple sign languages worldwide compounds this challenge, as the unique gestures of each language create barriers to mutual understanding. To address this, people turn to mobile applications like Handtalk, Jeenie, and ASL Pocket Sign for communication and learning due to their affordability and accessibility [1, 6, 7]. Despite their benefits, challenges persist, including limited vocabulary signs leading to feature constraints, inconsistencies in displayed content, and a lack of multimedia utilization affecting user-friendliness, effectiveness, and performance [3]. Enhancing applications for barrier-free communication and addressing gaps in existing technology, the research focuses on the challenges individuals face due to the absence of suitable communication technologies, especially for those familiar with different sign languages worldwide [6]. A thorough analysis was conducted to address the identified issues with existing applications and platforms, examining their strengths, weaknesses, and areas for improvement through competitive analysis. Innovations were devised using research papers and innovative ideas from applications to improve overall usability and effectiveness. The proposed application stands out by offering a selection of multiple sign languages, including widely used ones like ASL, BSL, FSL, etc [18]. This approach eliminates the need for users to switch between different applications, distinguishing it from some existing solutions. Prioritizing globally used sign languages further enhances inclusivity in our application [18]. Introducing a live sign language translator, inspired by technology like Slait [19], revolutionizes video calls and meetings by providing real-time sign language translation into text captions, improving communication efficiency [19]. Unlike platforms using human translators, such as Jeenie [8], the proposed solution feature ensures user privacy and cost-effectiveness. Additionally, drawing inspiration from engaging platforms like Goodreads and Duolingo, we aim to overcome content limitations in existing applications. Our platform encourages user interaction and engagement by incorporating interactive individual and group activities and gamifying the learning experience [4,8]. These implementations aim to elevate the user experience and usability of the application. The research identified significant issues and system gaps, proposing solutions based on existing features in other domains. The subsequent sections will provide detailed insights into the literature review and the process behind these advancements.