The advancement of technology in education, particularly for sign languages (SLs), can be transformative not only for learners, but also for educators. A SL teaching system that integrates explainable visual feedback and machine learning (ML) holds significant promise in enhancing the quality and effectiveness of SL teaching methodologies. This is especially crucial for training special education students, a group that plays a pivotal role in the educational journey of the Deaf and hard of hearing community.
VISTA-SL aims to protect the fundamental right of the Deaf to have access to SLs in their communication and to promote their dignity and their unique culture.
The VISTA-SL project is implemented within the Erasmus+ programme.
O1. Mitigate scarcity of SL teachers by developing teaching tools including (a) real-time visual feedback using AR and avatars, and (b) course personalization and coaching through a large-language-model based virtual instructor.
O2. Promote inclusion and diversity by developing SL curricula and games in four EU languages.
O3. Promote accessibility via an e-learning platform that includes the above tools and curricula, and is accessible at minimal cost.
O4. Disseminate and plan exploitation.
I1. Development of software for AR and avatar - based visual feedback, LLM-based virtual instructor, course personalization, and e-learning platform.
I2. Development of learning curricula and games by educators and SL- linguists in four EU languages.
I3. Six transnational managerial and technical meetings.
I4. Five multiplier events in different countries to connect with local and EU stakeholders and other dissemination actions.
I5. Training activities for educators and technical staff.
R1. Requirements analysis and design documents for SL teaching tools.
R2. Open source software tools/reports/guides for AR and avatar - based visual feedback, LLM-based virtual instructor, course personalization and e-learning platform.
R3. Open interactive learning curricula and games in 4 EU SLs, that promote inclusion and mitigate lack of SL teachers.
R4. Evaluation reports by different groups of users and stakeholders.
R5. Scientific papers, workshops, multiplier events, policy development.
In the framework of Erasmus Days we organize a day event in Athens at the National Deaf Foundation (Idrima Kofon), Zakharof 1, on the 17th of October 2025.
In this open event we are going to present the system developed so far with hands-on demonstrations, as well as the latest advancements in the field of accessibility for the Deaf community. Speakers from all over Europe will join us physically and remotely.
More Info
The Signal Processing and Communications Laboratory (SPC Lab) is a global leader in sign language technology. It has implemented the first automated museum tour guide system for the deaf (SignGuide T2EDK-00982), which offers two-way communication in sign language. It has also implemented the first publicly available automated teaching system for teaching sign languages (Erasmus+ KA203 CAT-SL), and has coordinated the HealthSign project (T1EDK-01299) where it developed an application for the automated interpretation of the Greek Sign Language with an emphasis on healthcare services.
The Hellenic Mediterranean University is highly research-oriented in every scientific field covered by its departments and its research laboratories; therefore, it is an Institute that holds a top position in university research rankings and it is recognized for its contribution in the development of the island of Crete and the country in general. The academic and research staff of the Hellenic Mediterranean University is involved in many scientific activities in collaboration with national and international research groups and teams which have led, on the one hand, to important research results and, on the other hand, to the development of technological innovations in a wide range of research areas and innovative products with international recognition.
Royal Dutch Kentalis is a merger organization established in 2009, consisting of 3 predecessors. ln 2015 Kentalis celebrated its 225th anniversary, taking the establishment of one of Kentalis predecessors as its starting point. Kentalis is a national organization in the Netherlands, specialized in providing diagnostic, care and education to persons who are deaf, hard- of-hearing or deafblind, and to those who have a language impairment. Kentalis' expertise is focused on bridging communication barriers. Kentalis Academy develops and provides Sign Language courseware and training in Sign Language to its employees as well as parents and third parties to support education in Sign Language. The training options made possible by the modules developed in the CAT-SL project are considered a valuable extension of individual training facilities for learners of Sign Language.
Universitat Pompeu Fabra was established in 1990 as a public university with a strong dedication to excellence in research and teaching. UPF is a public, international and research-intensive university that has earned a place for itself among the best universities in Europe in this period of time. The Department of Information and Communication Technologies (DTIC) of UPF initiated its activity in 1999 with undergraduate studies in Computer Science. DTIC has an important track record of active participation in EU projects (67 H2020 projects with a total budget for the department of 30 million EUR). DTIC has a large number of ERC grants (26 up-to-date), it is part of the FET Flagship Initiative The Human Brain Project. It is the only Spanish university ICT department that has been awarded a second time the Maria de Maeztu excellence by the Spanish government for the quality and relevance of its pioneering scientific research, and as the top IT research concentration in Spain.
Universität Hamburg was founded in 1919 by local citizens and is the largest institution for research and education in northern Germany. The University is known for its outstanding basic research as well as its applied and transfer research projects. As part of the Excellence Strategy of the Federal and State Governments, Universität Hamburg has been granted clusters of excellence for 4 core research areas. Furthermore, alongside 10 universities and 1 university alliance, Universität Hamburg was named a University of Excellence and was deemed a "flagship university." The Institute of German Sign Language and Communication of the Deaf (IDGS) at the Universität Hamburg is a well-known institute for sign language linguistics, sign language interpreting and deaf studies with a long tradition of sign language research in Germany. The institute professionally works on sign language corpus development due to the prestigious corpus project of German Sign Language (DGS) - DGS-Korpus - a long-term project of the Academy of Sciences and Humanities in Hamburg to build up an exhaustive data base and corpus-based dictionary of DGS.
TU Dublin (TUD), Ireland’s first Technological University, is where career-focused students, dedicated staff and academic excellence in science, the arts, business, engineering and technology converge to create the leaders of tomorrow. TU Dublin has a diverse student population, with 30,000 students from over 140 countries. The SFI ADAPT centres research vision is to pioneer new forms of proactive, scalable, and integrated AI-driven Digital Content Technology that empower individuals and society to engage in digital experiences with control, inclusion, and accountability. The Digital Content Transformation (DCT) Strand of ADAPT takes an algorithmic perspective to focus on enabling content to flow freely across different languages, cultures, and modalities. ADAPT is pioneering new Human Centric AI techniques and technologies including personalisation, natural language processing, data analytics, intelligent machine translation human- computer interaction, as well as setting the standards for data governance, privacy, and ethics for digital content.
The Deaf Studies Unit (DSU) belongs to the Department of Primary Education of the University of Patras, and is a leading center for Deaf Studies, Greek Sign language, and Deaf Education in Greece. Established in 1994, is the only academic institution in Greece that provides research in the area of deafness, and programs for teachers of the deaf, sign language tutors, and interpreters.