rocky-mountain-NEGATIVE

Expected results

As a result of the implementation of the scientific research on the project, new knowledge will be acquired in the field of technical and social sciences. The implementation of the activities set out in the work packages will lead to summary, analysis and promotion of the global experience and the experience of the members of the team on the subject, and the tasks set out in WP5 will allow scientists, for the first time in Bulgaria, to examine how structured game scenarios influence the virtual and mixed reality in children and adolescents with different CD for perception and cognition through action and experience in a protected environment. The activities in WP3 and WP4 will allow improvement of the functionality of the robotic technologies used so far and experimentation with new ones. The activities in WP6 and WP7 will allow research of approaches to creation of a Methodology and a Pilot Platform for integration of AT for speech therapy with an ergonomic model for its use. If successful results of these activities are observed, the team will offer a globally significant scientific achievement for the benefit of speech therapists - independently to combine AT and design game scenarios to improve communication skills and social adaptability of children and adolescents. In addition, a new prototype of a low-cost socially assistive robot will be developed for the needs of speech therapy. Another expected innovation is generation of human-like speech in the Platform via a generative pre-trained transformer (GPT), which will allow development of the functionality of assistive robots to understand, generate and speak text. New methods for quantitative assessment of the behaviour of children and adolescents with CD in physical and virtual space will be developed. It is expected that the development of the Methodology and protocols for scientific experimental research, instructions and informed consent to it, prepared by the project team and reviewed and approved by the Ethical Commission of SWU, can be used in the future as a methodology for design of robotic and virtual structured game scenarios in speech therapy.

In general, the quantity and quality of scientific research related to problems of regional and national importance for speech therapy will be increased, the connection of science with inclusive education, state authorities and society as a whole will be intensified. The development of knowledge and skills from early childhood will be stimulated with a focus on exact sciences and competences in using information systems and technologies. The number of researchers working in the field of artificial intelligence will increase. The digital transformation in the education system will be accelerated trough introducing online content and creating online platforms for providing digital learning resources for personalized learning. The capacity of the Competence Centre "Intelligent Mechatronic, Eco- and Energy-Saving Systems and Technologies" under the Operational Programme "Science and Education for Smart Growth" will be used.
Specifically, the project will contribute to increasing the quality of early childhood education and care in Bulgaria, as well as to establishing appropriate structures for speech therapy in the absence of a speech therapist or a need for telepresence in each kindergarten/school. Innovative research on the application of social robots in speech therapy for children with speech and language disorders took great interest by parents and the speech therapy community. They were covered in detail in the media - in two programmes on BNT2 - Znanie.BG, one programme on Nova TV, on BNT radio, on social media and on a number of Internet news websites. We will continue and expand the research in this area, as we have scientifically proven that children with CD are more motivated and practice their speech and language skills more effectively via socially assistive robots. Wishes of the parents42 of children with CD for more frequent speech therapy intervention enhanced through social robots, which they can partially use at home, will also be satisfied. Applying other innovative methodologies for serious games for the purpose of speech therapy and rehabilitation in a family environment, the parents of these children will have the opportunity to be co-therapists and to be guided remotely by the speech therapists. Telepresence of speech therapy sessions enhanced via robots and virtual reality in speech therapy and resource centers or school speech therapy rooms will ensure the rights of children with CD for sustainable development of their speech and language skills, as well as their social and civic competences. Engaging children from early childhood in structured play scenarios with assistive technologies will foster their awareness of the potential of innovative technologies in education and life in general. They will be introduced to new forms of human-machine interface, working in augmented reality and using AI. The foundations of using cloud services for speech/text understanding, human-like text generation and speaking will be laid. The use of this educational technological environment in early childhood will lay the foundation for later success in life regarding education and social adjustment of children with CD. 
It is expected that through speech therapy tools based on robotic systems and augmented reality with AI elements, the practice of social communication with other people and patterns of behavior in everyday life in a protected environment will be transferred to real life.

The project is large-scale and extremely multidisciplinary, which leads to a very high potential for scientific development of the team, and the experimental research with the innovative technologies planned for purchase will lead to an increase in the qualifications of the team members. The scientific achievements of the team in thematic areas will be further developed in an innovative way through research on new types of socially assistive robots, virtual and mixed reality, new technologies for quantitative assessment of non-verbal social cues and the use of large-scale models for NLP. The digital competences of speech therapy students and teachers to design speech therapy scenarios and to quantitatively evaluate therapy efficacy will be enhanced.

As a result of the team's participation in high-level international conferences, the assigned tasks are expected to be reported and discussed, which will lead to better results and establishing contacts with specialists in the field. Within the framework of the project, the scientific potential of the IR will be increased and career growth linked to the results of the scientific activity will be ensured for two associate professors, two doctoral students and one postdoctoral fellow. The educational and scientific potential of IR and ULSIT for robot programming and virtual modelling, using AI for speech processing and analysis, knowledge and use of visual programming, etc. will be increased. Specific knowledge and skills will be acquired and they will be oriented towards ethical principles for analyzing, assessing the impact and making sense of the legal and ethical aspects when using AI. Career growth will be provided for one postdoctoral fellow and two associate professors from ULSIT. The educational and scientific potential of SWU for training students and doctoral students regarding the use of assistive technologies in speech therapy will be increased. Career development will be provided for two postdoctoral fellows, two associate professors and two PhD students from SWU.
Innovative methodology for integration of assistive technologies in speech therapy for children and adolescents
КП-06-Н67/1 / 12.12.2022 
With the financial support of the Scientific Research Fund
Image