UDC 004.93’11
A MULTIMODAL SYSTEM FOR AUDIOVISUAL DECISION SUPPORT FOR VISUALLY IMPAIRED USERS
I. P. Burukina, Ph.D., Associate Professor, Head of CAD Department, PSU, Penza, Russia;
orcid.org/0009-0006-1953-2914, e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
G. O. Feldman, Bachelor, PSU, Penza, Russia; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
D. A. Grishaev, Bachelor, PSU, Penza, Russia; e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
The work is devoted to solving the problem of spatial orientation of persons with visual impairment. The aim of the research is to develop a multimodal system that combines image segmentation algorithms and neural network methods to transform visual signals into a detailed audio representation of surrounding space. The system has successfully passed comprehensive technical testing, showing high functional and op erational characteristics. The main advantages are high accuracy of object recognition, reliable distance detection, quick response and low power consumption. The research plays an important role in the develop ment of domestic rehabilitation technologies aimed at ensuring accessibility of infrastructure and increasing the independence of people with visual impairment.
Key words: system, visual impairment, segmentation, neural network, spatial orientation, testing, efficiency.