Beyond Words: Understanding the Art of Lip Reading in Multimodal Communication

Abstract

Speech recognition from lip movement is fascinating and challenging research area that has garnered substantial interest in recent times. The ability to recognize speech from lip movement has many potential applications, such as aiding those with hearing impairments and enhancing speech recognition in video conferencing systems and / or in noisy environments. The purpose of this survey is to present a comprehensive summary of the latest cutting-edge techniques of speech recognition from lip movement. It will cover various approaches used in this field, including deep learning-based methods, traditional machine-learning techniques, and hybrid approaches. The paper will also explore the existing datasets, which can be valuable resources for researchers in their future work. Overall, the survey can be beneficial for researchers who are interested in the field of speech recognition using lip movement.