A Next-Generation Assistive Human–Computer Interaction System Using Eye-Head Control and Blink Gesture Recognition

Abstract

Assistive HCI systems enable people with physical limitations to access a computer without the conventional means of entering data. The new system, as outlined in this paper, involves the use of a normal webcam to offer an easy way of operating a computer. It achieves this with its face recognition feature, which scans the user's facial characteristics, including the mouth and nose, as an alternative to using fingers. The system would recognise the user's face, allowing the user to give commands to operate the computer. There is also an option to perform mouse-related tasks by identifying deliberate eye blinks; as a result, the user has a simple way to enter a command without difficulty. The proposed computer vision system is designed to be fast-acting to allow real-time interaction and will not require any special hardware beyond a standard webcam, making it a cheap and accessible alternative for interacting with their computer.