以影像為基礎之重度身障者人機介面
摘要
本篇論文主要是提供一套以影像為基礎的低價位溝通輔具系統,讓不
同症狀的身障者都能夠操作系統,與家人或是朋友溝通,並且控制家中電
器。本系統的硬體只需要一台低價位的視訊攝影機以及一台個人電腦。
本論文的溝通輔具系統主要提供7 個日常生活中常用到的功能,分別
為語音溝通板、中英文輸入、家電控制、遠端協助、影音娛樂、瀏覽網際
網路以及傳送訊息。另外還有暫停與離開的選項。本系統主要提供三種溝
通介面。當身障者的手臂能夠動作時,可以利用手臂的動作來操作系統。
當身障者可以自主地控制嘴唇,可以利用嘴唇開闔來操作系統。當身障者
罹患重度疾病,像是腦性麻痺患者或是漸凍人,可以利用眨眼的方式來操
作系統。不同症狀的身障者可以選擇適用於自己的點選方式來操作本論文
提出的溝通輔具系統。
實驗結果顯示,使用眼動點選、唇動點選以及大動作點選等不同的方
式,都有九成以上的正確率。
關鍵字:人機介面、溝通輔具、眨眼溝通、漸凍人。

 

 

Imaged-Based Human Computer Interfaces for People with Severe Disabilities
Abstract
This paper presents an implementation of a low-cost image-based
communication aid system which allows people with disabilities to use their
limited voluntary motions to communicate with family and friends, access
computers, and control TV and air conditioner, etc. The system consists of only
one low-cost web camera and a personal computer.
The communication aid dichotomizes daily living necessities into 7 groups
(e.g., Voiced Messages, Typing, Home Appliance Control, Help, A/V
Entertainments, Web Surfing, Messages). In addition to the seven selections,
Suspend and Exit, are another two available options. The system provides users
with three kinds of operational interfaces to operate the communication aid. First
of all, people who still are able to control their arms can operate the system via
the movements of their arms. Secondly, for people who still can voluntarily open
and close their mouths, the system can be operated via the open and the closure
of the mouth. Thirdly, for people with severe disabilities, an extreme disability
such as severe cerebral palsy or amyotrophic lateral sclerosis, the system can be
operated via eye blinks. People with different kinds of disabilities can choose an
appropriate operational interface from the aforementioned three interfaces to
operate the communication aid.
Experimental results show that the performance of the proposed
communication aid is very encouraging.
Keywords: Human Computer Interface, Communication Aid, Eye-Blink
Communication, Amyotrophic Lateral Sclerosis.