混合實境音樂互動系統
摘要
本論文將微軟Kinect感應器與投影機結合，並融入國小音樂課程，建立一個具有音樂教育功能的混合實境互動桌。系統提供四個模式：彈奏模式、創作模式、五線譜模式、娛樂模式。(1)彈奏模式模擬十六種類型樂器的真實彈奏方式（共128種音色），供使用者彈奏。(2)創作模式提供八種曲風的爵士鼓節奏以及三十二種和弦，讓使用者很容易地認識節奏與和弦並能創作出配樂。(3)五線譜模式會檢驗樂理規則，讓使用者在五線譜上擺放音符的同時，學會樂理、認識拍號、音符與休止符、五線譜位置等，而系統還能紀錄使用者所寫下的曲子。(4)娛樂模式提供128種樂器音色給使用者選擇，讓使用者化身為音樂家，隨意彈奏就能演奏出以該樂器為主奏之名曲，並藉此認識樂器音色與曲目。 　　而本系統實際應用在國小音樂課，證實了這樣的互動學習方式確實能夠提昇學習成效，以及學生對於自身學習動機、班級學習氣氛等感受，且不論是親自操作系統，或是在一旁協助他人操作皆有效果。甚至原本對音樂無興趣者，在經過音樂互動桌的學習後，不但考試成績進步，對於音樂課的喜愛程度、學習的成就感、上課專心程度都有所提昇。

關鍵字：深度攝影機、人機互動、混合實境互動桌、投影觸控、國小音樂課程

Mixed-Reality Music Interactive System
Abstract
Combined a Microsoft Kinect sensor and a projector, we design an interactive table for elementary music education using mixed-reality technology. The interactive table provides 4 modes, inclusive of playing mode, composing mode, staff mode, and entertainment mode. In playing mode, the system simulates 128 kinds of musical instruments that offer users to play different kinds of instruments with the projected keyboard and to absorb the knowledge of these instruments. In composing mode, the system provides 8 rhythms and 32 chords that help users compose easily. In staff mode, the system automatically verifies the accuracy of music theory while users put musical notes on the staff so that users can learn the concept of staff, time signature, and musical alphabet. Besides, users can record staves and the system would merge them as a song. In entertainment mode, users can choose from 128 kinds of musical instruments and play a beautiful song with the virtual keyboard as if they themselves are famous musician. After those elementary school students take music classes using our system, we prove that it definitely can help students improve their grades no matter if they manipulate themselves or just assist others aside. Besides, it helps students improve their motivation, concentration, and sense of achievement as well even for those who have no interests in music classes.

Keywords : Depth camera, human-computer interaction, interactive table for mixed-reality learning environment, touch screen interface, elementary music education