Skip to main content

Home/ Becker Video Game Design/ Group items tagged multi-modal

Rss Feed Group items tagged

Garrett Eastman

GEMINI: A Generic Multi-Modal Natural Interface Framework for Videogames - 0 views

  •  
    Abstract: "In recent years videogame companies have recognized the role of player engagement as a major factor in user experience and enjoyment. This en-couraged a greater investment in new types of game controllers such as the WiiMote™, Rock Band™ instruments and the Kinect™. However, the native software of these controllers was not originally designed to be used in other game applications. This work addresses this issue by building a middleware framework, which maps body poses or voice commands to actions in any game. This not only warrants a more natural and customized user-experience but it al-so defines an interoperable virtual controller. In this version of the framework, body poses and voice commands are respectively recognized through the Ki-nect's built-in cameras and microphones. The acquired data is then translated into the native interaction scheme in real time using a lightweight method based on spatial restrictions. The system is also prepared to use Nintendo's Wiimote™ as an auxiliary and unobtrusive gamepad for physically or verbally impractical commands. System validation was performed by analyzing the per-formance of certain tasks and examining user reports. Both confirmed this ap-proach as a practical and alluring alternative to the game's native interaction scheme. In sum, this framework provides a game-controlling tool that is totally customizable and very flexible, thus expanding the market of game consumers."
Garrett Eastman

Multi S ensor I nteracti ve S ystems for Embodied Learning Games - 0 views

  •  
    Abstract: "This paper explores the use of modern sensor technologies for physical interaction on educati onal games and interactive spaces. More specifically the thesis studies the potential effect of motion capture and wearable body sensors on educational interactive games, on two aspects: i) on the involvement of human body and motion in the process of lear ning, and recall of knowledge (embodied learning), ii) on assisting the development of basic social emotional competencies, through the enhanced social affordances of embodied games. The paper presents a prototype of an educational game developed using a m otion capture controller and two bio feedback sensors, proposing a generic architecture for multi sensor interactive spaces. Finally the paper provides a review of previously studied modalities for emotion recognition, and examines their application on gam e mechanics and AI game agents."
1 - 2 of 2
Showing 20 items per page