Group items tagged

There are many different factors investigated affecting students' mathematics learning before in the literature. However I had never read a research project about the instructional gestures supporting learning. It reveals that the gestures have a substantial role in comprehension. The results even shows that some studies triggers the learning even roughly twice.

This is quite interesting. I am curious to hear more about the results of this research.

An article about computerized tutoring (NYT 2012)

"Teacher gestured, pointed, made eye contact, modulated her voice." some of the missing elements in cognitive tutoring systems.

In human-interaction, 55% of affective information is carried by the body whilst 38% by the voice tone and volume, and only 7% person by the words spoken [1]. Ekman [2] further suggests that non-verbal behaviours are the primary vehicles for expressing emotion. With the availability of computational power, and great advances in the fields of computer vision and speech recognition, it is now possible to create systems that can detect facial expressions, gestures and body postures from video and audio feed. Furthermore, systems that can integrate different modalities can offer powerful and much more pleasant computer experiences as they would be embracing users' natural behaviour.

In the paper it says "According to Wolcott teachers rely on nonverbal means such as eye contact, facial expressions and body language to determine the cognitive states of students, which indicate the degree of success in the instructional transaction". I really wonder what is your opinion about it and would it be succesful to implement affect recognition (after voice-recognition) in intelligent tutoring systems.