Narrow Results

This paper describe CAILS, an experimental Computer Assisted Iconic Language System which deals with three specific areas in communication: Cross-linguistic, visual/spatial concept representation and visual educational technique. Designed for interpersonal communication, this system functions with generally comprehensible visual referents. Each area has some specific syntax which is clear and easy to learn. CAILS takes advantage of visual memory of the user. The basic idea of this system is that an individual can, using basic visual references, compose a message, represent a concept and teach a rule. The specificity of the images eliminates ambiguity. For convenience, we classified visual references or «words» in the following categories: Hands, Movements, Expression, and Pictures.

When properly use, CAILS produce « iconic message objects» which may be presented to the intended recipient

This paper presents an analysis of Filipino and Japanese students’ facial expressions and hand gestures while solving a series of computer programming exercises. Frequently occurring Facial Action Coding System (FACS) muscle movements such as the widening of the eye (AU-5) and sucking of the lip (AU-28), as well as the occurrence of hand gestures, are identified and discussed in relation to the reported affective states of engagement and confusion. We show that it is possible to build models for predicting engagement and confusion using facial expressions and typing information. We believe that this study can help in the development of affectively aware computer systems for learning programming that can work with different cultures.