Determining tangible user interfaces in teaching matching skills to children with autism



Children with Autism, Product Design, Tangible User Interface, Tablet Computer, Matching Skills


One of the primary deficiencies in children with autism is the ability of symbolic thinking. For overcoming difficulties in understanding abstract concepts, recognizing the similarities and differences between objects, comprehending the whole and its parts, completing the missing pieces in a pattern, are the first skills necessary to be taught. In our present day, tablet computers are among the important accessible technologies in education and training. The study aims to focus on the supporting qualities and design criteria of tangible user interfaces (TUI) for practising matching skills, one of the basic skills that children with autism should acquire. Popularizing tablet computers in various teaching activities of children with autism is important in researches. As a methodology, a literature review was conducted to synthesize and summarize the results of studies on this subject. Regarding this, an evaluation of the supportive qualities of using devices with tangible interfaces and their components in teaching matching skills, one of the basic skills that children with autism should acquire in the preschool period, is presented in regard to user experience. First, the contribution of technological tools in teaching various skills to children with autism was evaluated. The qualities of the devices with TUI, the tablet computers in the context of accessible technology and the accompanying tangible widgets that would contribute teaching matching skills to children with autism were examined and the design criteria of these products have been revealed.


Allahyar, M., Hunt E. (2003). The assessment of spatial orientation using virtual reality techniques. International Journal of Testing, 3(3), 263-275.

Amerikan Psikiyatri Birliği. (1994). Mental bozuklukların tanısal ve sayımsal el kitabı (4. baskı) (DSM-IV) (E. Köroğlu, Çev.). Hekimler Yayın Birliği.

Battocchi, A., Gal, E., Sasson, B., Pianesi, F., Venuti, P., Zancanaro, M. ve Weiss, P. L. (2008). Collaborative puzzle game: an interface for studying collaboration and social ınteraction for children who are typically developed or who have autistic spectrum disorder. P. Sharkey, P. Lopes-dos-Santos, P. L. (T.) Weiss ve T. Brooks (Ed.), 7th International Conference on Disability, Virtual Reality and Associated Technologies, with ArtAbilitation (ICDVRAT 2008) içinde (s. 127-134). Maia, Portekiz.

Bauminger, N., Goren-Bar, D., Gal, E., Weiss, P. L., Yifat, R., Kupersmitt, J., Pianesi, F. (2007). Enhancing social communication in high-functioning children with autism through a co-located ınterface. 2007 IEEE 9th Workshop on Multimedia Signal Processing içinde (s. 18-21), Chania, Yunanistan.

Bernard-Opitz, V., Sriram, N. ve Nakhoda-Sapuan S. (2001). Enhancing social problem solving in children with autism and normal children through computer-assisted ınstruction. Journal of Autism and Developmental Disorders, 31, 377–384.

Bock, M., Fisker, M., Topp, K. F., Kraus, M. (2014). Initial exploration of the use of specific tangible widgets for tablet games. L. M. Aiello, D. McFarland (Ed.), International conference on social informatics içinde (s. 183-190). Springer, Cham.

Bock, M., Fisker, M., Topp, K. F., Kraus, M. (2015). Tangible widgets for a multiplayer tablet game in comparison to finger touch. CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play içinde (s. 755-758). Association for Computing Machinery.

Bonneh Y. S. , Belmonte M. K. ,Pei F. , … Merzenich M. M. (2008). Cross-modal extinction in a boy with severely autistic behaviour and high verbal intelligence. Cognitive Neuropsychology, 25(5), 635-652.

Bosseler, A. ve Massaro, D. W. (2003). Development and evaluation of a computer-animated tutor for vocabulary and language learning for children with autism. Journal of Autism and Developmental Disorders 33(6), 653-672.

Boyd, D., Bee, H. (2009). Lifespan development (5. Baskı). Pearson International Edition.

Broussard, R., Fazzio, S., Kang, S. C., Francisco-Revilla, L. (2012). A computer activity to encourage facial expression recognition for children with autism spectrum disorders. iConference '12: Proceedings of the 2012 iConference içinde (s. 478-479). Association for Computing Machinery.

Bruner, J. S. (1973). Organization of early skilled action. Child Development, 44. 92-96.

Burns, N., Grove, S. K. (2009). The practice of nursing research: appraisal, synthesis, and generation of evidence (6th ed.). Saunders.

Camargo, M. C., Carvalho, T. C. P., Barros, R. M., Barros, V. T. O., Santana, M. (2019). Improving Usability of a Mobile Application for Children with Autism Spectrum Disorder Using Heuristic Evaluation. In: Antona M., Stephanidis C. (Eds.). Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. HCII 2019. Lecture Notes in Computer Science, 11573. Springer, Cham.

Çuhadar, S. (2008). Otizmli çocukların eğitiminde yardımcı teknolojilerin kullanımı. 8th International Educational Technology Conference içinde (s. 1053-1056). Eskişehir, Türkiye.

Dale, E. (1969). Audio-visual methods in teaching (3. Baskı). Holt, Rinehart and Winston.

Dautenhahn, K. (2000). Design issues on interactive environments for children with autism. 3rd International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT 2000) içinde (s. 153-161). Alghero, Sardinia, İtalya.

De Jaegher, H. (2013). Embodiment and sense-making in autism. Frontiers in Integrative Neuroscience, 7, 1-19.

De Oliveira Barros, V. T., de Almeida Zerbetto, C. A., Meserlian, K. T., Barros, R., Crivellari Camargo, M., Cristina Passos de Carvalho, T. (2014). Daybyday: Interactive and customizable use of mobile technology in the cognitive development process of children with autistic spectrum disorder. C. Stephanidis, M. Antona (Ed.). Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge içinde (s. 443-453).

Dix, A. (2003). Being playful: Learning from children. S. MacFarlane, T. Nicol, J. Read, (Ed)., Proceedings of the 2003 Conference on Interaction and children (ICD’03) içinde (s. 3-9).

Dourish, P. (2001). Where the action is: The foundations of embodied interaction. MIT Press.

Fabri, M. (2006). Emotionally expressive avatars for collaborative virtual environments [Doktora Tezi, Leeds Metropolitan University].

Fischer, K. W. (1980). A theory of cognitive development: the control and construction of hierarchies of skills. Psychological Review, 87(6), 477-531.

Fishkin, K. A. (2004). Taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8(5), 347-358.

Gal, E., Goren-Bar, D., Gazit, E., Bauminger, N., Cappelletti, A., Pianesi, F., vd. (2005). Enhancing social communication through story-telling among high-functioning children with autism. M. Maybury, O. Stock, W. Wahlster (Ed.), INTATEIN: International Conference on Intelligent Technologies for Interactive Entertainment içinde (s. 320-323). Springer.

Gerhard, M. (2003). A hybrid avatar/agent model for educational CVEs. [Doktora Tezi, Leeds Metropolitan University].

Gerrish, K., Lacey, A. (2010). The research process in nursing (6. Baskı). Wiley-Blackwell.

Grossard, C., Grynspan, O., Serret, S., Jouen, A. L., Bailly, K., Cohen, D. (2017). Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers & Education, 113, 195-211.

Hardy, C., Ogden, J., Newman, J., Cooper, S. (2002). Autism and ICT: A guide for teachers and parents. David Fulton Publishers Ltd.

Hart, M. (2005). Autism/excel study. Assets '05: Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility içinde (s. 136-141). Association for Computing Machinery.

Heller, F., Schöning, J., Meleyal, L. F., Nolas, S. M., Zeisner, L., Rauers, A. (2016). Who are the people in my life? towards tangible eco-maps. UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct içinde. (s. 81-84). Association for Computing Machinery.

Hill, E. L., Crane, L., Bremner, A. J. (2012). Developmental disorders and multisensory perception. A. J. Bremner, D. J. Lewkowicz, C. Spence (Ed.), Multisensory Development (s. 273–300). Oxford University Press.

Hirano, S. H., Yeganyan, M. T., Marcu, G., Nguyen, D. H., Boyd, L. A., Hayes, G. R. (2010). Vsked: evaluation of a system to support classroom activities for children with autism. CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems içinde (s. 1633–1642), Association for Computing Machinery.

Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., Biasini, F. J. (2011). Avatar assistant: improving social skills in students with an asd through a computer-based intervention. Journal of Autism and Developmental Disorders, 41(11), 1543-1555.

Ishii, H. (2008). The tangible user interface and its evolution. Communications of the ACM, 51(6), 32-36.

Ishii, H. ve Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms, ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’97) içinde (s. 234-241). Association for Computing Machinery.

Kagohara, D. M., van der Meer, L., Ramdoss, S., O’Reilly, M. F., Lancioni, G. E., Davis, N., Rispoli, M. (2013). Using ipods and ipads in teaching programs for individuals with developmental disabilities: a systematic review. Research in Developmental Disabilities, 34(1), 147-56.

Keay-Bright, W. (2008). Tangible technologies as interactive play spaces for children with learning difficulties: the reactive colours project. International Journal of Technology, Knowledge and Society 4(1), 1-19.

Kellems, R. O., Charlton, C., Kversoy, K. S., Győri, M. (2020). Exploring the use of virtual characters (avatars), live animation, and augmented reality to teach social skills to individuals with autism. Multimodal Technologies and Interaction, 4(3), 48-59.

Kumazaki, H., Warren, Z., Swanson, A., Yoshikawa, Y., Matsumoto, Y., Yoshimura, Y., vd. (2019). Brief report: evaluating the utility of varied technological agents to elicit social attention from children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 49(4), 1700-1708.

Levin, D. E., Rosenquest, B. (2001). The ıncreasing role of electronic toys in the lives of infants and toddlers: Should we be concerned? Contemporary Issues in Early Childhood, 2(2), 242-247.

Lorenzo, G., Lledó, A., Pomares, J., Roig, R. (2016). Design and application of an immersive virtual reality system to enhance emotional skills for children with autism spectrum disorders. Computers & Education, 98, 192-205.

Lovaas, O. I. (2003). Teaching individuals with developmental delays: basic intervention techniques. Pro-Ed.

Milli Eğitim Bakanlığı (MEB). (2013). Özel eğitim uygulama merkezi (okulu) II. kademe eğitim programı (otistik çocuklar için). Milli Eğitim Bakanlığı, Özel Eğitim ve Rehberlik Hizmetleri Genel Müdürlüğü, Ankara.

Mohamed, A. O., Courboulay, V., Sehaba, K., Menard, M. (2006). Attention analysis in interactive software for children with autism. Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility içinde (s. 133-140). Association for Computing Machinery.

Moore, D., McGrath, P., Powell, N. J. (2005). Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities, 20(4), 231-243.

Moule, P., Aveyard, P., Goodman M. (2017). Nursing research (3. Baskı). SAGE Publication Ltd.

O’Malley, C., Stanton Fraser, D. (2004). Literature review in learning with tangible technologies. Report 12 NESTA FutureLab Series. (13.09.2013).

Özyürek, M. (1983). Kavram öğrenme ve öğretme. Anadolu Üniversitesi Eğitim Fakültesi Dergisi, 16(2), 347-366.

Parsons, S., Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autism spectrum disorders. Journal of Intellectual Disability Research, 46(5), 430-443.

Parsons, S., Leonard, A., Mitchell, P. (2006). Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Computers and Education, 47(2), 186-206.

Piaget, J. (1952). The origin of intelligence in the child (M. Cook, Çev.). International Universities Press, Inc.

Putnam, C., Chong, L. (2008). Software and technologies designed for people with autism: what do users want? Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility içinde, (s. 3-10). Association for Computing Machinery.

Ramdoss, S., Lang, R., Mulloy, A., Franco, J., O’reilly, M., Diddedn, R., Lancioni, G. (2011). Use of computer-based interventions to teach communication skills to children with autism spectrum disorders: a systematic review. Journal of Behavioral Education, 20, 55-76.

Ramloll, R., Trepagnier, C., Sebrechts, M., Finkelmeyer, A. (2004). A gaze contingent environment for fostering social attention in autistic children. ETRA '04: Proceedings of the 2004 symposium on Eye tracking research & applications içinde (s. 19–26). Association for Computing Machinery.

Ryokai, K., Marti, S., Ishii, H. (2004). I/O brush: drawing with everyday objects as ink. CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems içinde (s. 303-310). Association for Computing Machinery.

Shuler, C., Levine, Z., Ree, J. (2012). ilearn II: An analysis of the educational category of apple’s app store. The Joan Ganz Cooney Center. (24.05.2014).

Singer, D. G., Revenson, T. A. (1996). A piaget premier: How a child thinks. Penguin.

Sitdhisanguan K., Chotikakamthorn N., Dechaboon A., Out P., (2007). Comparative study of WIMP and tangible user ınterfaces in training shape matching skill for autistic children. TENCON 2007- 2007 IEEE Region 10 Conference içinde (s. 1-4), IEEE Xplore.

Tekin-İftar, E., Değirmenci, H. D. (2012). Otizm spektrumu olan çocukların öğretimi. E. Tekin-İftar (Editör), Otizm spektrum bozukluğu olan çocuklar ve eğitimleri. Vize Yayıncılık.

Yılmaz, D., Merinoslu, N. (2020, Mart 30). Tohum Otizm Vakfı eğitim amaçlı öneri kaynak listesi. (12.05. 2021).

Tohum Otizm Vakfı. (t.y.). Modül 12: Eşleme Becerileri [E-eğitim modülü]. Tohum Otizm Vakfı Eğitim Portalı E-Eğitimler içinde.

Wadsworth, B. J. (1996). Piaget’s theory of cognitive and effective development: Foundations of constructivism. Longman Publishing.

Wing, L. (1981). Language, Social, and Cognitive Impairments in Autism and Severe Mental Retardation. Journal of Autism and Developmental Disorders, 11(1), 31-44.

Wing, L. (2012). Otizm el rehberi (3. Baskı) (S. Kunt, Çev.). Sistem Yayıncılık.

Wing, L., Gould, J. (1979). Severe impairments of social interaction and associated abnormalities in children: epidemiology and classification. Journal of Autism and Developmental Disorders, 9, 11-29.

Zheng, Z., Fu, Q., Zhao, H., Swanson, A., Weitlauf, A., Warren, Z., Sarkar, N. (2015). Design of a computer-assisted system for teaching attentional skills to toddlers with ASD. Antona M., Stephanidis C. (Ed.) Universal Access in Human-Computer Interaction: Access to Learning, Health and Well-Being (UAHCI 2015) bildiri kitabı içinde (s. 721-730) Lecture Notes in Computer Science, vol 9177. Springer, Cham.