Determining tangible user interfaces in teaching matching skills to children with autism

Authors

Keywords:

Children with Autism, Product Design, Tangible User Interface, Tablet Computer, Matching Skills

Abstract

One of the primary deficiencies in children with autism is the ability of symbolic thinking. For overcoming difficulties in understanding abstract concepts, recognizing the similarities and differences between objects, comprehending the whole and its parts, completing the missing pieces in a pattern, are the first skills necessary to be taught. In our present day, tablet computers are among the important accessible technologies in education and training. The study aims to focus on the supporting qualities and design criteria of tangible user interfaces (TUI) for practising matching skills, one of the basic skills that children with autism should acquire. Popularizing tablet computers in various teaching activities of children with autism is important in researches. As a methodology, a literature review was conducted to synthesize and summarize the results of studies on this subject. Regarding this, an evaluation of the supportive qualities of using devices with tangible interfaces and their components in teaching matching skills, one of the basic skills that children with autism should acquire in the preschool period, is presented in regard to user experience. First, the contribution of technological tools in teaching various skills to children with autism was evaluated. The qualities of the devices with TUI, the tablet computers in the context of accessible technology and the accompanying tangible widgets that would contribute teaching matching skills to children with autism were examined and the design criteria of these products have been revealed.

References

Allahyar, M., Hunt E. (2003). The assessment of spatial orientation using virtual reality techniques. International Journal of Testing, 3(3), 263-275. https://doi.org/10.1207/S15327574IJT0303_5

Amerikan Psikiyatri Birliği. (1994). Mental bozuklukların tanısal ve sayımsal el kitabı (4. baskı) (DSM-IV) (E. Köroğlu, Çev.). Hekimler Yayın Birliği.

Battocchi, A., Gal, E., Sasson, B., Pianesi, F., Venuti, P., Zancanaro, M. ve Weiss, P. L. (2008). Collaborative puzzle game: an interface for studying collaboration and social ınteraction for children who are typically developed or who have autistic spectrum disorder. P. Sharkey, P. Lopes-dos-Santos, P. L. (T.) Weiss ve T. Brooks (Ed.), 7th International Conference on Disability, Virtual Reality and Associated Technologies, with ArtAbilitation (ICDVRAT 2008) içinde (s. 127-134). Maia, Portekiz.

Bauminger, N., Goren-Bar, D., Gal, E., Weiss, P. L., Yifat, R., Kupersmitt, J., Pianesi, F. (2007). Enhancing social communication in high-functioning children with autism through a co-located ınterface. 2007 IEEE 9th Workshop on Multimedia Signal Processing içinde (s. 18-21), Chania, Yunanistan. https://doi.org/10.1109/MMSP.2007.4412808

Bernard-Opitz, V., Sriram, N. ve Nakhoda-Sapuan S. (2001). Enhancing social problem solving in children with autism and normal children through computer-assisted ınstruction. Journal of Autism and Developmental Disorders, 31, 377–384. https://doi.org/10.1023/A:1010660502130

Bock, M., Fisker, M., Topp, K. F., Kraus, M. (2014). Initial exploration of the use of specific tangible widgets for tablet games. L. M. Aiello, D. McFarland (Ed.), International conference on social informatics içinde (s. 183-190). Springer, Cham. https://doi.org/10.1007/978-3-319-15168-7

Bock, M., Fisker, M., Topp, K. F., Kraus, M. (2015). Tangible widgets for a multiplayer tablet game in comparison to finger touch. CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play içinde (s. 755-758). Association for Computing Machinery. https://doi.org/10.1145/2793107.2810269

Bonneh Y. S. , Belmonte M. K. ,Pei F. , … Merzenich M. M. (2008). Cross-modal extinction in a boy with severely autistic behaviour and high verbal intelligence. Cognitive Neuropsychology, 25(5), 635-652. https://doi.org/10.1080/02643290802106415

Bosseler, A. ve Massaro, D. W. (2003). Development and evaluation of a computer-animated tutor for vocabulary and language learning for children with autism. Journal of Autism and Developmental Disorders 33(6), 653-672. https://doi.org/10.1023/b:jadd.0000006002.82367.4f

Boyd, D., Bee, H. (2009). Lifespan development (5. Baskı). Pearson International Edition.

Broussard, R., Fazzio, S., Kang, S. C., Francisco-Revilla, L. (2012). A computer activity to encourage facial expression recognition for children with autism spectrum disorders. iConference '12: Proceedings of the 2012 iConference içinde (s. 478-479). Association for Computing Machinery.

Bruner, J. S. (1973). Organization of early skilled action. Child Development, 44. 92-96.

Burns, N., Grove, S. K. (2009). The practice of nursing research: appraisal, synthesis, and generation of evidence (6th ed.). Saunders.

Camargo, M. C., Carvalho, T. C. P., Barros, R. M., Barros, V. T. O., Santana, M. (2019). Improving Usability of a Mobile Application for Children with Autism Spectrum Disorder Using Heuristic Evaluation. In: Antona M., Stephanidis C. (Eds.). Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. HCII 2019. Lecture Notes in Computer Science, 11573. Springer, Cham. https://doi.org/10.1007/978-3-030-23563-5_5

Çuhadar, S. (2008). Otizmli çocukların eğitiminde yardımcı teknolojilerin kullanımı. 8th International Educational Technology Conference içinde (s. 1053-1056). Eskişehir, Türkiye.

Dale, E. (1969). Audio-visual methods in teaching (3. Baskı). Holt, Rinehart and Winston.

Dautenhahn, K. (2000). Design issues on interactive environments for children with autism. 3rd International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT 2000) içinde (s. 153-161). Alghero, Sardinia, İtalya.

De Jaegher, H. (2013). Embodiment and sense-making in autism. Frontiers in Integrative Neuroscience, 7, 1-19.

De Oliveira Barros, V. T., de Almeida Zerbetto, C. A., Meserlian, K. T., Barros, R., Crivellari Camargo, M., Cristina Passos de Carvalho, T. (2014). Daybyday: Interactive and customizable use of mobile technology in the cognitive development process of children with autistic spectrum disorder. C. Stephanidis, M. Antona (Ed.). Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge içinde (s. 443-453). https://doi.org/10.1007/978-3-319-07440-5_41

Dix, A. (2003). Being playful: Learning from children. S. MacFarlane, T. Nicol, J. Read, (Ed)., Proceedings of the 2003 Conference on Interaction and children (ICD’03) içinde (s. 3-9). https://doi.org/10.1145/953536.953538

Dourish, P. (2001). Where the action is: The foundations of embodied interaction. MIT Press.

Fabri, M. (2006). Emotionally expressive avatars for collaborative virtual environments [Doktora Tezi, Leeds Metropolitan University].

Fischer, K. W. (1980). A theory of cognitive development: the control and construction of hierarchies of skills. Psychological Review, 87(6), 477-531. https://doi.org/10.1037/0033-295X.87.6.477

Fishkin, K. A. (2004). Taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8(5), 347-358.

Gal, E., Goren-Bar, D., Gazit, E., Bauminger, N., Cappelletti, A., Pianesi, F., vd. (2005). Enhancing social communication through story-telling among high-functioning children with autism. M. Maybury, O. Stock, W. Wahlster (Ed.), INTATEIN: International Conference on Intelligent Technologies for Interactive Entertainment içinde (s. 320-323). Springer. https://doi.org/10.1007/11590323_43

Gerhard, M. (2003). A hybrid avatar/agent model for educational CVEs. [Doktora Tezi, Leeds Metropolitan University].

Gerrish, K., Lacey, A. (2010). The research process in nursing (6. Baskı). Wiley-Blackwell.

Grossard, C., Grynspan, O., Serret, S., Jouen, A. L., Bailly, K., Cohen, D. (2017). Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers & Education, 113, 195-211. https://doi.org/10.1016/j.compedu.2017.05.002

Hardy, C., Ogden, J., Newman, J., Cooper, S. (2002). Autism and ICT: A guide for teachers and parents. David Fulton Publishers Ltd.

Hart, M. (2005). Autism/excel study. Assets '05: Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility içinde (s. 136-141). Association for Computing Machinery. https://doi.org/10.1145/1090785.1090811

Heller, F., Schöning, J., Meleyal, L. F., Nolas, S. M., Zeisner, L., Rauers, A. (2016). Who are the people in my life? towards tangible eco-maps. UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct içinde. (s. 81-84). Association for Computing Machinery. https://doi.org/10.1145/2968219.2971456

Hill, E. L., Crane, L., Bremner, A. J. (2012). Developmental disorders and multisensory perception. A. J. Bremner, D. J. Lewkowicz, C. Spence (Ed.), Multisensory Development (s. 273–300). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199586059.003.0012

Hirano, S. H., Yeganyan, M. T., Marcu, G., Nguyen, D. H., Boyd, L. A., Hayes, G. R. (2010). Vsked: evaluation of a system to support classroom activities for children with autism. CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems içinde (s. 1633–1642), Association for Computing Machinery.

Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., Biasini, F. J. (2011). Avatar assistant: improving social skills in students with an asd through a computer-based intervention. Journal of Autism and Developmental Disorders, 41(11), 1543-1555. https://doi.org/10.1007/s10803-011-1179-z

Ishii, H. (2008). The tangible user interface and its evolution. Communications of the ACM, 51(6), 32-36. https://doi.org/10.1145/1349026.1349034

Ishii, H. ve Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms, ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’97) içinde (s. 234-241). Association for Computing Machinery.

Kagohara, D. M., van der Meer, L., Ramdoss, S., O’Reilly, M. F., Lancioni, G. E., Davis, N., Rispoli, M. (2013). Using ipods and ipads in teaching programs for individuals with developmental disabilities: a systematic review. Research in Developmental Disabilities, 34(1), 147-56. https://doi.org/10.1016/j.ridd.2012.07.027

Keay-Bright, W. (2008). Tangible technologies as interactive play spaces for children with learning difficulties: the reactive colours project. International Journal of Technology, Knowledge and Society 4(1), 1-19. https://doi.org/10.18848/1832-3669/CGP/v04i01/55821

Kellems, R. O., Charlton, C., Kversoy, K. S., Győri, M. (2020). Exploring the use of virtual characters (avatars), live animation, and augmented reality to teach social skills to individuals with autism. Multimodal Technologies and Interaction, 4(3), 48-59. https://doi.org/10.3390/mti4030048

Kumazaki, H., Warren, Z., Swanson, A., Yoshikawa, Y., Matsumoto, Y., Yoshimura, Y., vd. (2019). Brief report: evaluating the utility of varied technological agents to elicit social attention from children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 49(4), 1700-1708. https://doi.org/10.1007/s10803-018-3841-1

Levin, D. E., Rosenquest, B. (2001). The ıncreasing role of electronic toys in the lives of infants and toddlers: Should we be concerned? Contemporary Issues in Early Childhood, 2(2), 242-247. https://doi.org/10.2304/ciec.2001.2.2.9

Lorenzo, G., Lledó, A., Pomares, J., Roig, R. (2016). Design and application of an immersive virtual reality system to enhance emotional skills for children with autism spectrum disorders. Computers & Education, 98, 192-205. https://doi.org/10.1016/j.compedu.2016.03.018

Lovaas, O. I. (2003). Teaching individuals with developmental delays: basic intervention techniques. Pro-Ed.

Milli Eğitim Bakanlığı (MEB). (2013). Özel eğitim uygulama merkezi (okulu) I.ve II. kademe eğitim programı (otistik çocuklar için). Milli Eğitim Bakanlığı, Özel Eğitim ve Rehberlik Hizmetleri Genel Müdürlüğü, Ankara.

Mohamed, A. O., Courboulay, V., Sehaba, K., Menard, M. (2006). Attention analysis in interactive software for children with autism. Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility içinde (s. 133-140). Association for Computing Machinery. https://doi.org/10.1145/1168987.1169011

Moore, D., McGrath, P., Powell, N. J. (2005). Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities, 20(4), 231-243. https://doi.org/10.1177/10883576050200040501

Moule, P., Aveyard, P., Goodman M. (2017). Nursing research (3. Baskı). SAGE Publication Ltd.

O’Malley, C., Stanton Fraser, D. (2004). Literature review in learning with tangible technologies. Report 12 NESTA FutureLab Series. https://www.nfer.ac.uk/media/1832/futl69.pdf (13.09.2013).

Özyürek, M. (1983). Kavram öğrenme ve öğretme. Anadolu Üniversitesi Eğitim Fakültesi Dergisi, 16(2), 347-366.

Parsons, S., Mitchell, P. (2002). The potential of virtual reality in social skills training for people with autism spectrum disorders. Journal of Intellectual Disability Research, 46(5), 430-443. https://doi.org/10.1046/j.1365-2788.2002.00425.x

Parsons, S., Leonard, A., Mitchell, P. (2006). Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Computers and Education, 47(2), 186-206. https://doi.org/10.1016/j.compedu.2004.10.003

Piaget, J. (1952). The origin of intelligence in the child (M. Cook, Çev.). International Universities Press, Inc.

Putnam, C., Chong, L. (2008). Software and technologies designed for people with autism: what do users want? Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility içinde, (s. 3-10). Association for Computing Machinery. https://doi.org/10.1145/1414471.1414475

Ramdoss, S., Lang, R., Mulloy, A., Franco, J., O’reilly, M., Diddedn, R., Lancioni, G. (2011). Use of computer-based interventions to teach communication skills to children with autism spectrum disorders: a systematic review. Journal of Behavioral Education, 20, 55-76. https://doi.org/10.1007/s10864-010-9112-7

Ramloll, R., Trepagnier, C., Sebrechts, M., Finkelmeyer, A. (2004). A gaze contingent environment for fostering social attention in autistic children. ETRA '04: Proceedings of the 2004 symposium on Eye tracking research & applications içinde (s. 19–26). Association for Computing Machinery. https://doi.org/10.1145/968363.968367

Ryokai, K., Marti, S., Ishii, H. (2004). I/O brush: drawing with everyday objects as ink. CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems içinde (s. 303-310). Association for Computing Machinery. https://doi.org/10.1145/985692.985731

Shuler, C., Levine, Z., Ree, J. (2012). ilearn II: An analysis of the educational category of apple’s app store. The Joan Ganz Cooney Center. https://joanganzcooneycenter.org/wp-content/uploads/2012/01/ilearnii.pdf (24.05.2014).

Singer, D. G., Revenson, T. A. (1996). A piaget premier: How a child thinks. Penguin.

Sitdhisanguan K., Chotikakamthorn N., Dechaboon A., Out P., (2007). Comparative study of WIMP and tangible user ınterfaces in training shape matching skill for autistic children. TENCON 2007- 2007 IEEE Region 10 Conference içinde (s. 1-4), IEEE Xplore. https://doi.org/10.1109/TENCON.2007.4428939

Tekin-İftar, E., Değirmenci, H. D. (2012). Otizm spektrumu olan çocukların öğretimi. E. Tekin-İftar (Editör), Otizm spektrum bozukluğu olan çocuklar ve eğitimleri. Vize Yayıncılık.

Yılmaz, D., Merinoslu, N. (2020, Mart 30). Tohum Otizm Vakfı eğitim amaçlı öneri kaynak listesi. https://www.tohumotizm.org.tr/wp-content/uploads/2020/10/Tohum-Otizm-Vakf%C4%B1-Kaynak-%C3%96nerileri_07.10.2020.pdf (12.05. 2021).

Tohum Otizm Vakfı. (t.y.). Modül 12: Eşleme Becerileri [E-eğitim modülü]. Tohum Otizm Vakfı Eğitim Portalı E-Eğitimler içinde. https://egitim.tohumotizmportali.org/Elearning/WEBUIRisePlayer?id=20789920&fromProgram=0

Wadsworth, B. J. (1996). Piaget’s theory of cognitive and effective development: Foundations of constructivism. Longman Publishing.

Wing, L. (1981). Language, Social, and Cognitive Impairments in Autism and Severe Mental Retardation. Journal of Autism and Developmental Disorders, 11(1), 31-44. https://doi.org/10.1007/bf01531339

Wing, L. (2012). Otizm el rehberi (3. Baskı) (S. Kunt, Çev.). Sistem Yayıncılık.

Wing, L., Gould, J. (1979). Severe impairments of social interaction and associated abnormalities in children: epidemiology and classification. Journal of Autism and Developmental Disorders, 9, 11-29. https://doi.org/10.1007/BF01531288

Zheng, Z., Fu, Q., Zhao, H., Swanson, A., Weitlauf, A., Warren, Z., Sarkar, N. (2015). Design of a computer-assisted system for teaching attentional skills to toddlers with ASD. Antona M., Stephanidis C. (Ed.) Universal Access in Human-Computer Interaction: Access to Learning, Health and Well-Being (UAHCI 2015) bildiri kitabı içinde (s. 721-730) Lecture Notes in Computer Science, vol 9177. Springer, Cham. https://doi.org/10.1007/978-3-319-20684-4_69

Downloads

Published

2022-06-01