Journal of Intelligent Communication

Article

Design of an Intelligent Agent to Measure Collaboration and Ver-bal-Communication Skills of Children with Autism Spectrum Dis-order in Collaborative Puzzle Games

Downloads

https://doi.org/10.54963/jic.v2i2.127
Zhang, M., & Hua, C. (2022). Design of an Intelligent Agent to Measure Collaboration and Ver-bal-Communication Skills of Children with Autism Spectrum Dis-order in Collaborative Puzzle Games. Journal of Intelligent Communication, 2(1), 12–20. https://doi.org/10.54963/jic.v2i2.127
Volume 2 Issue 1: March 2023
Copyright (c) 2023 Miao Zhang, Chengwei Hua
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright

The authors shall retain the copyright of their work but allow the Publisher to publish, copy, distribute, and convey the work.

License

Journal of Intelligent Communication (JIC)  publishes accepted manuscripts under Creative Commons Attribution 4.0 International (CC BY 4.0). Authors who submit their papers for publication by Journal of Intelligent Communication (JIC) agree to have the CC BY 4.0 license applied to their work, and that anyone is allowed to reuse the article or part of it free of charge for any purpose, including commercial use. As long as the author and original source is properly cited, anyone may copy, redistribute, reuse and transform the content.

Authors

  • Miao Zhang
    Vanderbilt University, Nashville, TN, USA
  • Chengwei Hua China Transport Telecommunications & Information Center, Beijing 100011, China

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder characterized by core deficits in social interaction and communication. Collaborative puzzle games are interactive activities that can be played to foster the collaboration and verbal-communication skills of children with ASD. In this paper, we have designed an intelligent agent that can play collaborative puzzle games with children and verbally communicate with them as if it is another human player. Furthermore, this intelligent agent is also able to automatically measure children’s task-performance and verbal-communication behaviors throughout game play. Two preliminary studies were conducted with children with ASD to evaluate the feasibility and performance of the intelligent agent. Results of Study I demonstrated the intelligent agent’s ability to play games and communicate with children within the game-playing domain. Results of Study II indicated its potential to measure the communication and collaboration skills of human users.

Keywords:

traffic accidents communication tools power-minimization

References

  1. Snoek CGM, Worring M, and Smeulders AWM, “Early versus late fusion in semantic video anal-ysis,” in Proc. 13th ACM Int. Conf. Multimedia, MM 2005, 2005, pp. 399–402, doi: 10.1145/1101149.1101236.
  2. Baio J et al., “Prevalence of Autism Spectrum Disorder among children aged 8 years-Autism and Developmental Disabilities Monitoring Net-work,” 2014, MMWR Surveillance Summaries. doi: 10.15585/mmwr.ss6706a1.
  3. Peacock G, Amendah D, Ouyang L, and Grosse SD, “Autism Spectrum Disorders and Health Care Expenditures,” J. Dev. Behav. Pediatr, vol. 33, no. 1, pp. 2–8, Jan. 2012, doi: 10.1097/DBP.0b013e31823969de.
  4. Sundberg ML and Partington JW, Teaching Lan-guage to Children with Autism Or Other Devel-opmental Disabilities, Pleasant Hill, California, USA: Behavior Analysts, Inc., 1998.
  5. Bauminger N, “The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Inter-vention Outcomes,” J. Autism Dev. Disord, vol. 32, no. 4, pp. 283–298, Aug. 2002, doi: 10.1023/A:1016378718278.
  6. Rogers SJ, “Empirically supported comprehen-sive treatments for young children with autism,” J. Clin. Child Psychol, vol. 27, no. 2, pp. 168–179, 1998, doi: 10.1207/s15374424jccp2702_4.
  7. Cohen H, Amerine-Dickens M, and Smith T, “Early intensive behavioral treatment: Replica-tion of the UCLA model in a community setting,” J. Dev. Behav. Pediatr, vol. 27, pp. S145–S155, 2006. doi: 10.1097/00004703-200604002-0001.
  8. Pennington RC, “Computer-assisted instruction for teaching academic skills to students with Au-tism Spectrum Disorders: a review of literature,” Focus Autism Other Dev. Disabl, vol. 25, no. 4, pp. 239–248, Dec. 2010, doi: 10.1177/1088357610378291.
  9. Moore D, Cheng Yufang, Mcgrath P, and Powell NJ, “Collaborative virtual environment technol-ogy for people with autism,” Focus Autism Other Dev. Disabl, vol. 20, no. 4, pp. 231–243, 2005, doi: 10.1177/10883576050200040501.
  10. Lahiri U, Bekele E, Dohrmann E, Warren Z, and Sarkar N, “A physiologically informed virtual reality based social communication system for individuals with autism,” J. Autism Dev. Disord, vol. 45, pp. 919–931, 2015, doi: 10.1007/s10803-014-2240-5.
  11. Bernard-Opitz V, Sriram N, and Nakhoda-Sapuan S, “Enhancing social problem solving in children with Autism and normal children through com-puter-assisted instruction,” J. Autism Dev. Dis-ord, vol. 31, no. 4, pp. 377–384, Aug. 2001, doi: 10.1023/A:1010660502130.
  12. Noor H, Shahbodin F, and Pee NC, “Serious game for autism children: review of literature,” World Academy Sci., Eng. and Technol. Int. J. Psychol. and Behav. Sci, vol. 6, pp. 554–559, 2012, doi: 10.5281/zenodo.1333272.
  13. Hourcade JP, Williams SR, Miller EA, Huebner KE, and Liang LJ, “Evaluation of tablet apps to encourage social interaction in children with Au-tism Spectrum Disorders,” in Conf. Human Fac-tors Comput. Syst – Proc, 2013, pp. 3197–3206, doi: 10.1145/2470654.2466438.
  14. Battocchi A, Pianesi F, Tomasini D, Zancanaro M, Esposito G, Venuti P, Ben Sasson A, Gal E, and Weiss PL, “Collaborative puzzle game: A tab-letop interactive game for fostering collabora-tion in children with Autism Spectrum Disorders (ASD),” in Proc. ACM Int. Conf. Interactive Tab-letops and Surfaces, 2009, pp. 197–204, doi: 10.1145/1731903.1731940.
  15. Piper AM, O’Brien E, Morris MR, and Winograd T, “SIDES: A cooperative tabletop computer game for social skills development,” in Proc. ACM Conf.Comput. Supported Cooperative Work, CSCW, 2006, pp. 1–10, doi: 10.1145/1180875.1180877.
  16. Curtis DD and Lawson MJ, “Exploring collabo-rative online learning,” J. Asynchronous Learn. Netw, vol. 5, pp. 21–34, 2001, doi: 10.24059/olj.v5i1.1885.
  17. Zancanaro M, Pianesi F, Stock O, Venuti P, Cap-pelletti A, Iandolo G, Prete M, and Rossi F, “Children in the museum: an environment for collaborative storytelling,” in PEACH-Intell. In-terfaces Museum Visits, 2007, pp. 165–184. doi: 10.1007/3-540-68755-6_8.
  18. Ben-Sasson A, Lamash L, and Gal E, “To enforce or not to enforce? The use of collaborative inter-faces to promote social skills in children with high functioning autism spectrum disorder,” Au-tism, vol. 17, pp. 608–622, 2013, doi: 10.1177/1362361312451526.
  19. Kopp S, Gesellensetter L, Krämer NC, and Wachsmuth I, “A conversational agent as muse-um guide-design and evaluation of a real-world application,” in Int. Workshop Intell. Virtual Agents, 2005, pp. 329–343, doi: 10.1007/11550617_28.
  20. Cauell J, Bickmore T, Campbell L, and Vilhjálmsson H, “Designing embodied conversa-tional agents,” Embodied Conversational Agents, Cambridge, Massachusetts, USA: MIT Press, 2000, pp. 29–63.
  21. Pellom B, Ward W, Hansen J, Cole R, Hacioglu K, Zhang J, Yu X, and Pradhan S, “University of Colorado dialog systems for travel and naviga-tion,” in Proc.1st Int. Conf. Human Lang. Tech-nol. Res, 2001, pp. 1–6, doi: 10.3115/1072133.1072225.
  22. Aust H, Oerder M, Seide F, and Steinbiss V, “The Philips automatic train timetable information system,” Speech Commun, vol. 17, pp. 249–262, 1995, doi: 10.1016/0167-6393(95)00028-M.