Journal of Qualitative Research in Education - Eğitimde nitel araştırmalar dergisi

Articles

Exploring Faculty Adoption of Natural Language Processing Tools in Teaching: An Exploratory Study in a Private University Context

Downloads

https://doi.org/10.54963/jqre.i45.1939
Shen, Z., Adnan, A. B. M., Ben, S., Lyu, Y., Bi, Z., & Liu, C. (2025). Exploring Faculty Adoption of Natural Language Processing Tools in Teaching: An Exploratory Study in a Private University Context. Journal of Qualitative Research in Education, (45), 52–77. https://doi.org/10.54963/jqre.i45.1939
Issue 45 (2026)
Copyright (c) 2025 Zhian Shen, Azhar Bin Md Adnan, Shaohua Ben, Yi Lyu, Zhuo Bi, Chang Liu
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright

The authors shall retain the copyright of their work but allow the Publisher to publish, copy, distribute, and convey the work.

License

Journal of Qualitative Research in Education (ENAD)  publishes accepted manuscripts under Creative Commons Attribution 4.0 International (CC BY 4.0). Authors who submit their papers for publication by ENAD agree to have the CC BY 4.0 license applied to their work, and that anyone is allowed to reuse the article or part of it free of charge for any purpose, including commercial use. As long as the author and original source are properly cited, anyone may copy, redistribute, reuse, and transform the content.

Authors

  • Zhian Shen

    School of Continuing Education, Shanghai Jianqiao University, Shanghai 201306, China
  • Azhar Bin Md Adnan

    Faculty of Social Sciences & Liberal Arts, UCSI University, Kuala Lumpur 56000, Malaysia
  • Shaohua Ben

    Faculty of Social Sciences & Liberal Arts, UCSI University, Kuala Lumpur 56000, Malaysia
  • Yi Lyu

    School of Continuing Education, Shanghai Jianqiao University, Shanghai 201306, China
    Faculty of Social Sciences & Liberal Arts, UCSI University, Kuala Lumpur 56000, Malaysia
  • Zhuo Bi

    School of Continuing Education, Shanghai Jianqiao University, Shanghai 201306, China
  • Chang Liu

    Communication Studies, School of Journalism and Communication, Shanghai Jianqiao University, Shanghai 201306, China

Received: 17 September 2025; Revised: 29 October 2025; Accepted: 26 November 2025; Published: 2 December 2025

Natural Language Processing (NLP) interfaces are becoming more common in higher education, but adoption by faculty is inconsistent in private universities with limited resources. Drawing on a study of a private university in Shanghai, we investigate institutional and individual determinants of how instructors adopt NLP tools (such as ChatGPT, Doubao and Kimi) for feedback, assessment, summarization, question generation, and instructional drafting. We employed an exploratory sequential mixed-methods design involving six interviews, as well as a survey (n = 195; ≈28% of faculty). Building on a TAM model enriched by Perceived Behavioral Control (PBC), University Facilitating Conditions (UFC), and Social Attitudes (SA), we tested a partial least squares structural equation model (PLS-SEM). Findings indicate that UFC is by far the most powerful predictor of adoption intentions and perceived control, while SA exerts a weaker but statistically significant influence which partially operates through PBC. PBC not only directly influences intention but also moderates the effects of UFC, indicating a central role of self-efficacy in instructor-focused interventions. These pathways are fleshed out by qualitative evidence that points to enabling policies, training, and aligned use cases as levers, and challenges around digital literacy, policy misalignment, and uneven infrastructure. We suggest professional development, incentives linked to pedagogical outputs, and ongoing resourcing for the integration of text-focused AI. The results extend TAM to the context of a private university setting by introducing institutional support and perceived control, which may be applied to similar institutions that are experiencing digital transformation.

Keywords:

NLP (NLP) Teaching Innovation Private Higher Education Technology Acceptance Model (TAM) Institutional Support

References

  1. Lan, Y.; Li, X.; Du, H.; et al. Survey of NLP for Education: Taxonomy, Systematic Review, and Future Trends. arXiv preprint 2024, arXiv:2401.07518. Available online: https://arxiv.org/abs/2401.07518
  2. Guo, X. Evaluation Method of English-Speaking Self-Learning System Based on NLP Technology. J. Electr. Syst. 2023, 19, 49–66. DOI: https://doi.org/10.52783/jes.623
  3. Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319–340. DOI: https://doi.org/10.2307/249008
  4. Venkatesh, V.; Morris, M.G.; Davis, G.B.; et al. User Acceptance of Information Technology: Toward a Unified View. MIS Q. 2003, 27, 425–478. DOI: https://doi.org/10.2307/30036540
  5. Scherer, R.; Siddiq, F.; Tondeur, J. The Technology Acceptance Model (TAM): A Meta-Analytic Structural Equation Modeling Approach to Explaining Teachers’ Adoption of Digital Technology in Education. Comput. Educ. 2019, 128, 13–35. DOI: https://doi.org/10.1016/j.compedu.2018.09.009
  6. Ma, J.; Wang, P.; Li, B.; et al. Exploring user adoption of ChatGPT: A technology acceptance model perspective. Int. J. Hum.–Comput. Interact. 2024, 41, 1431–1445. DOI: https://doi.org/10.1080/10447318.2024.2314358
  7. Okstad, J.J.; Dahlk, K.C. Developing an Interprofessional Research Infrastructure at a Mid-Sized Liberal Arts University. J. Interprof. Care 2021, 35, 39–43. DOI: https://doi.org/10.1080/13561820.2021.1981262
  8. Ertürk, R. The Effect of Teacher Autonomy on Teachers’ Professional Dedication. Int. J. Psychol. Educ. Stud. 2023, 10, 494–507.
  9. Mishra, P.; Koehler, M.J. Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge. Teach. Coll. Rec. 2006, 108, 1017–1054. DOI: https://doi.org/10.1111/j.1467-9620.2006.00684.x
  10. Hew, K.F.; Brush, T. Integrating Technology into K–12 Teaching and Learning: Current Knowledge Gaps and Recommendations for Future Research. Educ. Technol. Res. Dev. 2007, 55, 223–252. DOI: https://doi.org/10.1007/s11423-006-9022-5
  11. Gao, R.; Merzdorf, H.E.; Anwar, S.; et al. Automatic Assessment of Text-Based Responses in Post-Secondary Education: A Systematic Review. Comput. Educ. Artif. Intell. 2024, 6, 100206. DOI: https://doi.org/10.1016/j.caeai.2024.100206
  12. Celik, I.; Dindar, M.; Muukkonen, H.; et al. The Promises and Challenges of Artificial Intelligence for Teachers: A Systematic Review of Research. TechTrends 2022, 66, 616–630. DOI: https://doi.org/10.1007/s11528-022-00715-y
  13. Zhang, Y. Design of an Intelligent Q&A System for Online Education Platform Based on NLP Technology. J. Electr. Syst. 2024, 20, 2135–2145. DOI: https://doi.org/10.52783/jes.3128
  14. Oraif, I. NLP and EFL Learning: A Case Study Based on Deep Learning. J. Lang. Teach. Res. 2024, 15, 201–208. DOI: https://doi.org/10.17507/jltr.1501.22
  15. Huang, R. Design and Implementation of English Writing Aids Based on NLP. J. Electr. Syst. 2024, 20, 2178–2187. DOI: https://doi.org/10.52783/jes.3132
  16. Tu, L.; Nie, Y. Application of NLP Technology in Student Evaluation and Feedback in Teaching Quality Assurance System. J. Electr. Syst. 2024, 20, 2908–2922.
  17. Campino, J. Unleashing the Transformers: NLP Models Detect AI Writing in Education. J. Comput. Educ. 2024, 12, 645–673. DOI: https://doi.org/10.1007/s40692-024-00325-y
  18. Chary, M.; Parikh, S.; Manini, A.F.; et al. A Review of NLP in Medical Education. West. J. Emerg. Med. 2019, 20, 78–86. DOI: https://doi.org/10.5811/westjem.2018.11.39725
  19. Kharis, M.; Laksono, K.; Suhartono. Utilization of NLP Technology in Current Applications for Education and Research by Indonesian Student, Teacher, and Lecturer. J. High. Educ. Theory Pract. 2022, 22, 170–178. DOI: https://doi.org/10.33423/jhetp.v22i14.5544
  20. Stoehr, F.; Kämpgen, B.; Müller, L.; et al. NLP for Automatic Evaluation of Free-Text Answers—A Feasibility Study Based on the European Diploma in Radiology Examination. Insights Imaging 2023, 14. DOI: https://doi.org/10.1186/s13244-023-01507-5
  21. Bai, H. Design and Application of Decision Support System for Educational Management Based on Big Data. J. Electr. Syst. 2024, 20, 1645–1655. DOI: https://doi.org/10.52783/jes.3084
  22. Yessimova, S.; Rakhymzhanov, Y.; Spanova, B.; et al. Strengthening the Nexus: Policy and Legislative Reforms for University–Industry Collaboration in Kazakhstan. Theor. Pract. Res. Econ. Fields 2024, 15, 136–144. DOI: https://doi.org/10.14505/tpref.v15.1(29).13
  23. Al-Zahrani, A.M.; Alasmari, T.M. Exploring the Impact of Artificial Intelligence on Higher Education: The Dynamics of Ethical, Social, and Educational Implications. Humanit. Soc. Sci. Commun. 2024, 11, 1–13. DOI: https://doi.org/10.1057/s41599-024-03432-4
  24. Abedi, E.A.; Ackah-Jnr, F.R. First-Order Barriers Still Matter in Teachers’ Use of Technology: An Exploratory Study of Multi-Stakeholder Perspectives of Technology Integration Barriers. Int. J. Educ. Dev. Using ICT 2023, 19, 148–165.
  25. Lu, G.; Liu, Q.; Xie, K.; et al. Quality or Quantity: How Do Teachers’ Knowledge and Beliefs Persuade Them to Engage in Technology Integration in a Massive Government-Led Training Programme? Asia-Pac. Educ. Res. 2023, 32, 459–471. DOI: https://doi.org/10.1007/s40299-022-00668-z
  26. Kuo, Y.C.; Kuo, Y.T.; Abi-El-Mona, I. Mobile Learning: Pre-Service Teachers’ Perceptions of Integrating iPads into Future Teaching. Educ. Inf. Technol. 2023, 28, 6209–6230. DOI: https://doi.org/10.1007/s10639-022-11340-w
  27. Belda-Medina, J.; Kokošková, V. Integrating Chatbots in Education: Insights from the Chatbot-Human Interaction Satisfaction Model (CHISM). Int. J. Educ. Technol. High. Educ. 2023, 20, 62. DOI: https://doi.org/10.1186/s41239-023-00432-3
  28. Nazaretsky, T.; Ariely, M.; Cukurova, M.; et al. Teachers’ Trust in AI-Powered Educational Technology and a Professional Development Program to Improve It. Br. J. Educ. Technol. 2022, 53, 914–931. DOI: https://doi.org/10.1111/bjet.13232
  29. García-Alonso, E.M.; León-Mejía, A.C.; Sánchez-Cabrero, R.; et al. Training and Technology Acceptance of ChatGPT in University Students of Social Sciences: A Netcoincidental Analysis. Behav. Sci. 2024, 14, 612. DOI: https://doi.org/10.3390/bs14070612
  30. Eze, S.C.; Chinedu-Eze, V.C.; Okike, C.K.; et al. Factors Influencing the Use of E-Learning Facilities by Students in a Private Higher Education Institution in a Developing Economy. Humanit. Soc. Sci. Commun. 2020, 7, 1–15. DOI: https://doi.org/10.1057/s41599-020-00624-6
  31. Teng, M.F. Understanding teacher autonomy, teacher agency, and teacher identity: Voices from four EFL student teachers. Engl. Teach. Learn. 2019, 43, 189–212. DOI: https://doi.org/10.1007/s42321-019-00024-3
  32. Zhang, X.; Duan, X.; Wang, W.; et al. The relationship between organizational climate and teaching innovation among preschool teachers: The mediating effect of teaching efficacy. Behav. Sci. 2024, 14, 516. DOI: https://doi.org/10.3390/bs14070516
  33. Salmanpour, O.; Tabatabaei, O.; Salehi, H.; et al. Impact of the online Stoodle software program on Iranian EFL teachers' autonomy, creativity, and work engagement. Asia Pac. J. Second Foreign Lang. Educ. 2024, 9, 7. DOI: https://doi.org/10.1186/s40862-023-00227-z
  34. Mohammadi, Y.; Vinnervik, P.; Khodadad, D. The possible impact of department teaching culture on teaching styles of new teachers: A case study of a Swedish university department focused on engineering education. Educ. Sci. 2024, 14, 631. DOI: https://doi.org/10.3390/educsci14060631
  35. Shaheen, F.; Mahmood, N. Burnout and its predictors: Testing a model among public school teachers. Pak. J. Psychol. Res. 2020, 35, 355–372. DOI: https://doi.org/10.33824/PJPR.2020.35.2.19
  36. Lewis, B.; Smith, R.; Massey, C. Mirroring the networked society: Government policy, higher education, and telelearning technology in Canada. Can. J. Commun. 1999, 24, 1–16. DOI: https://doi.org/10.22230/cjc.1999v24n3a1109
  37. Pishghadam, R.; Shayesteh, S. Neuro-linguistic Programming (NLP) for Language Teachers: Revalidation of an NLP Scale. Theory Pract. Lang. Stud. 2014, 4, 2096–2104. DOI: https://doi.org/10.4304/tpls.4.10.2096-2104
  38. Al-Hafdi, F.S.; AlNajdi, S.M. The effectiveness of using chatbot-based environment on learning process, students' performances and perceptions: A mixed exploratory study. Educ. Inf. Technol. 2024, 29, 1–32. DOI: https://doi.org/10.1007/s10639-024-12671-6
  39. Zainal, M.A.; Mohd Matore, M.E.E. The influence of teachers' self-efficacy and school leaders' transformational leadership practices on teachers' innovative behaviour. Int. J. Environ. Res. Public Health 2021, 18, 6423. DOI: https://doi.org/10.3390/ijerph18126423
  40. Joshi, A.; Kale, S.; Chandel, S.; et al. Likert scale: Explored and explained. Br. J. Appl. Sci. Technol. 2015, 7, 396–403. DOI: https://doi.org/10.9734/BJAST/2015/14975
  41. Creswell, J.W. Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, 4th ed.; Pearson: Boston, MA, USA, 2012.
  42. Daher, W. Saturation in qualitative educational technology research. Educ. Sci. 2023, 13, 98. DOI: https://doi.org/10.3390/educsci13020098
  43. Park, K. Social sciences and health. In Park’s Textbook of Preventive and Social Medicine; Park, K., Ed.; Bhanot Publishers: Jabalpur, India, 2013.
  44. Culbertson, H.M. What is an Attitude? J. Ext. 1968, 6, 9. Available online: https://open.clemson.edu/joe/vol6/iss2/9/
  45. Li, W.; Zhang, X.; Li, J.; et al. An explanatory study of factors influencing engagement in AI education at the K-12 level: An extension of the classic TAM model. Sci. Rep. 2024, 14, 1–18. DOI: https://doi.org/10.1038/s41598-024-64363-3
  46. Gastaldello, G.; Streletskaya, N.; Rossetto, L. Glass half-full? A comprehensive PLS-SEM approach to explore the pandemic's effect on wine tourism intentions. Int. J. Wine Bus. Res. 2023, 35, 322–345. DOI: https://doi.org/10.1108/IJWBR-03-2022-0011
  47. Tukiran, M.; Sunaryo, W.; Wulandari, D.; et al. Optimizing education processes during the COVID-19 pandemic using the technology acceptance model. Front. Educ. 2022, 7, 903572. DOI: https://doi.org/10.3389/feduc.2022.903572
  48. Henseler, J.; Schuberth, F. Should PLS become factor-based or should CB-SEM become composite-based? Both! Eur. J. Inf. Syst. 2024, 34, 551–563. DOI: https://doi.org/10.1080/0960085X.2024.2357123
  49. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101.
  50. Legris, P.; Ingham, J.; Collerette, P. Why do people use information technology? A critical review of the technology acceptance model. Inf. Manag. 2003, 40, 191–204. DOI: https://doi.org/10.1016/S0378-7206(01)00143-4
  51. Masrom, M. Technology acceptance model and e-learning. Technol. 2007, 21, 81–85.
  52. Lee, Y.; Kozar, K.A.; Larsen, K.R. The technology acceptance model: Past, present, and future. Commun. Assoc. Inf. Syst. 2003, 12. DOI: https://doi.org/10.17705/1CAIS.01250
  53. Pett, M.A.; Lackey, N.R.; Sullivan, J.J. Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research; Sage Publications: Thousand Oaks, CA, USA, 2003. DOI: https://doi.org/10.4135/9781412984898
  54. Swisher, L.L.; Beckstead, J.W.; Bebeau, M.J. Factor analysis as a tool for survey analysis using a professional role orientation inventory as an example. Phys. Ther. 2004, 84, 784–799. DOI: https://doi.org/10.1093/ptj/84.9.784
  55. Thompson, B. Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications; American Psychological Association: Washington, DC, USA, 2004. DOI: https://doi.org/10.1037/10694-000
  56. Henson, R.K.; Roberts, J.K. Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educ. Psychol. Meas. 2006, 66, 393–416. DOI: https://doi.org/10.1177/0013164405282485
  57. Taherdoost, H.; Sahibuddin, S.; Jalaliyoon, N. Exploratory factor analysis; concepts and theory. Adv. Appl. Pure Math. 2014, 27, 375–382.
  58. Hair, J.F.; Risher, J.J.; Sarstedt, M.; et al. When to use and how to report the results of PLS-SEM. Eur. Bus. Rev. 2019, 31, 2–24. DOI: https://doi.org/10.1108/EBR-11-2018-0203