Article

Fairness, Bias, and Ethics in AI: Exploring the Factors Affecting Student Performance

Downloads

Omughelli , D., Gordon, N., & Al Jaber, T. (2024). Fairness, Bias, and Ethics in AI: Exploring the Factors Affecting Student Performance. Journal of Intelligent Communication, 3(2), 100–110. https://doi.org/10.54963/jic.v4i1.306

Authors

The use of artificial intelligence (AI) as a data science tool for education has enormous potential for increasing student performance and course outcomes. However, the growing concern about fairness, bias, and ethics in AI systems requires a careful examination of these issues in an educational context. Using AI and predictive modelling tools, this paper explores the aspects influencing student performance and course success. The Open University Learning Analytics Dataset (OULAD) is analysed using several AI techniques (logistic regression and random forest) in this study to reveal insights about fairness, ethics, and potential biases. This dataset has been used by hundreds of studies to explore how educational data mining can provide information on students. However, potential bias or unfairness in that dataset could undermine the results and any conclusions made from them. To gain insights into the dataset's properties, this was analysed using a typical data science methodology, which included data collecting, cleaning, and exploratory data analysis using Python. By applying AI-based predictive models, this study aims to detect potential biases and their impact on student outcomes. Fairness and ethical considerations are central to the analysis as the representation of various demographic groups and any disparities are evaluated in course results. The goal is to provide useful insights on the proper use of AI in education, while also maintaining equitable and transparent decision-making procedures. The findings shed light on the complicated interplay between artificial intelligence, fairness, and ethics in the context of student performance and course success. As artificial intelligence continues to influence the educational landscape, this study will provide useful ideas for encouraging fairness and minimising biases, resulting in a more inclusive and equal learning environment.

Keywords:

artificial intelligence education fairness bias ethics predictive modelling

Author Biographies

Doris was an MSc postgraduate student at the University of Hull, within the centre of excellence in Data Science, Artificial Intellgence and Modelling (DAIM). Her dissertation topic built on prior work of Neil and Tareq, looking at fairness and bias, as well as wider interest in learning analytics.

Neil is a professor in Computer Science.at the University of Hull in England. Neil is also a National Teaching Fellow, and a Principal Fellow of AdvanceHE. Neil has produced several sector level reports for AdvanceHE, with significant ones on the way that technology enhanced learning can enable flexible pedagogy, on the role of assessment in education, and on computing education. Neil is chair of the British Computer Societies Ethics specialist group and is recognised for his work on ethics and AI. His research interests include applications of computer science to enable true technology enhanced learning, issues around sustainable development, as well as more discipline specific work on applications of computer algebra and formal methods. He has published over 150 research publications.
 
Tareq is a lecturer in Computer Science. His Ph.D. research was on designing and ranking mobile health apps. Since then, Tareq has been teaching and researching in Artificial Intelligence, teaching a variety of topics around machine learning in the centre of excellence in Data Science, Artificial Intelligence and Modelling (DAIM).
 

Highlights

  • Provides some insights into the challenges of fair use of learning analytics
  • Shows some of the effective AI techniques for analysing educational data
  • Reveals the challenges of fair and unbiassed data in machine learning
  • Gives recommendations to researchers and institutions on analysing educational data and in developing inclusive education

References

  1. Zlatkin-Troitschanskaia, O.; Shavelson, R.J.; Pant, H.A. Assessment of Learning Outcomes in Higher Education. In Handbook on Measurement, Assessment, and Evaluation in Higher Education, 2nd ed.; Secolsky, C., Denison, D.B., Eds.; Routledge: New York, NY, USA, 2017; pp. 686–698.
  2. Michelsen, S.; Sweetman, R.; Stensaker, B.; Bleiklie, I. Shaping Perceptions of a Policy Instrument: The Political-Administrative Formation of Learning Outcomes in Higher Education in Norway and England. Higher Educ. Policy 2016, 29, 399–417.
  3. OECD. Education at a Glance 2017: OECD Indicators; OECD Publishing: Paris, France, 2017; pp. 1–456.
  4. Bird, E.; Fox-Skelly, J.; Jenner, N.; Larbey, R.; Weitkamp E.; Winfield, A. The Ethics of Artificial Intelligence: Issues and Initiatives; Panel for the Future of Science and Technology: Brussels, Belgium, 2020; pp. 1–128.
  5. Varona, D.; Suárez, J.L. Discrimination, Bias, Fairness, and Trustworthy AI. Appl. Sci. 2022, 12, 5826.
  6. Zhao, J.; Wang, T.; Yatskar, M.; Ordonez, V.; Chang, K. Men Also Like Shopping: Reducing Gender Bias Amplification Using Corpus-level Constraints. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark, 7–11 September 2017.
  7. Zhou, J.; Chen, F.; Holzinger, A. Towards Explainability for AI Fairness. In xxAI-Beyond Explainable AI: International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers, 1st ed.; Holzinger, A., Goebel, R., Fong, R., Moon, T., Müller, K.R., Samek, W., Eds.; Springer: Cham, Switzerland, 2020; pp. 375–386.
  8. Park, J.H.; Choi, H.J. Factors Influencing Adult Learners’ Decision to Drop out or Persist in Online Learning. J. Educ. Technol. Soc. 2009, 12, 207–217.
  9. Xu, D.; Jaggars, S. Adaptability to Online Learning: Differences Across Types of Students and Academic Subject Areas; Community College Research Center, Teachers College, Columbia University: New York, NY, USA, February 2013.
  10. AERA. Code of Ethics. Educ. Res. 2011, 40, 145–156.
  11. Akgun, S.; Greenhow, C. Artificial Intelligence in Education: Addressing Ethical Challenges in K-12 Settings. AI Ethics 2022, 2, 431–440.
  12. Holstein, K.; Vaughan, J.W.; Daumé, H.; Dudik, M.; Wallach, H. Improving Fairness in Machine Learning Systems: What do Industry Practitioners Need? In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4–9 May 2019.
  13. Danijel, K.; Vedran, J.; Goran, D. Machine Learning in Education—A Survey of Current Research Trends. In Proceedings of the 29th DAAAM International Symposium on Intelligent Manufacturing and Automation, Zadar, Croatia, 24–27 October 2018.
  14. UNESCO. Beijing Consensus on Artificial Intelligence and Education. In Proceedings of the International Conference on Artificial Intelligence and Education, Planning Education in the AI Era: Lead the Leap, Beijing, China, 16–18 May 2019.
  15. Pedro, F.; Subosa, M.; Rivas, A.; Valverde, P. Artificial Intelligence in Education: Challenges and Opportunities for Sustainable Development; UNESCO: Paris, France, 2019.
  16. Ali, S., Payne, B.H.; Williams, R.; Park, H.W.; Breazeal, C. Constructionism, Ethics, and Creativity: Developing Primary and Middle School Artificial Intelligence Education. In Proceedings of the EduAI19: International Workshop on Education in Artificial Intelligence K-12, Macao, China, 28 April 2019.
  17. Autonomous and Intelligent Systems. Available online: https://standards.ieee.org/initiatives/autonomous-intelligence-systems/ (accessed on 13 April 2023).
  18. Kuzilek J.; Hlosta M.; Zdrahal, Z. Open University Learning Analytics Dataset. Sci. Data 2017, 4, 1–8.
  19. McKinney, W. Data Structures for Statistical Computing in Python. In Proceedings of the 9th Python in Science Conference, Austin, TX, USA, 28 June–3 July 2010; pp. 51–56.
  20. Harris, C.R.; Millman, K.J.; Van Der Walt, S.J.; Gommers, R.; Virtanen, P.; Cournapeau, D.; Wieser, E.; Taylor, J.; Berg, S.; Smith, N.J.; et al. Array Programming with NumPy. Nature 2020, 585, 357–362.
  21. Brownlee, J. Better Machine Learning: Model Evaluation, Hyperparameter Tuning, and Error Analysis with Scikit-Learn. Machine Learning Mastery, 2020.
  22. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-Learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830.
  23. Bayrak, T.; Gulati, A. The Role of Gender on Student Success. Int. J. Inf. Commun. Technol. Educ. 2015, 11, 1–17.
  24. Cavanaugh, J.K.; Jacquemin, S.J. A Large Sample Comparison of Grade Based Student Learning Outcomes in Online vs. Face-to-Face Courses. Online Learn. 2015, 19, 25–32.
  25. Vella, E.J.; Turesky, E.F.; Hebert, J. Predictors of Academic Success in Web-Based Courses: Age, GPA, and Instruction Mode. Qual. Assur. Educ. 2016, 24, 586–600.
  26. Eom, S.B.; Ashill, N.; Wen, H.J. The Determinants of Students’ Perceived Learning Outcomes and Satisfaction in University Online Education: An Empirical Investigation. Decis. Sci. J. Innovative Educ. 2006, 4, 215–235.
  27. Patton, M.Q. A Transcultural Global Systems Perspective: In Search of Blue Marble Evaluators. Can. J. Program Eval. 2016, 30, 374–390.
  28. Burgstahler, S.; Moore, E. Making Student Services Welcoming and Accessible Through Accommodations and Universal Design. J. Postsecond. Educ. Disability 2009, 21, 155–174.
  29. Gregori, P.; Martínez, V.; Moyano-Fernández, J.J. Basic Actions to Reduce Dropout Rates in Distance Learning. Eval. Program Plann. 2018, 66, 48–52.
  30. Amro, H.J.; Mundy, M.A.; Kupczynski, L. The Effects of Age and Gender on Student Achievement in Face-to-Face and Online College Algebra Classes. Res. Higher Educ. J. 2015, 27.
  31. Henrie, C.R.; Halverson, L.R.; Graham, C.R. Measuring Student Engagement in Technology-Mediated Learning: A Review. Comput. Educ. 2015, 90, 36–53.
  32. Buckley, P.; Doyle, E. Gamification and Student Motivation. Interact. Learn. Environ. 2016, 24, 1162–1175.
  33. Subhash, S.; Cudney, E.A. Gamified Learning in Higher Education: A Systematic Review of the Literature. Comput. Hum. Behav. 2018, 87, 192–206.