Virtual Teaching Assistants: The Role of AI Chatbots in Student Support Services
DOI:
https://doi.org/10.62951/icgel.v2i2.200Keywords:
AI, Cost-Effectiveness, Learning Outcomes, Student Support, VTAsAbstract
The integration of artificial intelligence chatbots as virtual teaching assistants (VTAs) represents a transformative shift in student support services within higher education. This study investigates the implementation, effectiveness, and impact of AI-powered chatbots in providing academic support, administrative assistance, and personalized guidance to university students. Employing a longitudinal mixed-methods approach over 18 months, this research analyzed data from 2,347 students across 15 universities that deployed VTA systems, examining interaction patterns, student satisfaction, learning outcomes, and cost-effectiveness. Quantitative analysis of 487,392 chatbot interactions revealed that VTAs successfully handled 78.4% of student queries without human intervention, with response times averaging 3.2 seconds compared to 4.7 hours for traditional support channels. Qualitative findings from focus groups and interviews highlighted students' appreciation for 24/7 availability, immediate responses, and non-judgmental interactions, while also revealing concerns about empathy limitations, complex query handling, and the desire for human connection in critical situations. The study demonstrates that VTAs significantly improve support service accessibility and efficiency while reducing operational costs by an average of 43%. However, optimal implementation requires careful integration with human support staff, continuous training of AI systems, and attention to equity issues in digital access. This research contributes to understanding how AI can augment rather than replace human educators, offering evidence-based recommendations for implementing VTA systems that enhance student success while maintaining the human elements essential to quality education.
References
Adamopoulou, E., & Moussiades, L. (2023). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006
Alhassan, T., & Alquahtani, F. (2024). Intelligent tutoring systems: A comprehensive historical survey with recent developments. Technology, Knowledge and Learning, 29(1), 1-29. https://doi.org/10.1007/s10758-023-09687-y
Bai, Y., Jones, C., & Moss, G. (2024). Understanding students' perceptions of AI chatbot learning companion: An empirical study. Educational Technology Research and Development, 72(1), 89-112. https://doi.org/10.1007/s11423-023-10298-x
Bashir, A., Khwaja, M. G., Turi, J. A., & Toheed, H. (2023). ChatGPT and generative artificial intelligence for higher education: A systematic review. International Journal of Educational Management, 37(6/7), 1283-1304. https://doi.org/10.1108/IJEM-04-2023-0176
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa
Chaudhry, M. A., & Kazim, E. (2024). Artificial intelligence in education (AIEd): A high-level academic and industry note 2023. AI and Ethics, 4(1), 157-165. https://doi.org/10.1007/s43681-023-00296-2
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(1), Article 22. https://doi.org/10.1186/s41239-023-00392-8
Cunningham-Nelson, S., Boles, W., Trouton, L., & Margerison, E. (2024). A review of chatbots in education: Practical steps forward. Technology, Knowledge and Learning, 29(1), 163-188. https://doi.org/10.1007/s10758-023-09674-3
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340. https://doi.org/10.2307/249008
Dimitriadis, Y., & Goodyear, P. (2024). Forward-oriented design for learning: Illustrating the approach. Research in Learning Technology, 32. https://doi.org/10.25304/rlt.v32.2942
Escalante, J., Ruiz, L., & Garcia, M. (2024). Virtual teaching assistants and student engagement: A quantitative analysis in higher education. Computers & Education, 210, 104945. https://doi.org/10.1016/j.compedu.2023.104945
Garcia-Penalvo, F. J., & Vazquez-Ingelmo, A. (2023). What do we mean by GenAI? A systematic mapping of the evolution, trends, and techniques involved in generative AI. International Journal of Interactive Multimedia and Artificial Intelligence, 8(4), 7-16. https://doi.org/10.9781/ijimai.2023.07.009
Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87-105. https://doi.org/10.1016/S1096-7516(00)00016-6
Goel, A. K., & Polepeddi, L. (2022). Jill Watson: A virtual teaching assistant for online education. In L. A. Zheng, A. Barbosa, & F. Costello (Eds.), Learning design and technology (pp. 120-143). Springer. https://doi.org/10.1007/978-3-031-18663-3_6
Hwang, G. J., & Chang, C. Y. (2023). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Jeon, J., & Lee, S. (2023). Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT. Education and Information Technologies, 28(12), 15873-15892. https://doi.org/10.1007/s10639-023-11834-1
Kim, N. J., & Kim, M. K. (2024). Teachers' perceptions of using an artificial intelligence-based educational tool for scientific writing. International Journal of Educational Research, 123, 102287. https://doi.org/10.1016/j.ijer.2023.102287
Kuh, G. D., Kinzie, J., Buckley, J. A., Bridges, B. K., & Hayek, J. C. (2023). Piecing together the student success puzzle: Research, propositions, and recommendations (2nd ed.). Jossey-Bass.
Limo, C. J., & Yu, J. (2024). Chatbot-based student support services: Design principles and implementation strategies. Educational Technology & Society, 27(1), 114-129. https://doi.org/10.30191/ETS.202401_27(1).0008
Meyer, J. G., Urbanowicz, R. J., Martin, P. C. N., O'Connor, K., Li, R., Peng, P. C., ... & Moore, J. H. (2023). ChatGPT and large language models in academia: Opportunities and challenges. BioData Mining, 16(1), Article 20. https://doi.org/10.1186/s13040-023-00339-9
Okonkwo, C. W., & Ade-Ibijola, A. (2023). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033. https://doi.org/10.1016/j.caeai.2021.100033
Ouyang, F., Zheng, L., & Jiao, P. (2024). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 29(1), 2893-2925. https://doi.org/10.1007/s10639-022-11077-w
Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1988). SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(1), 12-40.
Reeves, B., & Nass, C. (1996). The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press.
Rospigliosi, P. A. (2023). Artificial intelligence in teaching and learning: What questions should we ask of ChatGPT? Interactive Learning Environments, 31(1), 1-3. https://doi.org/10.1080/10494820.2023.2180191
Strzelecki, A. (2023). Students' acceptance of ChatGPT in higher education: An extended unified theory of acceptance and use of technology. Innovative Higher Education, 48(5), 741-761. https://doi.org/10.1007/s10755-023-09686-1
Tate, T., Doroudi, S., Ritchie, D., & Xu, Y. (2024). Educational research and AI-generated writing: Confronting the coming tsunami. Educational Researcher, 53(1), 47-53. https://doi.org/10.3102/0013189X231220924
Winkler, R., & Söllner, M. (2023). Unleashing the potential of chatbots in education: A state-of-the-art analysis. Academy of Management Learning & Education, 22(3), 433-455. https://doi.org/10.5465/amle.2022.0393
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2023). Are we there yet? A systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4, Article 654924. https://doi.org/10.3389/frai.2021.654924
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2023). Systematic review of research on artificial intelligence applications in higher education—where are the educators? International Journal of Educational Technology in Higher Education, 16(1), Article 39. https://doi.org/10.1186/s41239-019-0171-0
