Assessment design through co-creation
Student-staff partnership in evaluating the impact of artificial intelligence
DOI:
https://doi.org/10.15173/ijsap.v9i1.5802Keywords:
partnership, co-creation, change, AI, artificial intelligence, ChatGPT, assessment, higher educationAbstract
This case study reports on a co-creation initiative that explored the use of generative artificial intelligence (AI) technologies in the context of higher education assessments. The AI Co-Creators project aimed to promote dialogue between students and staff on the impact of AI with the objective of using AI tools more effectively. The case study presents a collaborative partnership which focused on evaluating ChatGPT-generated output in response to diverse coursework assessments on an undergraduate medical sciences programme. The co-design of evaluation criteria and key findings are presented and resultant challenges faced by students and staff are explored through dialogue, interview, and thematic analysis. The value of the student-staff collaboration is explored from the perspective of the student, staff, and institution, while the benefits, limitations and recommendations for future co-creation projects are presented in the context of AI and higher education assessment and learning.
Downloads
References
Biggs, J. (2003). Aligning teaching for constructing learning. Higher Education Academy. https://www.advance-he.ac.uk/knowledge-hub/aligning-teaching-constructing-learning
Biggs, J., Tang, C., & Kennedy, G. (2022). Teaching for quality learning at university (5th ed.). Open University Press, McGraw Hill Education.
Bottomley, S., & Denny, P. (2011). A participatory learning approach to biochemistry using student authored and evaluated multiple‐choice questions. Biochemistry and Molecular Biology Education, 39(5), 352–3 61. https://doi.org/10.1002/bmb.20526
Boud, D., Ajjawi, R., Dawson, P., & Tai, J. (2018). Developing evaluative judgement in higher education. Routledge, London. https://doi.org/10.4324/9781315109251
Bovill, C. (2020). Co-creating learning and teaching: Towards relational pedagogy in higher education. Critical publishing.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology (vol. 2). American Psychological Association. https://doi.org/10.1037/13620-004
Cabral, A., Fuller, S., De Wilde, J., Khama, K., & Melsen, M. (2023). Curriculum enhancement through co-creation: Fostering student-educator partnerships in higher education. International Journal for Students as Partners, 7(2), 111–1 23. https://doi.org/10.15173/ijsap.v7i2.5280
Carless, D. (2005). Prospects for the implementation of assessment for learning. Assessment in Education: Principles, Policy & Practice, 12(1), 39–54. https://doi.org/10.1080/0969594042000333904
Colson, N., Shuker, M.-A., & Maddock, L. (2022). Switching on the creativity gene: A co-creation assessment initiative in a large first year genetics course. Assessment & Evaluation in Higher Education, 47(8), 1149–1166. https://doi.org/10.1080/02602938.2021.2011133
Cook-Sather, A. (2006). Sound, presence, and power:“Student voice” in educational research and reform. Curriculum inquiry, 36(4), 359–390. https://doi.org/10.1111/j.1467-873X.2006.00363.x
Cook‐Sather, A. (2011). Teaching and learning together: College faculty and undergraduates cocreate a professional development model. To Improve the Academy, 29(1), 219–232. https://doi.org/10.3998/tia.17063888.0029.020
Deeley, S. J., & Bovill, C. (2017). Staff student partnership in assessment: Enhancing assessment literacy through democratic practices. Assessment & Evaluation in Higher Education, 42(3), 463–4 77. https://doi.org/10.1080/02602938.2015.1126551
Dollinger, M. (2018). Technology for the scalability of co-creation with students. Australasian Society for Computers in Learning in Tertiary Education. https://doi.org/10.26181/22758389.v1
Doyle, E., Buckley, P., & Whelan, J. (2019). Assessment co-creation: An exploratory analysis of opportunities and challenges based on student and instructor perspectives. Teaching in Higher Education, 24(6). https://doi.org/10.1080/13562517.2018.1498077
Falchikov, N. (2013). Improving assessment through student involvement: Practical solutions for aiding learning in higher and further education. Routledge. https://doi.org/10.4324/9780203220993
Gamage, K. A., Dehideniya, S. C., Xu, Z., & Tang, X. (2023). ChatGPT and higher education assessments: More opportunities than concerns? Journal of Applied Learning and Teaching, 6(2). https://doi.org/10.37074/jalt.2023.6.2.32
Hardy, J., Bates, S. P., Casey, M. M., Galloway, K. W., Galloway, R. K., Kay, A. E., Kirsop, P., & McQueen, H. A. (2014). Student-generated content: Enhancing learning through sharing multiple-choice questions. International Journal of Science Education, 36(13), 2180–2194. https://doi.org/10.1080/09500693.2014.916831
Healey, M. (2014). Students as partners in learning and teaching in higher education [Workshop, 2014, 4 February]. University College Cork.
Healey, M., & Healey, R. (2019). Essential frameworks for enhancing student success: Student engagement through partnership. AdvanceHE. https://www.advance-he.ac.uk/guidance/teaching-and-learning/essential-frameworks-enhancing-student-success
Holmes, W., & Miao, F. (2023). Guidance for generative AI in education and research. UNESCO Publishing. https://www.unesco.org/en/articles/guidance-generative-ai-education-and-research
Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605
Johnson, M. (2021). Teaching excellence in the context of business and management education: Perspectives from Australian, British and Canadian universities. The International Journal of Management Education, 19(3), 100508. https://doi.org/10.1016/j.ijme.2021.100508
Kumar, V. R., & Raman, R. (2022, 26-26 March). Student perceptions on artificial intelligence (AI) in higher education. 2022 IEEE Integrated STEM Education Conference (ISEC). https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10025165
Liu, N.-F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279–290. https://doi.org/10.1080/13562510600680582
Luo, J. (2024). A critical review of GenAI policies in higher education assessment: a call to reconsider the “originality” of students’ work. Assessment & Evaluation in Higher Education, 49(5), 651–664. https://doi.org/10.1080/02602938.2024.2309963
Mavondo, F. T., Tsarenko, Y., & Gabbott, M. (2004). International and local student satisfaction: Resources and capabilities perspective. Journal of Marketing for Higher Education, 14(1), 41–60. https://doi.org/10.1300/J050v14n01_03
McLeod, J. (2011). Student voice and the politics of listening in higher education. Critical studies in education, 52(2), 179–189. https://doi.org/10.1080/17508487.2011.572830
Mercer-Mapstone, L., & Bovill, C. (2020). Equity and diversity in institutional approaches to student–staff partnership schemes in higher education. Studies in Higher Education, 45(12), 2541–2557. https://doi.org/10.1080/03075079.2019.1620721
OpenAI. (2024). https://openai.com/chatgpt
Palmer, E., & Devitt, P. (2006). Constructing multiple choice questions as a method for learning. Annals Academy of Medicine Singapore, 35(9), 604–608. https://www.annals.edu.sg/pdf/35VolNo9Sep2006/V35N9p604.pdf
Perkins, M. (2023). Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. Journal of university teaching & learning practice, 20(2). https://doi.org/10.53761/1.20.02.07
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 342–363. https://doi.org/10.37074/jalt.2023.6.1.9
Sabzalieva, E., & Valentini, A. (2023). ChatGPT and artificial intelligence in higher education: Quick start guide. UNESCO International Institute for Higher Education in Latin America and the Caribbean. https://eduq.info/xmlui/handle/11515/38828
Smith, C. D., Worsfold, K., Davies, L., Fisher, R., & McPhail, R. (2013). Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’. Assessment & Evaluation in Higher Education, 38(1), 44–60. https://doi.org/10.1080/02602938.2011.598636
Strydom, F., & Loots, S. (2020). The student voice as contributor to quality education through institutional design. South African Journal of Higher Education, 34(5), 20–3 4. https://hdl.handle.net/10520/ejc-high-v34-n5-a2
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.17
Univeristy College London (UCL). (2024a). AI Co-Creators projects. https://www.ucl.ac.uk/changemakers/ai-co-creators-projects
Univeristy College London (UCL). (2024b). UCL ChangeMakers. https://www.ucl.ac.uk/changemakers/
Webb, M. (2023). Generative AI - a primer. An introduction to generative artificial intelligence technology and its implications on education. Jisc. https://www.jisc.ac.uk/reports/generative-ai-a-primer
Yu, F.-Y., & Liu, Y. (2008). The comparative effects of student question-posing and question-answering strategies on promoting college students’ academic achievement, cognitive and metacognitive strategies use. Journal of Education and Psychology, 31(3), 25–52.
Zarandi, N., Soares, A. M., & Alves, H. (2022). Student roles and behaviors in higher education co-creation–a systematic literature review. International Journal of Educational Management, 36(7), 1297–1320. https://doi.org/10.1108/IJEM-08-2021-0317
Zouhaier, S. (2023). The impact of artificial intelligence on higher education: An empirical study. European Journal of Educational Sciences, 10(1), 17–33.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Andrew Williams, Ellie Ingle
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process - this applies to the submitted, accepted, and published versions of the manuscript. This can lead to productive exchanges, as well as earlier and greater citation of published work (see The Effect of Open Access).
