Speakers
Description
The 2025 National High School Graduation Exam in Vietnam introduces changes to the English test format with more diverse question types, which may lead to some difficulties for both teachers and students regarding teaching and learning documents for practice. This study explores the use of ChatGPT in generating English practice tests aligned with the new 2025 national high school graduation exam format and evaluates the quality of the generated exams in terms of reliability, validity, and difficulty. Conducted at two high schools in a northern province of Vietnam, the research involved 85 to 154 students in grade 12 and followed five stages: designing prompts, gathering expert feedback, revising prompts, implementing the test with students, and evaluating outcomes. The practice test design process was carried out through eight stages: creating test matrix, developing prompt templates, testing and refining prompts, storing as validated template, including topics from the 2018 syllabus, creating questions for each part, reviewing and refining each part, and compiling and formatting final test. A combination of expert judgment and statistical analysis was employed to evaluate the quality of the test. Expert feedback assessed face validity and content validity through Likert questionnaires. Students’ practice test results were analyzed using SPSS to examine construct validity, reliability (Cronbach’s alpha), and difficulty of items, tests. Findings show that with refined prompts, ChatGPT can create reasonably valid, reliable, and difficult practice tests by using the 8 stages of practice test design.
Biography
Nguyen Thi Hong Minh
Faculty of Foreign Languages Education, Thai Nguyen University of Education, Vietnam
Dr. Nguyen Thi Hong Minh is currently a lecturer of English language education at Thai Nguyen University of Education. Her research interests include innovation practices in foreign language teaching and learning, professional development for in-service teachers, and English curriculum design and evaluation. Recently, she has been motivated by the integration of technologies in English instruction, including the use of AI for learners’ proficiency development. She was recognized by Ministry of Education and Training for her supervision of students’ researcher papers which were awarded 3rd prize in 2023 and 2024.
Dinh Dam Hai Anh
Faculty of Foreign Languages Education, Thai Nguyen University of Education, Vietnam
Dinh Dam Hai Anh is an undergraduate student majoring in English language education at the Faculty of Foreign Languages Education, Thai Nguyen University of Education. With a strong interest in exploring and applying artificial intelligence in English language learning and teaching, he has actively volunteered in various academic projects, including the TEMA project (Teaching English Multilingually through Art).
Vu Hoang Dung
Faculty of Foreign Languages Education, Thai Nguyen University of Education, Vietnam
Vu Hoang Dung is currently studying English language education at the Faculty of Foreign Languages Education, Thai Nguyen University of Education. With an interest in technology and pedagogy, she is especially keen on applying artificial intelligence to enhance English learning experiences. Dung has also taken part in academic and extracurricular projects as an active volunteer, most notably her involvement in the TEMA (Teaching English Multilingually through Art).
