AHCI RESEARCH GROUP

Publications

Papers published in international journals,
proceedings of conferences, workshops and books.

OUR RESEARCH

Scientific Publications

How to

Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.

Show all

2024

Tan, B. S.; Ong, S. H.; Andrew, K. H. T.; Wong, T. L.; Bai, P. S.; Rao, A. P.

Usability Study of GenAI for English Learning in VR Journal Article

In: Pakistan Journal of Life and Social Sciences, vol. 22, no. 2, pp. 7367–7382, 2024, ISSN: 17274915 (ISSN).

Abstract | Links | BibTeX | Tags: Education, Educational Technology, English Language, generative artificial intelligence, Virtual Reality

@article{tan_usability_2024,

title = {Usability Study of GenAI for English Learning in VR},

author = {B. S. Tan and S. H. Ong and K. H. T. Andrew and T. L. Wong and P. S. Bai and A. P. Rao},

url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85207260177&doi=10.57239%2fPJLSS-2024-22.2.00556&partnerID=40&md5=22c640bcbf6a9c19da4eb3c263bc5617},

doi = {10.57239/PJLSS-2024-22.2.00556},

issn = {17274915 (ISSN)},

year  = {2024},

date = {2024-01-01},

journal = {Pakistan Journal of Life and Social Sciences},

volume = {22},

number = {2},

pages = {7367–7382},

abstract = {Traditional English learning environments in university often hindered by outdated focus on reading and writing, limited textbook content, insufficient speaking practice opportunities, and pre-programmed artificial intelligence (AI) in English speaking practice. This study explores the potential of leveraging VR technologies and generative AI (GenAI) to overcome these barriers. EasyEnglish is a real-time conversation game with GenAI non-player character (NPC)s. This game utilizes voice input recognition, large language model (LLM) for language assessment and text-to-speech (TTS) for NPC lip-sync animation. The content validity was assessed by 3 experts to evaluate the conversation quality. A usability test was conducted using a purposive sampling method with 7 undergraduate non-native English speakers who have less than 1 year experience in using VR technology. This study employed System Usability Scale (SUS) and Content Validity Index (CVI) metrics for assessment. The CVI result showed satisfactory agreement in conversation quality but highlighted areas for improvement in learning objectives. The SUS result revealed satisfaction in consistency of user interface (UI) and learnability of EasyEnglish, while also highlighting the need for improvement in UI, setup, and visual cues. The significance of the study lies in the GenAI's ability to provide diverse response, avoid repetitive dialogue and speak using gestures to undergraduate students. GenAI effectively identify and assess irrelevant words in conversation, provide immediate grammar and vocabulary correction and suggestion of conversation improvement accurately. Future research should focus on improving accessibility, include more multimodal interactions, and mapping learning objectives with the soft skills emphasized by the World Economic Forum (WEF). © (2024), (Elite Scientific Publications). All rights reserved.},

keywords = {Education, Educational Technology, English Language, generative artificial intelligence, Virtual Reality},

pubstate = {published},

tppubtype = {article}

}