AI Literacy, Speaking Self-Efficacy, Digital Engagement, and Speaking Anxiety as Predictors of EFL Speaking Performance
https://doi.org/10.51574/jrip.v6i2.5740
Keywords:
AI literacy, Speaking self-efficacy, Digital engagement, Speaking anxiety, EFL speaking performanceAbstract
Oral proficiency is the area in which Indonesian English majors most often fall short, and the arrival of conversational artificial intelligence has widened access to speaking practice without settling the question of who actually benefits from it. Intervention studies report average gains yet say little about the learner attributes behind them, so departments now weighing AI literacy modules are deciding without evidence on the learners themselves. This study examined how far AI literacy, speaking self-efficacy, digital engagement, and speaking anxiety predict perceived EFL speaking performance, both jointly and individually. A quantitative, non-experimental, cross-sectional correlational survey was conducted with 178 undergraduates in an English Language Education programme at a university in South Sulawesi, drawn by proportionate stratified random sampling with year of study as the stratifying variable. Five Likert scales totalling 63 items measured the four predictors and the outcome, all of them meeting the conventional item and reliability criteria. The questionnaire was administered online over four weeks in mid-semester, and the data were analysed in IBM SPSS Statistics 27 through descriptive statistics, Pearson correlations, classical assumption testing, and simultaneous multiple regression. The four predictors together accounted for 54.6 per cent of the variance in perceived speaking performance, F(4, 173) = 51.940, p < .001. Speaking self-efficacy made the largest unique contribution (β = .329, sr² = .068), followed by speaking anxiety (β = -.252, sr² = .046) and digital engagement (β = .217, sr² = .031). AI literacy remained significant while contributing least (β = .175, sr² = .018), despite a zero-order correlation of .542 with the outcome. Because the design is correlational, that contrast is read as overlap rather than as a causal pathway: the share of variance uniquely attributable to AI literacy shrinks once confidence, practice, and apprehension are taken into account. Departments planning AI literacy modules are therefore better advised to situate them within a wider affective and behavioural strategy than to adopt them as a stand-alone remedy for weak oral performance.
Downloads
References
Abbasi, M., Ghamoushi, M., & Mohammadi Zenouzagh, Z. (2024). EFL learners’ engagement in online learning context: Development and validation of potential measurement inventory. Universal Access in the Information Society, 23(3), 1467–1481. https://doi.org/10.1007/s10209-023-00993-0
Alshammari, S. H., & Alrashidi, O. (2024). The Effect of Students’ Engagement on Their Learning Achievement in EFL Online Courses: A Structural Equation Modelling Approach. International Journal of Online Pedagogy and Course Design, 14(1), 1–18. https://doi.org/10.4018/IJOPCD.357875
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191
Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman.
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185–216. https://doi.org/10.1177/135910457000100301
Butt, F. S., Malik, A., & Mahmood, K. (2026). Assessing AI literacy of university students in Pakistan: A cross-sectional survey. Digital Library Perspectives, 42(1), 141–158. https://doi.org/10.1108/DLP-06-2025-0094
Chai, T., & Sha, C. (2025). Prevention of AI learning anxiety: The chain mediation role of technophilia and AI self-efficacy under the context of teacher support. Acta Psychologica, 261, 105979. https://doi.org/10.1016/j.actpsy.2025.105979
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage Publications.
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55(6), 2503–2529. https://doi.org/10.1111/bjet.13460
Dewi, E. R., & Alam, A. A. (2025). AI Literacy, Digital Self-Efficacy, and Learning Resilience as Predictors of Academic Success Across Urban and Rural Students. Journal of Educational Science and Technology (EST), 11(2), 60. https://doi.org/10.26858/est.v11i2.75877
Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in Second Language Research: Construction, Administration, and Processing (2nd ed.). Routledge. https://doi.org/10.4324/9780203864739
Duong, C. D. (2026). AI literacy and higher education students’ digital entrepreneurial intention: A moderated mediation model of AI self-efficacy and digital entrepreneurial self-efficacy. Industry and Higher Education, 40(2), 242–255. https://doi.org/10.1177/09504222251370089
Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254. https://doi.org/10.1016/j.system.2024.103254
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate Data Analysis. Andover, UK: Cengage Learning. https://books.google.co.id/books?id=0R9ZswEACAAJ
Hermagustiana, I., Astuti, A. D., & Sucahyo, D. (2021). Do I Speak Anxiously? A Correlation of Self-Efficacy, Foreign Language Learning Anxiety and Speaking Performance of Indonesian EFL Learners. Script Journal: Journal of Linguistics and English Teaching, 6(1), 68–80. https://doi.org/10.24903/sj.v6i1.696
Hewitt, E., & Stephenson, J. (2012). Foreign Language Anxiety and Oral Exam Performance: A Replication of Phillips’s MLJ Study. The Modern Language Journal, 96(2), 170–189. https://doi.org/10.1111/j.1540-4781.2011.01174.x
Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign Language Classroom Anxiety. The Modern Language Journal, 70(2), 125–132. https://doi.org/10.1111/j.1540-4781.1986.tb05256.x
Huang, L., & Liu, M. (2026). The Rise of Digital Tutors: A Bibliometric Exploration of Intelligent Agent‐Supported Language Learning From 2005 to 2025. European Journal of Education, 61(1), e70529. https://doi.org/10.1111/ejed.70529
Istiara, F., Ab, J. S., Tama, O. H., Mahrunnisya, D., Ajeng, G. D., Adijaya, N., Saputra, D. W., & Hadi, M. S. (2025). Deep Learning Engagement as a Predictor of Academic Self-Efficacy and Language Performance. TARBIYA: Journal of Education in Muslim Society, 115–126. https://doi.org/10.15408/tjems.v12i1.46710
Janitra, M. J. O., & Anwar, K. (2022). Significant Relationship between Anxiety Level and Oral Communication Performances: The Case of English Education Learners. New Language Dimensions, 3(1), 60–70. https://doi.org/10.26740/nld.v3n1.p60-70
Jin, S. (2024). Speaking proficiency and affective effects in EFL: Vlogging as a social media‐integrated activity. British Journal of Educational Technology, 55(2), 586–604. https://doi.org/10.1111/bjet.13381
Kim, H. J., Hong, A. J., & Song, H.-D. (2019). The roles of academic engagement and digital readiness in students’ achievements in university e-learning environments. International Journal of Educational Technology in Higher Education, 16(1), 21. https://doi.org/10.1186/s41239-019-0152-3
Kline, R. B. (2023). Principles and Practice of Structural Equation Modeling. Guilford Publications. https://books.google.co.id/books?id=t2CvEAAAQBAJ
Kock, N. (2015). Common Method Bias in PLS-SEM: A Full Collinearity Assessment Approach. International Journal of e-Collaboration, 11(4), 1–10. https://doi.org/10.4018/ijec.2015100101
Li, M., Wang, Y., & Yang, X. (2025). Can Generative AI Chatbots Promote Second Language Acquisition? A Meta‐Analysis. Journal of Computer Assisted Learning, 41(4), e70060. https://doi.org/10.1111/jcal.70060
Liu, G. L., & Zhao, X. (2026). The Predictive Effects of Sociobiographical Variables, English Learning Confidence, and Digital Competence on AI‐Mediated Informal Digital Learning of English (AI‐IDLE). International Journal of Applied Linguistics, 36(2), 1641–1652. https://doi.org/10.1111/ijal.70010
Liu, M., & Xiangming, L. (2019). Changes in and Effects of Anxiety on English Test Performance in Chinese Postgraduate EFL Classrooms. Education Research International, 2019, 1–11. https://doi.org/10.1155/2019/7213925
Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3313831.3376727
Lyu, B., Lai, C., & Guo, J. (2025). Effectiveness of Chatbots in Improving Language Learning: A Meta‐Analysis of Comparative Studies. International Journal of Applied Linguistics, 35(2), 834–851. https://doi.org/10.1111/ijal.12668
MacIntyre, P. D., & Gardner, R. C. (1994). The Subtle Effects of Language Anxiety on Cognitive Processing in the Second Language. Language Learning, 44(2), 283–305. https://doi.org/10.1111/j.1467-1770.1994.tb01103.x
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041
Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104. https://doi.org/10.1111/bjet.13411
Ng Kok Wah, J. (2025). Artificial Intelligence in Language Learning: A Systematic Review of Personalization and Learner Engagement. Forum for Linguistic Studies, 7(9). https://doi.org/10.30564/fls.v7i9.10336
Okyar, H. (2023). Foreign Language Speaking Anxiety and its Link to Speaking Self-Efficacy, Fear of Negative Evaluation, Self-Perceived Proficiency and Gender. Science Insights Education Frontiers, 17(2), 2715–2731. https://doi.org/10.15354/sief.23.or388
Panggua, S., Pongsapan, N. P., Ismail, H., Patandung, Y., Rachel, & Tangirerung, J. R. (2025). AI-Enhanced Academic Speaking Skills: A Qualitative Investigation of Digital Tool Integration in Indonesian EFL University Context. Forum for Linguistic Studies, 7(8). https://doi.org/10.30564/fls.v7i8.10763
Pertiwi, P. C., Segoh, D., & Rohmadhani, A. (2025). Artificial Intelligence in Academic Environments: Reducing or Increasing Foreign Language Anxiety? Inspiring: English Education Journal, 8(1), 100–131. https://doi.org/10.35905/inspiring.v8i1.13009
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879
Ren, J., Nik, W. S. B. W., Wang, S., & Wang, H. (2025). Language evaluation anxiety and self-appraisal ability: Their impact on students’ oral English performance. Environment and Social Psychology, 10(7). https://doi.org/10.59429/esp.v10i7.3905
Shi, W., & Shakibaei, G. (2025). Insights Into the Effectiveness of Artificial Intelligence‐Integrated Speaking Instruction in Enhancing Speaking Skills and Social–Emotional Competence as Well as Reducing Demotivation and Shyness. European Journal of Education, 60(3), e70174. https://doi.org/10.1111/ejed.70174
Shirvan, M. E., Khajavy, G. H., Nazifi, M., & Taherian, T. (2018). Longitudinal examination of adult students’ self-efficacy and anxiety in the course of general English and their prediction by ideal self-motivation: Latent growth curve modeling. New Horizons in Adult Education and Human Resource Development, 30(4), 23–41. https://doi.org/10.1002/nha3.20230
Singh, E., Vasishta, P., & Singla, A. (2025). AI-enhanced education: Exploring the impact of AI literacy on generation Z’s academic performance in Northern India. Quality Assurance in Education, 33(2), 185–202. https://doi.org/10.1108/QAE-02-2024-0037
Sok, S., & Shin, H. W. (2025). Do Interactions with CHATGPT Influence L2 Learners’ Oral Speaking Ability, Summarization Ability, and Perceptions of Generative AI Tasks? TESOL Quarterly, 59(S1). https://doi.org/10.1002/tesq.70001
Sun, P. P., & Zhang, L. J. (2024). Investigating the Effects of Chinese University Students’ Online Engagement on Their EFL Learning Outcomes. The Asia-Pacific Education Researcher, 33(4), 747–757. https://doi.org/10.1007/s40299-023-00800-7
Syairofi, A., Emilia, E., & Purnawarman, P. (2025). The use of ChatGPT in the Indonesian ELT context: A systematic review. Journal of Research on English and Language Learning (J-REaLL), 6(2), 217–234. https://doi.org/10.33474/j-reall.v6i2.23552
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn & Bacon/Pearson Education.
Waluyo, B., & Pratiwi, D. I. (2025). AI chatbot-assisted English learning and willingness to communicate: A narrative meta-synthesis of evidence from Asian English as a foreign language contexts. The JALT CALL Journal, 21(3), 102884. https://doi.org/10.29140/jaltcall.v21n3.102884
Wang, C., Li, X., & Zou, B. (2025). Revisiting Integrated Model of Technology Acceptance Among the Generative AI ‐Powered Foreign Language Speaking Practice: Through the Lens of Positive Psychology and Intrinsic Motivation. European Journal of Education, 60(1), e70054. https://doi.org/10.1111/ejed.70054
Xu, S., Chen, P., & Zhang, G. (2024). Exploring the impact of the use of ChatGPT on foreign language self-efficacy among Chinese students studying abroad: The mediating role of foreign language enjoyment. Heliyon, 10(21), e39845. https://doi.org/10.1016/j.heliyon.2024.e39845
Yang, C., Shao, J., Zhang, M., & Xu, H. (2026). Integrating Multimodality in Emotion Moderation: The Effects of Multimodal AI on EFL Speakers’ Boredom, Enjoyment, and Anxiety. International Journal of Applied Linguistics, ijal.70201. https://doi.org/10.1111/ijal.70201
Yi, Z., & Siquan, X. (2025). The Impact of Pre‐Service Language Teachers’ Basic Psychological Needs on Behavioural Intentions to Utilise Artificial Intelligence ( AI ) in Teaching: AI Literacy and Self‐Efficacy as Mediators. European Journal of Education, 60(3), e70160. https://doi.org/10.1111/ejed.70160
Yuan, N., Yu, Q., & Liu, W. (2025). The impact of digital literacy on learning outcomes among college students: The mediating effect of digital atmosphere, self-efficacy for digital technology and digital learning. Frontiers in Education, 10, 1641687. https://doi.org/10.3389/feduc.2025.1641687
Yunita, R., Febrilyantri, C., Hayasaki, A., & Ni’am, M. I. (2025). Bridging the Affective-Linguistic Gap: A Mixed-Methods Exploration of AI-Assisted Speaking Practice and Willingness to Communicate. Jurnal Pendidikan Progresif, 15(4), 2760–2780. https://doi.org/10.23960/jpp.v15i4.pp2760-2780
Zhang, Q., Pan, X., & Fan, J. (2025). Uncovering the Mediating Effects of AI Trust and Self‐Efficacy on Engagement in Human‐ GENAI Communication for EFL Learning. European Journal of Education, 60(4), e70336. https://doi.org/10.1111/ejed.70336
Zou, B., Wang, C., Yan, Y., Du, X., & Ji, Y. (2025). Exploring English as a Foreign Language Learners’ Adoption and Utilisation of ChatGPT for Speaking Practice Through an Extended Technology Acceptance Model. International Journal of Applied Linguistics, 35(2), 689–704. https://doi.org/10.1111/ijal.12658
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Sutrah Norman, Muhammad Agung

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.




