AI Literacy, Speaking Self-Efficacy, Digital Engagement, and Speaking Anxiety as Predictors of EFL Speaking Performance

https://doi.org/10.51574/jrip.v6i2.5740

Authors

Keywords:

AI literacy, Speaking self-efficacy, Digital engagement, Speaking anxiety, EFL speaking performance

Abstract

Oral proficiency is the area in which Indonesian English majors most often fall short, and the arrival of conversational artificial intelligence has widened access to speaking practice without settling the question of who actually benefits from it. Intervention studies report average gains yet say little about the learner attributes behind them, so departments now weighing AI literacy modules are deciding without evidence on the learners themselves. This study examined how far AI literacy, speaking self-efficacy, digital engagement, and speaking anxiety predict perceived EFL speaking performance, both jointly and individually. A quantitative, non-experimental, cross-sectional correlational survey was conducted with 178 undergraduates in an English Language Education programme at a university in South Sulawesi, drawn by proportionate stratified random sampling with year of study as the stratifying variable. Five Likert scales totalling 63 items measured the four predictors and the outcome, all of them meeting the conventional item and reliability criteria. The questionnaire was administered online over four weeks in mid-semester, and the data were analysed in IBM SPSS Statistics 27 through descriptive statistics, Pearson correlations, classical assumption testing, and simultaneous multiple regression. The four predictors together accounted for 54.6 per cent of the variance in perceived speaking performance, F(4, 173) = 51.940, p < .001. Speaking self-efficacy made the largest unique contribution (β = .329, sr² = .068), followed by speaking anxiety (β = -.252, sr² = .046) and digital engagement (β = .217, sr² = .031). AI literacy remained significant while contributing least (β = .175, sr² = .018), despite a zero-order correlation of .542 with the outcome. Because the design is correlational, that contrast is read as overlap rather than as a causal pathway: the share of variance uniquely attributable to AI literacy shrinks once confidence, practice, and apprehension are taken into account. Departments planning AI literacy modules are therefore better advised to situate them within a wider affective and behavioural strategy than to adopt them as a stand-alone remedy for weak oral performance.

Downloads

Download data is not yet available.

References

Abbasi, M., Ghamoushi, M., & Mohammadi Zenouzagh, Z. (2024). EFL learners’ engagement in online learning context: Development and validation of potential measurement inventory. Universal Access in the Information Society, 23(3), 1467–1481. https://doi.org/10.1007/s10209-023-00993-0

Alshammari, S. H., & Alrashidi, O. (2024). The Effect of Students’ Engagement on Their Learning Achievement in EFL Online Courses: A Structural Equation Modelling Approach. International Journal of Online Pedagogy and Course Design, 14(1), 1–18. https://doi.org/10.4018/IJOPCD.357875

Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191

Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman.

Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185–216. https://doi.org/10.1177/135910457000100301

Butt, F. S., Malik, A., & Mahmood, K. (2026). Assessing AI literacy of university students in Pakistan: A cross-sectional survey. Digital Library Perspectives, 42(1), 141–158. https://doi.org/10.1108/DLP-06-2025-0094

Chai, T., & Sha, C. (2025). Prevention of AI learning anxiety: The chain mediation role of technophilia and AI self-efficacy under the context of teacher support. Acta Psychologica, 261, 105979. https://doi.org/10.1016/j.actpsy.2025.105979

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.

Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage Publications.

Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55(6), 2503–2529. https://doi.org/10.1111/bjet.13460

Dewi, E. R., & Alam, A. A. (2025). AI Literacy, Digital Self-Efficacy, and Learning Resilience as Predictors of Academic Success Across Urban and Rural Students. Journal of Educational Science and Technology (EST), 11(2), 60. https://doi.org/10.26858/est.v11i2.75877

Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in Second Language Research: Construction, Administration, and Processing (2nd ed.). Routledge. https://doi.org/10.4324/9780203864739

Duong, C. D. (2026). AI literacy and higher education students’ digital entrepreneurial intention: A moderated mediation model of AI self-efficacy and digital entrepreneurial self-efficacy. Industry and Higher Education, 40(2), 242–255. https://doi.org/10.1177/09504222251370089

Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254. https://doi.org/10.1016/j.system.2024.103254

Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146

Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate Data Analysis. Andover, UK: Cengage Learning. https://books.google.co.id/books?id=0R9ZswEACAAJ

Hermagustiana, I., Astuti, A. D., & Sucahyo, D. (2021). Do I Speak Anxiously? A Correlation of Self-Efficacy, Foreign Language Learning Anxiety and Speaking Performance of Indonesian EFL Learners. Script Journal: Journal of Linguistics and English Teaching, 6(1), 68–80. https://doi.org/10.24903/sj.v6i1.696

Hewitt, E., & Stephenson, J. (2012). Foreign Language Anxiety and Oral Exam Performance: A Replication of Phillips’s MLJ Study. The Modern Language Journal, 96(2), 170–189. https://doi.org/10.1111/j.1540-4781.2011.01174.x

Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign Language Classroom Anxiety. The Modern Language Journal, 70(2), 125–132. https://doi.org/10.1111/j.1540-4781.1986.tb05256.x

Huang, L., & Liu, M. (2026). The Rise of Digital Tutors: A Bibliometric Exploration of Intelligent Agent‐Supported Language Learning From 2005 to 2025. European Journal of Education, 61(1), e70529. https://doi.org/10.1111/ejed.70529

Istiara, F., Ab, J. S., Tama, O. H., Mahrunnisya, D., Ajeng, G. D., Adijaya, N., Saputra, D. W., & Hadi, M. S. (2025). Deep Learning Engagement as a Predictor of Academic Self-Efficacy and Language Performance. TARBIYA: Journal of Education in Muslim Society, 115–126. https://doi.org/10.15408/tjems.v12i1.46710

Janitra, M. J. O., & Anwar, K. (2022). Significant Relationship between Anxiety Level and Oral Communication Performances: The Case of English Education Learners. New Language Dimensions, 3(1), 60–70. https://doi.org/10.26740/nld.v3n1.p60-70

Jin, S. (2024). Speaking proficiency and affective effects in EFL: Vlogging as a social media‐integrated activity. British Journal of Educational Technology, 55(2), 586–604. https://doi.org/10.1111/bjet.13381

Kim, H. J., Hong, A. J., & Song, H.-D. (2019). The roles of academic engagement and digital readiness in students’ achievements in university e-learning environments. International Journal of Educational Technology in Higher Education, 16(1), 21. https://doi.org/10.1186/s41239-019-0152-3

Kline, R. B. (2023). Principles and Practice of Structural Equation Modeling. Guilford Publications. https://books.google.co.id/books?id=t2CvEAAAQBAJ

Kock, N. (2015). Common Method Bias in PLS-SEM: A Full Collinearity Assessment Approach. International Journal of e-Collaboration, 11(4), 1–10. https://doi.org/10.4018/ijec.2015100101

Li, M., Wang, Y., & Yang, X. (2025). Can Generative AI Chatbots Promote Second Language Acquisition? A Meta‐Analysis. Journal of Computer Assisted Learning, 41(4), e70060. https://doi.org/10.1111/jcal.70060

Liu, G. L., & Zhao, X. (2026). The Predictive Effects of Sociobiographical Variables, English Learning Confidence, and Digital Competence on AI‐Mediated Informal Digital Learning of English (AI‐IDLE). International Journal of Applied Linguistics, 36(2), 1641–1652. https://doi.org/10.1111/ijal.70010

Liu, M., & Xiangming, L. (2019). Changes in and Effects of Anxiety on English Test Performance in Chinese Postgraduate EFL Classrooms. Education Research International, 2019, 1–11. https://doi.org/10.1155/2019/7213925

Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3313831.3376727

Lyu, B., Lai, C., & Guo, J. (2025). Effectiveness of Chatbots in Improving Language Learning: A Meta‐Analysis of Comparative Studies. International Journal of Applied Linguistics, 35(2), 834–851. https://doi.org/10.1111/ijal.12668

MacIntyre, P. D., & Gardner, R. C. (1994). The Subtle Effects of Language Anxiety on Cognitive Processing in the Second Language. Language Learning, 44(2), 283–305. https://doi.org/10.1111/j.1467-1770.1994.tb01103.x

Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041

Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104. https://doi.org/10.1111/bjet.13411

Ng Kok Wah, J. (2025). Artificial Intelligence in Language Learning: A Systematic Review of Personalization and Learner Engagement. Forum for Linguistic Studies, 7(9). https://doi.org/10.30564/fls.v7i9.10336

Okyar, H. (2023). Foreign Language Speaking Anxiety and its Link to Speaking Self-Efficacy, Fear of Negative Evaluation, Self-Perceived Proficiency and Gender. Science Insights Education Frontiers, 17(2), 2715–2731. https://doi.org/10.15354/sief.23.or388

Panggua, S., Pongsapan, N. P., Ismail, H., Patandung, Y., Rachel, & Tangirerung, J. R. (2025). AI-Enhanced Academic Speaking Skills: A Qualitative Investigation of Digital Tool Integration in Indonesian EFL University Context. Forum for Linguistic Studies, 7(8). https://doi.org/10.30564/fls.v7i8.10763

Pertiwi, P. C., Segoh, D., & Rohmadhani, A. (2025). Artificial Intelligence in Academic Environments: Reducing or Increasing Foreign Language Anxiety? Inspiring: English Education Journal, 8(1), 100–131. https://doi.org/10.35905/inspiring.v8i1.13009

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879

Ren, J., Nik, W. S. B. W., Wang, S., & Wang, H. (2025). Language evaluation anxiety and self-appraisal ability: Their impact on students’ oral English performance. Environment and Social Psychology, 10(7). https://doi.org/10.59429/esp.v10i7.3905

Shi, W., & Shakibaei, G. (2025). Insights Into the Effectiveness of Artificial Intelligence‐Integrated Speaking Instruction in Enhancing Speaking Skills and Social–Emotional Competence as Well as Reducing Demotivation and Shyness. European Journal of Education, 60(3), e70174. https://doi.org/10.1111/ejed.70174

Shirvan, M. E., Khajavy, G. H., Nazifi, M., & Taherian, T. (2018). Longitudinal examination of adult students’ self-efficacy and anxiety in the course of general English and their prediction by ideal self-motivation: Latent growth curve modeling. New Horizons in Adult Education and Human Resource Development, 30(4), 23–41. https://doi.org/10.1002/nha3.20230

Singh, E., Vasishta, P., & Singla, A. (2025). AI-enhanced education: Exploring the impact of AI literacy on generation Z’s academic performance in Northern India. Quality Assurance in Education, 33(2), 185–202. https://doi.org/10.1108/QAE-02-2024-0037

Sok, S., & Shin, H. W. (2025). Do Interactions with CHATGPT Influence L2 Learners’ Oral Speaking Ability, Summarization Ability, and Perceptions of Generative AI Tasks? TESOL Quarterly, 59(S1). https://doi.org/10.1002/tesq.70001

Sun, P. P., & Zhang, L. J. (2024). Investigating the Effects of Chinese University Students’ Online Engagement on Their EFL Learning Outcomes. The Asia-Pacific Education Researcher, 33(4), 747–757. https://doi.org/10.1007/s40299-023-00800-7

Syairofi, A., Emilia, E., & Purnawarman, P. (2025). The use of ChatGPT in the Indonesian ELT context: A systematic review. Journal of Research on English and Language Learning (J-REaLL), 6(2), 217–234. https://doi.org/10.33474/j-reall.v6i2.23552

Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn & Bacon/Pearson Education.

Waluyo, B., & Pratiwi, D. I. (2025). AI chatbot-assisted English learning and willingness to communicate: A narrative meta-synthesis of evidence from Asian English as a foreign language contexts. The JALT CALL Journal, 21(3), 102884. https://doi.org/10.29140/jaltcall.v21n3.102884

Wang, C., Li, X., & Zou, B. (2025). Revisiting Integrated Model of Technology Acceptance Among the Generative AI ‐Powered Foreign Language Speaking Practice: Through the Lens of Positive Psychology and Intrinsic Motivation. European Journal of Education, 60(1), e70054. https://doi.org/10.1111/ejed.70054

Xu, S., Chen, P., & Zhang, G. (2024). Exploring the impact of the use of ChatGPT on foreign language self-efficacy among Chinese students studying abroad: The mediating role of foreign language enjoyment. Heliyon, 10(21), e39845. https://doi.org/10.1016/j.heliyon.2024.e39845

Yang, C., Shao, J., Zhang, M., & Xu, H. (2026). Integrating Multimodality in Emotion Moderation: The Effects of Multimodal AI on EFL Speakers’ Boredom, Enjoyment, and Anxiety. International Journal of Applied Linguistics, ijal.70201. https://doi.org/10.1111/ijal.70201

Yi, Z., & Siquan, X. (2025). The Impact of Pre‐Service Language Teachers’ Basic Psychological Needs on Behavioural Intentions to Utilise Artificial Intelligence ( AI ) in Teaching: AI Literacy and Self‐Efficacy as Mediators. European Journal of Education, 60(3), e70160. https://doi.org/10.1111/ejed.70160

Yuan, N., Yu, Q., & Liu, W. (2025). The impact of digital literacy on learning outcomes among college students: The mediating effect of digital atmosphere, self-efficacy for digital technology and digital learning. Frontiers in Education, 10, 1641687. https://doi.org/10.3389/feduc.2025.1641687

Yunita, R., Febrilyantri, C., Hayasaki, A., & Ni’am, M. I. (2025). Bridging the Affective-Linguistic Gap: A Mixed-Methods Exploration of AI-Assisted Speaking Practice and Willingness to Communicate. Jurnal Pendidikan Progresif, 15(4), 2760–2780. https://doi.org/10.23960/jpp.v15i4.pp2760-2780

Zhang, Q., Pan, X., & Fan, J. (2025). Uncovering the Mediating Effects of AI Trust and Self‐Efficacy on Engagement in Human‐ GENAI Communication for EFL Learning. European Journal of Education, 60(4), e70336. https://doi.org/10.1111/ejed.70336

Zou, B., Wang, C., Yan, Y., Du, X., & Ji, Y. (2025). Exploring English as a Foreign Language Learners’ Adoption and Utilisation of ChatGPT for Speaking Practice Through an Extended Technology Acceptance Model. International Journal of Applied Linguistics, 35(2), 689–704. https://doi.org/10.1111/ijal.12658

Downloads

Published

2026-08-28

How to Cite

Sutrah, S., & Agung, M. (2026). AI Literacy, Speaking Self-Efficacy, Digital Engagement, and Speaking Anxiety as Predictors of EFL Speaking Performance. Jurnal Riset Dan Inovasi Pembelajaran, 6(2), 1129–1152. https://doi.org/10.51574/jrip.v6i2.5740