The impact of contextual understanding on neural machine translation accuracy: A case study of Indonesian cultural idioms in English translation
Abstract
The translation of Indonesian idiomatic expressions into English using Neural Machine Translation (NMT) systems presents significant challenges due to the intricate nature of idiomatic language. Idioms are culturally embedded constructs conveying meanings different from their literal interpretations. This study explores the effectiveness of NMT systems in capturing and translating Indonesian idiomatic expressions into English. Using a qualitative approach, 150 diverse Indonesian idioms were evaluated through Google Translate and DeepL. Each idiom was assessed for semantic accuracy, syntactic coherence, and contextual fidelity. Qualitative analysis provided a comprehensive evaluation of translation quality. Findings reveal significant challenges for NMT systems in translating idiomatic expressions. Both Google Translate and DeepL show strengths in some areas, but also have limitations. While they generally capture literal meanings, they often miss metaphorical nuances and cultural connotations. Syntactic errors such as incorrect word order and tense inconsistencies are common, especially in complex idioms. In addition, contextual fidelity analysis shows that NMT systems struggle with contextual appropriateness and pragmatic usage, resulting in translations lacking cultural sensitivity and relevance. These challenges highlight the need for improved algorithms to better interpret and translate idiomatic language across cultural contexts. Accurate idiom translation is crucial for language learners to understand cultural nuances and idiomatic usage. Enhancing the capabilities of NMT systems requires refining algorithms, developing context-aware models, and expanding training datasets with diverse idiomatic expressions. Overcoming these challenges will advance machine translation capabilities and improve cross-cultural communication and language learning experiences.
Keywords
References
Baker, M. (2018). In other words: A coursebook on translation (3rd ed.). Routledge.
Bidari, N.A.A. (2021). Analisis Kesalahan Makna pada Terjemahan (Arab-Indonesia) Santriwati Kelas III Reguler A TMI Al-Amien Prenduan Sumenep, 6(1). Al-Ibrah. https://www.ejournal.stital.ac.id/index.php/alibrah/article/download/116/97
Brevian, R.R.A. (2020). Kualitas Terjemahan Kesepadanan Gramatikal Kategori Jumlah, Persona, Kala dan Aspek oleh Mesin Penerjemah I-Translate dan Google Translate dari Bahasa Inggris Ke Dalam Bahasa Indonesia (Master thesis). Universitas Gadjah Mada.
https://etd.repository.ugm.ac.id/penelitian/detail/190499
Chung, E.S. (2022). The Effect of Using Machine Translation on Linguistic Features in L2 Writing Across Proficiency Levels and Text Genres, 35(9), 2239 -2264. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2020.1868531
Dankers, V., Lucas, C.G., & Titov, I. (2022). Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 3608-3626. ACL Anthology. 10.18653/v1/2022.acl-long.252
Dayter, D., Locher, M. A., & Messerli, T. C. (2023). Pragmatics in Translation: Mediality, Participation and Relational Work. Cambridge University Press. https://doi.org/10.1017/9781009261210
Donthi, S., Spencer, M., Patel, O., Doh, J., & Rodan, E. (2024). Improving LLM Abilities in Idiomatic Translation, 1-10. arXiv. https://doi.org/10.48550/arXiv.2407.03518
Ekazuriaty, N.A. (2016). An Analysis on the Google Translation Quality in Translating English Into Indonesia of the Text "Cinderella" (Doctoral dissertation). STAIN Ponorogo.
House, J. (2015). Translation Quality Assessment: Past and Present. Routledge.
The Importance of Context within Translation. (2024). Kwintessential. https://www.kwintessential.co.uk/blog/general-interest/the-importance-of-context-within-translation
Ismail, A., & Hartono, R. (2016). Errors Made in Google Translate in the Indonesian to English Translations of News Item Texts, 5(2), 55-62. ELT Forum: Journal of English Language Teaching.
Jolley, J.R., & Maimone, L. (2022). Thirty years of machine translation in language teaching and learning: A review of the literature, 14(1), 26-44. L2 Journal. https://doi.org/10.5070/L214151760
Kasmir, K. (2022). An Analysis of Google Translate Tool Results From Indonesian to English (Study on Abstraction in English of Library Science Department Thesis 2021 Academic Year State Islamic University of North Sumatra) (Doctoral dissertation). Universitas Islam Negeri Sumatera Utara Medan.
Kenny, D. (Ed.). (2022). Machine translation for everyone: Empowering users in the age of artificial intelligence. Language Science Press. https://doi.org/10.5565/rev/quadernsiee.49
Klekovina, V., Denié-Highney, L., & Laurence. (2022). Machine Translation: Friend or Foe in the Language Classroom?, 26(2), 50-57. L2 Journal. https://doi.org/10.5070/L214151723
Kol, S., Schcolnik, M., & Spector-Cohen, E. (2018). Google Translate in Academic Writing Courses?, 14(1), 50-57. The EuroCALL Review. https://doi.org/10.4995/eurocall.2018.10140
Krisianto, A. (2021). Kamus Idiom Inggris-Indonesia, Kamus Mini 2555+Idiom. Andi Publisher.
Larson, M.L. (1984). Meaning-Based Translation: A Guide to Cross-Language Equivalence. University Press of America.
Lee, S.M. (2020). The Impact of Using Machine Translation on EFL Students’ Writing, 33(3), 157-175. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2018.1553186
Lee, S.M., & Briggs, N. (2021). Effects of Using Machine Translation to Mediate the Revision Process of Korean University Students’ Academic Writing, 33(1), 18-33. ReCALL. https://doi.org/10.1017/S095834402000018X
Liu, E., Chaudhary, A., & Neubig, G. (2023). Crossing the Threshold: Idiomatic Machine Translation through Retrieval Augmentation and Loss Weighting In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 15095-15111. ACL Anthology. doi:10.18653/v1/2023.emnlp-main.933
Napitulu, S. (2017). Analyzing Indonesian-English Abstracts Translation in View of Translation Errors by Google Translate, 5(2), 15-23. International Journal of English Language and Linguistics Research.
Sipayung, K.T., Pasaribu, A.N., Sinaga, N.T. (2024) Common Problems and Overt Errors in Translating Idioms in The Film Maleficent, 9(2), 23-31. Eurasian Journal of Applied Linguistics. http://dx.doi.org/10.32601/ejal.10203
Why Context Really Matters in Translation. (2022). eTranslation Services. https://etranslationservices.com/translations/why-context-really-matters-in-translation/
DOI: http://dx.doi.org/10.22373/ej.v12i1.24433
Refbacks
- There are currently no refbacks.