Evaluation of the quality of machine translation of legal texts

The modern world is undergoing an active transformation and development of trade, cultural, economic and political ties between states. Practically each of these areas is regulated by a multitude of laws and regulations, which is reflected in various types of legal documents and texts. Given that participants in international relations represent different linguistic and cultural backgrounds, the need for high-quality legal translation is becoming more urgent. In the modern world, machine translation is becoming increasingly relevant, including in the legal field, taking into account the complexities of judicial language, cultural differences and the peculiarities of legal systems of states. The purpose of this article is to determine the effectiveness of various machine translation systems when working with legal texts. The focus of this work is on two types of legal texts belonging to different functional styles, which allows the authors to trace the dependence of the adequacy and equivalence of machine translation on the communicative situation. A comparative analysis of the quality of translation of two types of professional texts performed by humans and machine translation systems is carried out. The methodological basis of the study was the classification method, descriptive and comparative methods. The research results will help professional translators or ordinary users choose the highest quality machine translation service, identify and eliminate typological errors that occur when working with texts of a certain subject at the stages of pre-editing and post-editing.

1. Galdia M. Strategies and tools for legal translation. Comparative Legilinguistics. 2013;(16):77-94. Available at: https://www.researchgate.net/publication/314254078_STRATE-GIES_AND_TOOLS_FOR_LEGAL_TRANSLATION

2. Apasova Yu.N. On the issue of the concept of legal translation from the point of view of law. NOMOTHETIKA Filosofiya. Sotsiologiya. Pravo = NOMOTHETIKA: Philosophy. Sociology. Right. 2021;(1). (In Russ.). Available at: https://cyberleninka.ru/article/n/k-voprosu-ponyatiya-yuridi-cheskogo-perevoda-s-tochki-zreniya-prava (accessed 07.04.2025).

3. Ayvazova E.R. Translation legal texts as one of the most difficult areas of the translation industry. In: Voprosy sudebnoi deyatel'nosti i pravoprimeneniya v sovremennykh usloviyakh: sbornik statei po rezul'tatam II Mezhdunarodnoi nauchno-prakticheskoi konferentsii = Issues of judicial activity and law enforcement in modern conditions : a collection of articles based on the results of the II International Scientific and Practical Conference. Simferopol': Obshchestvo s ogranichennoi otvetstvennost'yu «Izdatel'stvo Tipografiya «Arial»; 2023. P. 969-974.

4. Khizhniak S.P. Legal translation as a type of special translation. Vestnik Permskogo natsional'nogo issledovatel'skogo politekhnicheskogo universiteta. Problemy yazykoznaniya i pedagogiki = Bulletin of the Perm National Research Polytechnic University. Problems of linguistics and pedagogy. 2022;(3):20-30. (In Russ.)

5. Levitan K.M. Legal translation and comparative jurisprudence. Rossiiskii yuridicheskii zhurnal = Russian Law Journal. 2012;(5):46-55. (In Russ.)

6. Borichevskaya A.A., Dubrovskaya E.V. Linguacultural factors of legal text translation. Pedagogy & Psychology. Theory and Practice. 2019;(3):16-18.

7. Zaikova I.V., Khomyakova A.A. Some aspects of the written translation of English-language texts of official business documents. Molodezhnyi vestnik IrGTU = Youth Bulletin of IrSTU. 2015;(1):23. (In Russ.)

8. Shcherba L.V. Selected works on the Russian language. Moscow: Izdatel'stvo Yurait; 2022. 192 p. (In Russ.). Available at: https://urait.ru/bcode/431398

9. Gribanskaya E.E. Functional styles of speech, or how not to get trapped. Obrazovatel'nye tekhnologii = Educational technologies. 2017;(4):123-135. (In Russ.) Available at: https://cyberleninka.ru/article/n/funktsionalnye-stili-rechi-ili-kak-ne-popast-vprosak.

10. Zhukova E.A. Features of the official business style. Vestnik Moskovskogo informatsionno-tekhnologicheskogo universiteta – Moskovskogo arkhitekturno-stroitel'nogo instituta = Bulletin of the Moscow Information Technology University - Moscow Institute of Architecture and Civil Engineering. 2018;(1). (In Russ.). Available at: https://cyberleninka.ru/article/n/osobennosti-ofitsialno-delovogo-stilya (date of request: 07.04.2025).

11. Vinogradov V.S. Introduction to translation studies (general and lexical issues). Moscow: Izdatel'stvo instituta obshchego srednego obrazovaniya RAO; 2001. 224 p. (In Russ.)

12. Chokhonelidze N.S., Nodiya T.T. The spoken style of modern Russian literary language. Vestnik nauki i obrazovaniya = Bulletin of Science and Education. 2021;(14-3). (In Russ.). Available at: https://cyberleninka.ru/article/n/razgovornyy-stil-sovremennogo-russkogo-literaturnogo-yazyka (date of request: 07.04.2025).

13. Goncharov A.A., Buntman N.V., Nuriev V.A. Errors in machine translation: classification problems. Sistemy i sredstva informatiki = Computer science systems and tools. 2019;29(3):92-103. (In Russ.)

14. Kondratiev E.G. Problems of machine translation in modern linguistics. Uspekhi sovremennoi nauki i obrazovaniya = Successes of modern science and education. 2017;1(6):168-171. (In Russ.)

15. Tatarinova R.D. The problem of using machine translation. In: Nauchnye issledovaniya: teoriya, metodika i praktika. Sbornik materialov IV Mezhdunarodnoi nauchno-prakticheskoi konferentsii = Scientific research: theory, methodology and practice. Proceedings of the IV International Scientific and Practical Conference. Cheboksary: Obshchestvo s ogranichennoi otvetstvennost'yu "Tsentr nauchnogo sotrudnichestva "Interaktiv plyus"; 2018. P. 281-282. (In Russ.)

16. Rodina S.V., Lakiza E.V. Linguistic problems of machine translation (based on the material of Russian and English). Universum: filologiya i iskusstvovedenie = Universum: philology and Art History. 2023;(6):17-19. (In Russ.)

17. Belyaeva, L. N. Machine translation in the translator's work: a practical aspect. Vestnik Permskogo natsional'nogo issledovatel'skogo politekhnicheskogo universiteta. Problemy yazykoznaniya i pedagogiki = Bulletin of the Perm National Research Polytechnic University. Problems of linguistics and pedagogy. 2019;(2):8-20. (In Russ.)

18. Stone V. Alameda Health System. Available at: https://law.justia.com/cases/california/supreme-court/2024/s279137.html

19. Johnson V. Settino. Available at: https://law.justia.com/cases/massachusetts/supreme-court/2024/sjc-13555.html

20. Kovaleva E.D., Koshmina A.S., Vlasenko N.I. Gender neutrality of language and its influence on language norms. Izvestiya Yugo-Zapadnogo gosudarstvennogo universiteta. Seriya: Lingvistika i pedagogika = Proceedings of the Southwest State University. Series: Linguistics and Pedagogics. 2022;12(3):68-76. (In Russ.)

21. Khromova A.A., Lukmanova R.R. Post-editing of English-Russian machine translation: problems, methods and optimization. Filologicheskie nauki. Voprosy teorii i praktiki = Philological Sciences. Questions of theory and practice. 2024;(3). (In Russ.). Available at: https://cyberleninka.ru/article/n/postredaktirovanie-anglo-russkogo-mashinnogo-perevoda-problemy-metody-i-optimizatsiya (date of request: 07.04.2025).

22. Vlasenko N.I. Ways of expressing expressive statements in the epistolary genre. Izvestiya Yugo-Zapadnogo gosudarstvennogo universiteta. Seriya: Lingvistika i pedagogika = Proceedings of the Southwest State University. Series: Linguistics and Pedagogics. 2020;10(3):160-169. (In Russ.)