Optimizing Real-time Voice Translation for Arabic-English Interactions: A Multidimensional Evaluation of Accuracy, Fluency, and Cultural Sensitivity
DOI:
https://doi.org/10.55074/hesj.vi48.1512Keywords:
machine translation, real-time voice translation, fluency, accuracy, cultural sensitivity, Arabic speech recognitionAbstract
Real-time voice translation systems are an advanced tool for overcoming language barriers. However, their performance in bilingual Arabic-English interactions faces significant challenges due to the lexical, syntactic, and semantic complexities of the Arabic language and its cultural diversity. This study presents a comprehensive and multidimensional assessment of existing speech-to-speech translation systems, with a focus on semantic accuracy, fluency, and cultural sensitivity in translating spoken English into Arabic. It considers lexical (word and vocabulary choice), syntactic (sentence structure), and semantic (interpretation of meaning) aspects. Analyzing a diverse dataset comprising spoken Arabic dialogues and various contexts (e.g., commercial advertisements, social conversations, greetings). The study employed quantitative and qualitative data analysis to examine and evaluate translation quality. The findings demonstrate persistent challenges in addressing lexical (e.g., inaccurate word choice), syntactic (e.g., unnatural sentence structures), and semantic (e.g., misinterpretation of contextual meanings), which are exacerbated by the limitations of real-time processing. Based on these findings, the study proposes improvement strategies that include adapting machine learning models with expanded lexical and grammatical data, including dialects, developing context-sensitive semantic analysis algorithms, and incorporating cultural adaptation mechanisms to ensure contextual relevance. These improvements aim to enhance semantic accuracy, dialogue coherence, and cultural relevance, supporting effective communication and enhancing translation effectiveness in Arabic-English bilingual interactions.Downloads
References
Abuelyaman, E., Rahmatallah, L., Mukhtar, W., & Elagabani, M. (2014). Machine Translation of Arabic Language: Challenges and Keys. 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, 111-116.
Algaraady, J., & Mahyoob, M. (2025). Exploring ChatGPT's potential for augmenting post-editing in machine translation across multiple domains: challenges and opportunities. Frontiers in Artificial Intelligence, 8, 1526293.
Alsayadi, H. A., Abdelhamid, A., Hegazy, I., & Fayed, Z. (2021). Arabic speech recognition using end-to-end deep learning. IET Signal Processing.
Algaraady, j, (2018). Needs, Challenges and Preliminary Solutions for Verb Phrases Translation from English to Arabic: An Example-Based Machine Translation Model, (Doctoral Dissertation, Aligarh Muslim University, Aligarh).
Aseri, Y., Alreemy, K., Alelyani, S., & Mohanna, M. (2022). Meeting challenges of Modern Standard Arabic and Saudi Dialect Identification. Embedded Systems and Applications.
Asakr, A. (2016). An English-Arabic Real-Time System (EARS). International Journal of Computer Technology, 15, 6898-6906.
Banimelhem, O., & Amayreh, W. (2023). Is ChatGPT a Good English to Arabic Machine Translation Tool? 2023 14th International Conference on Information and Communication Systems (ICICS), 1-6.
Baniata, L. H., Park, S., & Park, S. B. (2018). A neural machine translation model for Arabic dialects that utilises multitask learning (MTL). Computational intelligence and neuroscience, 2018(1), 7534712.
Dalvi, F., Zhang, Y., Khurana, S., Durrani, N., Sajjad, H., Abdelali, A.,... & Vogel, S. (2018). QCRI's Live Speech Translation System. QFARC 2018.
Dendani, B., Bahi, H., & Sari, T. (2021). Self-Supervised Speech Enhancement for Arabic Speech Recognition in Real-World Environments. Traitement du Signal.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. NAACL-HLT.
Hadla, L. S., Hailat, T. M., & Al-Kabi, M. (2014). Evaluating Arabic to English Machine Translation. International Journal of Advanced Computer Science and Applications, 5.
Mahyoob, M., & Algaraady, J. (2018). Towards developing a morphological analyser for Arabic noun forms. International journal of Linguistics and computational Applications, 5(3), 45-51.
Prasad, R., Natarajan, P., Stallard, D., Saleem, S., Ananthakrishnan, S., Tsakalidis, S., Kao, C., Choi, F., Meermeier, R., Rawls, M., Devlin, J., Krstovski, K., & Challenner, A. (2013). BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms. Comput. Speech Lang., 27, 475-491.
Qassem, M. M. S. (2015). Semi-automatic Annotation of Arabic Corpus: A Morpho-syntactic Study Thesis (Doctoral Dissertation, Aligarh Muslim University Aligarh)
Solyman, A., Zhenyu, W., Qian, T., Elhag, A. A. M., Toseef, M., & Aleibeid, Z. (2021). Synthetic data with neural machine translation for automatic correction in Arabic grammar. Egyptian Informatics Journal, 22(3), 303-315
Waibel, A., Badran, A., Black, A., Frederking, R. E., Gates, D., Lavie, A., Levin, L. S., Lenzo, K., Tomokiyo, L., Reichert, J., Schultz, T., Wallace, D., Woszczyna, M., & Zhang, J. (2003). Speechalator: Two-way speech-to-speech translation on a consumer PDA. 8th European Conference on Speech Communication and Technology (Eurospeech 2003).
Zakraoui, J., Saleh, M., Al-Maadeed, S., & Alja'am, J. (2020). Evaluation of Arabic to English Machine Translation Systems. 2020 11th International Conference on Information and Communication Systems (ICICS), 185-190.










