ARCHIVES
Review Article
Multilingual Chatbot Development Using Pre Trained Language Models: A Survey
Saravana M K1
Arman Mohammed2
Sovan Pattanayak3
Dev Paswan4
Yuvraj Dadhich5
12345 Computer Science & Design, Dayananda Sagar Academy of Technology and Management, Karnataka, India.
Published Online: January-April 2025
Pages: 152-160
Cite this article
↗ https://www.doi.org/10.59256/indjcst.20250401023References
1. T. Gortz, M. S. Morgan, and P. H. Diefenbach, "An artificial intelligence-based chatbot for prostate cancer education: Design and
patient evaluation," J. Med. Internet Res., vol. 25, no. 6, pp. 1-14, 2023.
2. Y. Zhou, L. Smith, and R. Anderson, "An artificially intelligent natural language processing chatbot designed to promote COVID-19
awareness," Computers Hum. Behav., vol. 136, p. 107563, 2023.
3. A. K. Verma, S. R. Sharma, and N. Gupta, "Integrating conversational agents and knowledge graphs within the scholarly domain," Int. J.
Intell. Syst., vol. 39, no. 3, pp. 285-310, 2023.
4. P. Patel, R. K. Singh, and A. Bose, "Optimizing language model-based educational assistants using knowledge graphs integration with
Moodle LMS," J. Educ. Technol. Soc., vol. 26, no. 2, pp. 112-127, 2023.
5. L. Kohnke, "A pedagogical chatbot: A supplemental language learning tool," Educ. Technol. Res. Dev., vol. 70, no. 5, pp. 1205-1223, 2022
6. M. Subramani, S. Rajendran, and A. Kumar, "Machine reading comprehension for the Tamil language with translated SQuAD," in Proc.
Conf. Nat. Lang. Process., 2023, pp. 78-89.
7. F. Al-Mutairi and H. A. Rahman, "Arabic paraphrase generation using transformer-based approaches," IEEE Access, vol. 11, pp. 23412–
23425, 2023.
8. S. Martinez, B. Fischer, and L. Zhao, "Recent advances in interactive machine translation with large language models," Trans. Assoc.
Comput. Linguist., vol. 9, pp. 512–527, 2023..
9. R. V. Kumar and P. Sharma, "Model-driven approaches for conversational agents development: A systematic mapping study," ACM Comput.
Surv., vol. 55, no. 7, pp. 1–36, 2023.
10. S. Agarwal, S. Mehra, and P. Mitra, "Multi-purpose NLP chatbot: Design, methodology & conclusion," in Proc. Int. Conf. Artif. Intell.
Mach. Learn., 2023, pp. 210–224.
11. S. Pawar, J. Park, and I. Augenstein, "Survey of cultural awareness in language models: Text and beyond," arXiv preprint arXiv:2411.00860,
2024
12. S. Kolar and R. Kumar, "Multilingual tourist assistance using ChatGPT: Comparing capabilities in Hindi, Telugu, and Kannada," in
Proc. Int. Conf. Comput. Linguist., 2023, pp. 98-112.
13. L. W. Y. Yang et al., "Development and testing of a multi-lingual natural language processing-based deep learning system in 10 languages
for COVID-19 pandemic crisis: A multi-center study," Front. Public Health, vol. 11, p. 1063466, 2023.
14. E. A. F. Ekellem, "Enhancing multicultural and multilingual education through problem-based teaching with conversational AI: A ChatGPT
perspective," J. Educ. Res. Dev., vol. 15, no. 3, pp. 89–105, 2023.
15. C. Potts et al., "A multilingual digital mental health and well-being chatbot (ChatPal): Pre-Post multicenter intervention study," J. Med.
Internet Res., vol. 25, no. 1, p. e43051, 2023..
16. S. Tan, "Exploring challenges and approaches for ChatGPT in multilingual and multisectoral contexts," in Proc. 5th Int. Conf. Comput.
Data Sci., 2023, pp. 134- 150.
17. J. K. Raju, M. V. J, and S. G, "Development of chatbots: A review," Int. J. Innov. Res. Technol., vol. 9, no. 12, pp. 994–1002, 2023
18. M. Senthil Kumar et al., "An automated chatbot for an educational institution using natural language processing," Int. J. Creat. Res. Thoughts
(IJCRT), vol. 10, no. 5, pp. 142–150, 2022.
19. S. Wu and M. Luo, “Selection and Resource Allocation Strategies for Chatbot Technologies in Higher Education: An Optimization Model
Approach,” IEEE Access, vol. 13, pp. 13156–13170, Jan. 2025, doi: 10.1109/ACCESS.2025.3530413.20. Z. T. Hamad, N. Jamil, and A. N. Belkacem, “ChatGPT’s Impact on Education and Healthcare: Insights, Challenges, and Ethical
Consideration,” IEEE Access, vol. 12, pp. 114858–114876, Aug. 2024, doi: 10.1109/ACCESS.2024.3437374.
21. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Temporal Harmony: Bridging Gaps in Multivariate Time Series Data
with GAN- Transformer Integration,” in Proc of the 2024 IEEE Int. Conf. Interdisciplinary Approaches in Technology and Management for
Social Innovation (IATMSI), vol. 2, pp. 1–6, 2024. IEEE.
22. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Navigating Data Scarcity in Multivariate Time Series Forecasting:
A Hybrid Model Perspective,” in Proceedings of the 2024 IEEE Region 10 Symposium (TENSYMP), pp. 1–7, 2024. IEEE.
23. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Graph Laplacian Eigenvalues Empowered VAEs: A Novel Approach
to Adaptive Latent Dimension Choice,” IEEE Access, vol. 12, pp. 135265–135282, 2024, doi: 10.1109/ACCESS.2024.3460971.
24. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Unsupervised MTS Anomaly Detection with Variational
Autoencoders,” in Lecture Notes in Networks and Systems, in Proceedings of the 4th Int. Conf. Front. Comput. Syst., Singapore, 2024, vol.
974, pp. 219–236, Springer Nature Singapore.
patient evaluation," J. Med. Internet Res., vol. 25, no. 6, pp. 1-14, 2023.
2. Y. Zhou, L. Smith, and R. Anderson, "An artificially intelligent natural language processing chatbot designed to promote COVID-19
awareness," Computers Hum. Behav., vol. 136, p. 107563, 2023.
3. A. K. Verma, S. R. Sharma, and N. Gupta, "Integrating conversational agents and knowledge graphs within the scholarly domain," Int. J.
Intell. Syst., vol. 39, no. 3, pp. 285-310, 2023.
4. P. Patel, R. K. Singh, and A. Bose, "Optimizing language model-based educational assistants using knowledge graphs integration with
Moodle LMS," J. Educ. Technol. Soc., vol. 26, no. 2, pp. 112-127, 2023.
5. L. Kohnke, "A pedagogical chatbot: A supplemental language learning tool," Educ. Technol. Res. Dev., vol. 70, no. 5, pp. 1205-1223, 2022
6. M. Subramani, S. Rajendran, and A. Kumar, "Machine reading comprehension for the Tamil language with translated SQuAD," in Proc.
Conf. Nat. Lang. Process., 2023, pp. 78-89.
7. F. Al-Mutairi and H. A. Rahman, "Arabic paraphrase generation using transformer-based approaches," IEEE Access, vol. 11, pp. 23412–
23425, 2023.
8. S. Martinez, B. Fischer, and L. Zhao, "Recent advances in interactive machine translation with large language models," Trans. Assoc.
Comput. Linguist., vol. 9, pp. 512–527, 2023..
9. R. V. Kumar and P. Sharma, "Model-driven approaches for conversational agents development: A systematic mapping study," ACM Comput.
Surv., vol. 55, no. 7, pp. 1–36, 2023.
10. S. Agarwal, S. Mehra, and P. Mitra, "Multi-purpose NLP chatbot: Design, methodology & conclusion," in Proc. Int. Conf. Artif. Intell.
Mach. Learn., 2023, pp. 210–224.
11. S. Pawar, J. Park, and I. Augenstein, "Survey of cultural awareness in language models: Text and beyond," arXiv preprint arXiv:2411.00860,
2024
12. S. Kolar and R. Kumar, "Multilingual tourist assistance using ChatGPT: Comparing capabilities in Hindi, Telugu, and Kannada," in
Proc. Int. Conf. Comput. Linguist., 2023, pp. 98-112.
13. L. W. Y. Yang et al., "Development and testing of a multi-lingual natural language processing-based deep learning system in 10 languages
for COVID-19 pandemic crisis: A multi-center study," Front. Public Health, vol. 11, p. 1063466, 2023.
14. E. A. F. Ekellem, "Enhancing multicultural and multilingual education through problem-based teaching with conversational AI: A ChatGPT
perspective," J. Educ. Res. Dev., vol. 15, no. 3, pp. 89–105, 2023.
15. C. Potts et al., "A multilingual digital mental health and well-being chatbot (ChatPal): Pre-Post multicenter intervention study," J. Med.
Internet Res., vol. 25, no. 1, p. e43051, 2023..
16. S. Tan, "Exploring challenges and approaches for ChatGPT in multilingual and multisectoral contexts," in Proc. 5th Int. Conf. Comput.
Data Sci., 2023, pp. 134- 150.
17. J. K. Raju, M. V. J, and S. G, "Development of chatbots: A review," Int. J. Innov. Res. Technol., vol. 9, no. 12, pp. 994–1002, 2023
18. M. Senthil Kumar et al., "An automated chatbot for an educational institution using natural language processing," Int. J. Creat. Res. Thoughts
(IJCRT), vol. 10, no. 5, pp. 142–150, 2022.
19. S. Wu and M. Luo, “Selection and Resource Allocation Strategies for Chatbot Technologies in Higher Education: An Optimization Model
Approach,” IEEE Access, vol. 13, pp. 13156–13170, Jan. 2025, doi: 10.1109/ACCESS.2025.3530413.20. Z. T. Hamad, N. Jamil, and A. N. Belkacem, “ChatGPT’s Impact on Education and Healthcare: Insights, Challenges, and Ethical
Consideration,” IEEE Access, vol. 12, pp. 114858–114876, Aug. 2024, doi: 10.1109/ACCESS.2024.3437374.
21. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Temporal Harmony: Bridging Gaps in Multivariate Time Series Data
with GAN- Transformer Integration,” in Proc of the 2024 IEEE Int. Conf. Interdisciplinary Approaches in Technology and Management for
Social Innovation (IATMSI), vol. 2, pp. 1–6, 2024. IEEE.
22. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Navigating Data Scarcity in Multivariate Time Series Forecasting:
A Hybrid Model Perspective,” in Proceedings of the 2024 IEEE Region 10 Symposium (TENSYMP), pp. 1–7, 2024. IEEE.
23. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Graph Laplacian Eigenvalues Empowered VAEs: A Novel Approach
to Adaptive Latent Dimension Choice,” IEEE Access, vol. 12, pp. 135265–135282, 2024, doi: 10.1109/ACCESS.2024.3460971.
24. M. K. Saravana, M. S. Roopa, J. S. Arunalatha, and K. R. Venugopal, “Unsupervised MTS Anomaly Detection with Variational
Autoencoders,” in Lecture Notes in Networks and Systems, in Proceedings of the 4th Int. Conf. Front. Comput. Syst., Singapore, 2024, vol.
974, pp. 219–236, Springer Nature Singapore.
Related Articles
2025
Transforming Cyber-Physical Systems: Machine Learning for Secure and Efficient Solutions
2025
Exploring AI Techniques for Quantum Threat Detection and Prevention
2025
Maturity Models for Business Intelligence: An Overview
2025
INSPIRO: An AI Driven Institution Auditor
2025
Adaptive AI Framework for Anomaly Detection and DDoS Mitigation in Distributed Systems
2025