Skip to main content
journal@msti-indonesia.com 081377790601
Register
Articles

Large Language Model Integration in Desktop Applications: A Systematic Literature Review

  • 1* Universitas Teknologi Sulawesi Utara

* Corresponding Author: Deyidi Mokoginta

Open Access
DOI
https://doi.org/10.59431/jda.v5i1.810
Published
Pages
1-16

Issue

Vol. 5 No. 1 (2026)

Journal Dekstop Application (JDA)
June

Abstract

The integration of Large Language Models (LLMs) into desktop applications has accelerated sharply over the past several years, yet no prior systematic review has examined this deployment setting as a distinct research domain — separate from web-based or mobile environments, each carrying different architectural constraints, privacy expectations, and user interaction patterns. This study maps, analyzes, and synthesizes the available scientific evidence on LLM architectures adopted in desktop implementations, the technical barriers arising during integration, the measurable effects on User Experience (UX), and the relative effectiveness of competing deployment strategies. A Systematic Literature Review (SLR) was conducted following PRISMA 2020 reporting guidelines, with research questions structured using the PICOC framework. Systematic searches across seven digital databases — IEEE Xplore, ACM Digital Library, Scopus, Web of Science, Google Scholar, arXiv, and Semantic Scholar — covering 2019–2024 yielded 1,200 initial articles, narrowed to 42 final articles through layered selection and quality appraisal using a modified CASP rubric. GPT-4 and the LLaMA family emerged as the dominant architectures, with model selection driven primarily by parameter scale and privacy requirements. Computational constraints, response latency, and data security ranked as the most serious technical barriers, with Retrieval-Augmented Generation (RAG) and model quantization as the most common mitigations. LLM integration was associated with measurable gains in task efficiency and user satisfaction in 73.8% of reviewed studies, though output predictability and user trust remained persistent challenges. A hybrid deployment approach — combining local models with cloud-based API access — emerged as the most common practice among production implementations. Unlike existing reviews addressing LLM capabilities in general software engineering contexts, this study provides the first systematic map of LLM integration specifically within the desktop application domain, offering concrete guidance for developers working at the intersection of artificial intelligence and desktop software engineering.

Keywords

Large Language Model Desktop Application Systematic Literature Review Local Deployment Retrieval-Augmented Generation

How to Cite

Mokoginta, D. (2026). Large Language Model Integration in Desktop Applications: A Systematic Literature Review. Journal Dekstop Application (JDA), 5(1), 1-16. https://doi.org/10.59431/jda.v5i1.810

References

  • Abdulla, H., AlJazeeri, F., Hewahi, N., & El-Medany, W. (2025, November). Developing a tailored framework for systematic literature reviews in machine learning (ML-SLR): Addressing challenges and advancing research. In 2025 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT) (pp. 1–6). IEEE. https://doi.org/10.1109/3ICT68299.2025.11442228
  • Agrawal, S., Oza, P., Kakkar, R., Tanwar, S., Jetani, V., Undhad, J., & Singh, A. (2024). Analysis and recommendation system-based on PRISMA checklist to write systematic review. Assessing Writing, 61, Article 100866. https://doi.org/10.1016/j.asw.2024.100866
  • Buckley, T. A., Crowe, B., Abdulnour, R. E. E., Rodman, A., & Manrai, A. K. (2025, March). Comparison of frontier open-source and proprietary large language models for complex diagnoses. JAMA Health Forum, 6(3), Article e250040. https://doi.org/10.1001/jamahealthforum.2025.0040
  • Carrera-Rivera, A., Ochoa, W., Larrinaga, F., & Lasa, G. (2022). How to conduct a systematic literature review: A quick guide for computer science research. MethodsX, 9, Article 101895. https://doi.org/10.1016/j.mex.2022.101895
  • Castillo, S., & Grbovic, P. (2022). The APISSER methodology for systematic literature reviews in engineering. IEEE Access, 10, 23700–23707. https://doi.org/10.1109/ACCESS.2022.3148206
  • Chamarthi, B., Polu, O., Anumula, S., et al. (2025, April 22). Natural language processing (NLP)- and machine learning (ML)-enabled operating room optimization: A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) systematic review anchored in project planning theory. Cureus, 17(4), Article e82796. https://doi.org/10.7759/cureus.82796
  • Chkirbene, Z., Hamila, R., Gouissem, A., & Devrim, U. (2024, December). Large language models (LLM) in industry: A survey of applications, challenges, and trends. In 2024 IEEE 21st International Conference on Smart Communities: Improving Quality of Life Using AI, Robotics and IoT (HONET) (pp. 229–234). IEEE. https://doi.org/10.1109/HONET63146.2024.10822885
  • Choi, W. C., & Chang, C. I. (2025). Advantages and limitations of open-source versus commercial large language models (LLMs): A comparative study of DeepSeek and OpenAI's ChatGPT. Preprints.org. https://doi.org/10.20944/preprints202503.1081.v1
  • Han, S., Wang, M., Zhang, J., Li, D., & Duan, J. (2024). A review of large language models: Fundamental architectures, key technological evolutions, interdisciplinary technologies integration, optimization and compression techniques, applications, and challenges. Electronics, 13(24), Article 5040. https://doi.org/10.3390/electronics13245040
  • Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., … Wang, H. (2024). Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology, 33(8), 1–79.
  • Kitchenham, B., Madeyski, L., & Budgen, D. (2022). SEGRESS: Software engineering guidelines for reporting secondary studies. IEEE Transactions on Software Engineering, 49(3), 1273–1298. https://doi.org/10.1109/TSE.2022.3174092
  • Kivimäki, T. (2025). Usability evaluation of the local large language models [Master's thesis, University of Turku].
  • Kukreja, S., Kumar, T., Purohit, A., Dasgupta, A., & Guha, D. (2024, January). A literature survey on open source large language models. In Proceedings of the 2024 7th International Conference on Computers in Management and Business (pp. 133–143). https://doi.org/10.1145/3647782.3647803
  • Liu, J. (2025, October). AI-powered automated and remote UX evaluation methods: A systematic literature review. In Proceedings of the 43rd ACM International Conference on Design of Communication (pp. 10–16). https://doi.org/10.1145/3711670.3764614
  • Long, H. A., French, D. P., & Brooks, J. M. (2020). Optimising the value of the Critical Appraisal Skills Programme (CASP) tool for quality appraisal in qualitative evidence synthesis. Research Methods in Medicine & Health Sciences, 1(1), 31–42. https://doi.org/10.1177/2632084320947559
  • Mienye, I. D., Jere, N., Obaido, G., Ogunruku, O. O., Esenogho, E., & Modisane, C. (2025). Large language models: An overview of foundational architectures, recent trends, and a new taxonomy. Discover Applied Sciences, 7(9), Article 1027. https://doi.org/10.1007/s42452-025-07668-w
  • Mohammad, A., & Chirchir, B. (2024). Challenges of integrating artificial intelligence in software project planning: A systematic literature review. Digital, 4(3), 555–571. https://doi.org/10.3390/digital4030028
  • Patel, S., & Dholakiya, R. A. (2025, August). Large language models: Evolution, architecture, applications, and future horizons. In 2025 5th International Conference on Soft Computing for Security Applications (ICSCSA) (pp. 1922–1929). IEEE. https://doi.org/10.1109/ICSCSA66339.2025.11170884
  • Phillips, M., Reed, J. B., Zwicky, D., & Van Epps, A. S. (2024a). A scoping review of engineering education systematic reviews. Journal of Engineering Education, 113(4), 818–837. https://doi.org/10.1002/jee.20549
  • Phillips, M., Reed, J. B., Zwicky, D., Van Epps, A. S., Buhler, A. G., Rowley, E. M., … Zakharov, W. (2024b). Systematic reviews in the engineering literature: A scoping review. IEEE Access, 12, 62648–62663. https://doi.org/10.1109/ACCESS.2024.3394755
  • Prabhune, S., & Berndt, D. J. (2024). Deploying large language models with retrieval augmented generation. arXiv. https://doi.org/10.48550/arXiv.2411.11895
  • Puhakka, O. (2025). Usability of local large language models and retrieval augmented generation in health care [Bachelor's thesis, University of Oulu]. https://urn.fi/URN:NBN:fi:oulu-202505083171
  • Scherbakov, D., Hubig, N., Jansari, V., Bakumenko, A., & Lenert, L. A. (2025). The emergence of large language models as tools in literature reviews: A large language model-assisted systematic review. Journal of the American Medical Informatics Association, 32(6), 1071–1086. https://doi.org/10.1093/jamia/ocaf063
  • Schillaci, Z. (2024). LLM adoption trends and associated risks. In Large language models in cybersecurity: Threats, exposure and mitigation (pp. 121–128). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-54827-7_13
  • Susnjak, T. (2023). PRISMA-DFLLM: An extension of PRISMA for systematic literature reviews using domain-specific finetuned large language models. arXiv. https://doi.org/10.48550/arXiv.2306.14905
  • Wang, S., Liu, W., Chen, J., Zhou, Y., Gan, W., Zeng, X., … Hao, J. (2024). GUI agents with foundation models: A comprehensive survey. arXiv. https://doi.org/10.48550/arXiv.2411.04890
  • Wang, Z., Chu, Z., Doan, T. V., Ni, S., Yang, M., & Zhang, W. (2025). History, development, and principles of large language models: An introductory survey. AI and Ethics, 5(3), 1955–1971. https://doi.org/10.1007/s43681-024-00583-7
  • Zhang, C., He, S., Qian, J., Li, B., Li, L., Qin, S., … Zhang, Q. (2024). Large language model-brained GUI agents: A survey. arXiv. https://doi.org/10.48550/arXiv.2411.18279
  • Zheng, Y., Chen, Y., Qian, B., Shi, X., Shu, Y., & Chen, J. (2025). A review on edge large language models: Design, execution, and applications. ACM Computing Surveys, 57(8), 1–35. https://doi.org/10.1145/3719664.

Author Biographies

  • Deyidi Mokoginta, Universitas Teknologi Sulawesi Utara

    Department of Electrical Engineering, Universitas Teknologi Sulawesi Utara, Manado City, North Sulawesi Province, Indonesia

License

Copyright (c) 2026 Deyidi Mokoginta

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

This is an open-access journal. All articles are distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Under this license, you are free to:

  • Share: Copy and redistribute the material in any medium or format.
  • Adapt: Remix, transform, and build upon the material for any purpose, even commercially.

Attribution Requirements:
You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

Copyright and Retention:
Authors retain copyright without restrictions and grant this journal the right of first publication under an open-access model. The journal retains non-exclusive publishing rights for archiving, indexing, and scholarly dissemination.

Usage Statistics