The Framework Integration Approach for Large Language Model Governance in Enterprise Systems

Saut Jenifer Tambunan; Mohammad Achmad Amin Soetomo; Heru Purnomo Ipung

doi:10.38043/tiers.v7i1.7646

Authors

Saut Jenifer Tambunan Swiss German University, Indonesia
Mohammad Achmad Amin Soetomo Swiss German University, Indonesia
Heru Purnomo Ipung Swiss German University, Indonesia

DOI:

https://doi.org/10.38043/tiers.v7i1.7646

Keywords:

LLM, Data Governance, Enterprise Systems, Acumatica ERP, TOGAF, DAMA-DMBOK, COBIT

Abstract

Large Language Model (LLM) integration in enterprise systems lacks comprehensive governance frameworks, creating risks in data quality, regulatory compliance, and decision transparency. This study aims to: (1) evaluate data quality management practices affecting LLM output reliability, (2) identify effective governance controls for regulatory compliance, and (3) develop transparency mechanisms for LLM decision-making in enterprise contexts. Through qualitative research employing Focus Group Discussions with five domain experts and pilot implementation using Llama 3.2:3B model in Acumatica ERP, this study develops a preliminary governance framework tailored for Indonesian distribution businesses. Key findings reveal: the "context problem" where LLMs produce technically accurate but business-irrelevant outputs (100% expert consensus), solved through Business-Driven Templates embedding three context types (Data, Process, Business). The integrated TOGAF-DAMA-DMBOK-COBIT framework achieved 88% expert agreement with pilot scenarios demonstrating 80-100% success rates. Resource allocation analysis shows 45% priority for data quality, 25% governance controls, 15% transparency mechanisms, and 15% training. This research contributes: (1) empirically-validated three-framework integration for LLM governance, (2) discovery and solution of the "context problem" through Business-Driven Templates, and (3) Indonesian-specific implementation roadmap reducing deployment from 18-24 to 9-12 months while addressing UU 27/2022 compliance and SMB constraints.

Downloads

Download data is not yet available.

References

T. H. Davenport, Putting the enterprise into the enterprise system, Harv. Bus. Rev., vol. 76, no. 4, pp. 121131, 1998, [Online]. Available: https://hbr.org/1998/07/putting-the-enterprise-into-the-enterprise-system

B. Min et al., Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey, ACM Comput. Surv., vol. 56, no. 2, Feb. 2024, doi: 10.1145/3605943.

M. Zdravkovi and H. Panetto, Artificial intelligence-enabled enterprise information systems, 2022, Taylor and Francis Ltd. doi: 10.1080/17517575.2021.1973570.

K. Gangapatnam, Revolutionizing Enterprise Resource Planning Through AI Integration: A Technical Deep Dive, European Journal of Computer Science and Information Technology, vol. 13, no. 15, pp. 5569, Apr. 2025, doi: 10.37745/ejcsit.2013/vol13n155569.

S. Mohammed, L. Ehrlinger, H. Harmouch, F. Naumann, and D. Srivastava, Data Quality Assessment: Challenges and Opportunities, Dec. 2024, doi: https://doi.org/10.48550/arXiv.2403.00526.

L. Ehrlinger and W. W, A Survey of Data Quality Measurement and Monitoring Tools, Mar. 31, 2022, Frontiers Media S.A. doi: 10.3389/fdata.2022.850611.

L. Cai and Y. Zhu, The challenges of data quality and data quality assessment in the big data era, in Data Science Journal, Committee on Data for Science and Technology, 2015. doi: 10.5334/dsj-2015-002.

T. R. McIntosh et al., From COBIT to ISO 42001: Evaluating cybersecurity frameworks for opportunities, risks, and regulatory compliance in commercializing large language models, Comput. Secur., vol. 144, p. 103964, Sep. 2024, doi: 10.1016/j.cose.2024.103964.

Y. Duan, J. S. Edwards, and Y. K. Dwivedi, Artificial intelligence for decision making in the era of Big Data-evolution, challenges and research agenda, Int. J. Inf. Manage., vol. 48, pp. 6371, 2019, doi: https://doi.org/10.1016/j.ijinfomgt.2019.01.021.

V. Khatri and C. V. Brown, Designing data governance, Commun. ACM, vol. 53, no. 1, pp. 148152, Jan. 2010, doi: 10.1145/1629175.1629210.

M. Janssen, P. Brous, E. Estevez, L. S. Barbosa, and T. Janowski, Data governance: Organizing data for trustworthy Artificial Intelligence, Gov. Inf. Q., vol. 37, no. 3, Jul. 2020, doi: 10.1016/j.giq.2020.101493.

J. Schneider, R. Abraham, C. Meske, and J. Vom Brocke, Artificial Intelligence Governance For Businesses, Information Systems Management, vol. 40, no. 3, pp. 229249, 2023, doi: 10.1080/10580530.2022.2085825.

The Open Group, The TOGAF Standard, 10th Edition. Hertogenbosch: Van Haren Publishing, 2022. [Online]. Available: https://www.opengroup.org/togaf

G. of Indonesia, Undang-Undang Nomor 27 Tahun 2022 tentang Pelindungan Data Pribadi. Jakarta: Government of Indonesia, 2022. [Online]. Available: https://peraturan.bpk.go.id/Home/Details/229798/uu-no-27-tahun-2022

I. M. Enholm, E. Papagiannidis, P. Mikalef, and J. Krogstie, Artificial Intelligence and Business Value: a Literature Review, Information Systems Frontiers, 2022, doi: 10.1007/s10796-021-10186-w/Published.

Acumatica, AI-Powered ERP Solutions - Acumatica Artificial Intelligence, 2025. [Online]. Available: https://www.acumatica.com/cloud-erp-software/artificial-intelligence/

J. Jhnk, M. Weiert, and K. Wyrtki, Ready or Not, AI Comes An Interview Study of Organizational AI Readiness Factors, Business and Information Systems Engineering, vol. 63, no. 1, pp. 520, Feb. 2021, doi: 10.1007/s12599-020-00676-7.

P. Mikalef and M. Gupta, Artificial intelligence capability: Conceptualization, measurement calibration, and empirical study on its impact on organizational creativity and firm performance, Information and Management, vol. 58, no. 3, Apr. 2021, doi: 10.1016/j.im.2021.103434.

S. Sarferaz, Implementing Generative AI Into ERP Software, IEEE Access, vol. 13, pp. 7334273354, 2025, doi: 10.1109/ACCESS.2025.3564133.

N. V K Abhinav Vedanbhatla, LLMs as AI Middleware: Unifying Disparate Systems in Manufacturing IT Landscapes, 2025, doi: 10.32996/jcsts.

H. Gong et al., TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching, International Committee on Computational Linguistics, pp. 19781988, 2020, doi: 10.18653/v1/2020.coling-main.179.

F. Nargesian, E. Zhu, R. J. Miller, K. Q. Pu, and P. C. Arocena, Data lake management: Challenges and opportunities, in Proceedings of the VLDB Endowment, VLDB Endowment, 2018, pp. 19861989. doi: 10.14778/3352063.3352116.

E. Niederwieser, D. Siegele, and D. T. Matt, AI-Driven ERP Systems: Integrating Large Language Models for Enhanced Customer Interaction and Operational Efficiency, Zeitschrift fr wirtschaftlichen Fabrikbetrieb, vol. 120, no. s1, pp. 112117, 2025, doi: 10.1515/zwf-2025-0007.

H. P. Ipung, A Novel Enterprise Artificial Intelligence Architecture Framework (NAEF) for Business Capabilities to Decisions/Insights Analysis, in 2024 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), IEEE, 2024, pp. 678683.

P. Liu, W. Yuan, J. Fu, Z. Jiang, H. Hayashi, and G. Neubig, Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing, ACM Comput. Surv., vol. 55, no. 9, Sep. 2023, doi: 10.1145/3560815.

A. Taeihagh, Governance of artificial intelligence, Policy Soc., vol. 40, no. 2, pp. 137157, 2021, doi: 10.1080/14494035.2021.1928377.

M. Philibert, LLM-Powered Business Process Modelling in Small and Medium Enterprises, University of Turku, 2025. [Online]. Available: https://urn.fi/URN:NBN:fi-fe2025070377053

R. Abraham, J. Schneider, and J. vom Brocke, Data governance: A conceptual framework, structured review, and research agenda, Dec. 01, 2019, Elsevier Ltd. doi: 10.1016/j.ijinfomgt.2019.07.008.

I. Alhassan, D. Sammon, and M. Daly, Critical Success Factors for Data Governance: A Theory Building Approach, Information Systems Management, vol. 36, no. 2, pp. 98110, Apr. 2019, doi: 10.1080/10580530.2019.1589670.

Inc. Meta Platforms, Llama 3.2: Revolutionizing edge AI and vision with open, customizable models, 2024, Meta Platforms, Inc. [Online]. Available: https://ai.meta.com/blog/llama-3-2/

ISACA, COBIT 2019 Framework: Introduction and Methodology. Rolling Meadows, IL, USA: ISACA, 2018. [Online]. Available: https://www.isaca.org/resources/cobit

F. Gampfer, A. Jrgens, M. Mller, and R. Buchkremer, Past, current and future trends in enterprise architectureA view beyond the horizon, Sep. 01, 2018, Elsevier B.V. doi: 10.1016/j.compind.2018.03.006.

L. Fabri, B. Hckel, A. M. Oberlnder, M. Rieg, and A. Stohr, Disentangling Human-AI Hybrids: Conceptualizing the Interworking of Humans and AI-Enabled Systems, Business and Information Systems Engineering, vol. 65, no. 6, pp. 623641, Dec. 2023, doi: 10.1007/s12599-023-00810-1.

B. Otto, Organizing Data Governance: Findings from the telecommunications industry and consequences for large service providers, Communications of the Association for Information Systems, vol. 29, no. 1, pp. 4566, 2011, doi: 10.17705/1cais.02903.