[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access
Just Accepted

USING LARGE LANGUAGE MODELS FOR ARMCHAIR AUDITORS

Online AM: 02 July 2024 Publication History

Abstract

Armchair auditors are citizens who use open data to investigate and monitor government activities, typically using analytics and other approaches. Armchair auditors provide a valuable role in holding governments and organizations accountable. This paper investigates the potential use of large language models (LLM) to support armchair auditor analyzes of different governmental entities. Unfortunately, the literature, prior to the development of LLM suggested several challenges for armchair auditors. However, the analysis in this paper suggests that LLM can provide substantial data and analytic process support for armchair auditors mitigating issues such as, providing guidelines for analyses, guiding users to appropriate communities, suggesting potential data availability opportunities, doing analysis and other issues. As part of an approach to unifying armchair auditor searches, this paper also suggests a prompt library designed to support, standardize and promote best practice analyzes among armchair auditors. In addition to these issues, this paper also analyzes emerging ethical issues associated with armchair auditors and their use of open data and LLMs. Finally, this paper extends the activity theory model to account for LLMs.

References

[1]
BBC, 2009, Cameron in 'people power' pledge, http://news.bbc.co.uk/2/hi/uk_news/politics/8067505.stm, Last accessed on January 10, 2024.
[2]
Brynjolfsson, E., Li, D. and Raymond, L.R., 2023. Generative AI at work (No. w31161). National Bureau of Economic Research.
[3]
Cameron, D., 2009, A new politics: The post-bureaucratic age, https://www.theguardian.com/commentisfree/2009/may/25/david-cameron-a-new-politics3, Last accessed on January 10, 2024.
[4]
Chamola, V., V. Hassija, A. R. Sulthana, D. Ghosh, D. Dhingra and B. Sikdar (2023). "A Review of Trustworthy and Explainable Artificial Intelligence (XAI)." IEEE Access 11: 78994-79015.
[5]
Engestrom, Y. 1987. Learning by Expanding: An Activity-Theoretical Approach to Developmental Research. Helsinki, Finland: Orientakonsultit. Available at: http://www.lchc.ucsd.edu/MCA/Paper/Engestrom/expanding/toc.htm – Accessed on January 10, 2024.
[6]
Hayek, F. 1945. The use of knowledge in society. American Economic Review 35, 4 (1945), 519–530.
[7]
Malinova, M. and J. Mendling (2021). "COGNITIVE DIAGRAM UNDERSTANDING AND TASK PERFORMANCE IN SYSTEMS ANALYSIS AND DESIGN." MIS Quarterly 45(4): 2101-2157.
[8]
O'Leary, D.E., 2015. Armchair auditors: Crowdsourcing analysis of government expenditures. Journal of Emerging Technologies in Accounting, 12, 1 (2015), 71-91.
[9]
O'Leary, D.E., 2016. Ethics for big data and analytics. IEEE Intelligent Systems, 31(4), pp.81-84.
[10]
O'Leary, D.E., 2022. Massive data language models and conversational artificial intelligence: Emerging issues. Intelligent Systems in Accounting, Finance and Management, 29(3), pp.182-198.
[11]
Schmude, T., L. Koesten, T. Möller and S. Tschiatschek (2023). On the Impact of Explanations on Understanding of Algorithmic Decision-Making. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, Association for Computing Machinery: 959–970.
[12]
Zhang, C. Y., S. Cho and M. Vasarhelyi (2022). "Explainable Artificial Intelligence (XAI) in auditing. International Journal of Accounting Information Systems 46: 22.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Digital Government: Research and Practice
Digital Government: Research and Practice Just Accepted
EISSN:2639-0175
Table of Contents
This work is licensed under a Creative Commons Attribution-NoDerivs International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Online AM: 02 July 2024
Accepted: 11 June 2024
Revision received: 25 March 2024
Received: 30 January 2024

Check for updates

Author Tags

  1. Activity Theory
  2. Large Language Models
  3. Armchair Auditor
  4. Open Data
  5. ChatGPT
  6. BARD

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 168
    Total Downloads
  • Downloads (Last 12 months)168
  • Downloads (Last 6 weeks)32
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media