Files and links (1)
Published VersionCC BY V4.0, Open Access
Journal article
AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War
Philosophy & Technology, Vol.38, pp.1-27
2025
Appears in UniSC Supported Open Access Outputs
Abstract
Generative AI is increasingly used as an epistemic tool to aid inquiry, broaden our knowledge and generally help us find things out. It is now embedded in internet search functions to condense information and answer user questions without further need to access websites or news articles. However, models based on generative AI come with inherent flaws which may inhibit their effectiveness as tools to aid responsible inquiry. While the risk of misinformation due to ‘hallucinations’ has been documented, this paper instead focuses on the capacity for these models to present moral or political bias reflective of the preferences of the model designers and crowd worker labellers. This paper takes the novel approach of tracing the ethical issue of bias back to fundamental alignment problem within the process of Reinforced Learning from Human Feedback (RLHF), a key step in training generative AI models. The potential for language models to be influenced by their designers, censored to certain topics, or trained to be more politically leaning one way or another has the capability of insidiously causing epistemic harm. By applying the concepts of bias of crowds to the training process of language models I show how they can impede effective epistemic inquiry and cause epistemic and moral harm. In doing so I present an argument showing that the ethics of AI language models cannot be removed from the socio-technical systems from which they are created.
Details
- Title
- AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War
- Authors
- Declan Humphreys (Corresponding Author) - University of the Sunshine Coast, Queensland, School of Science, Technology and Engineering
- Publication details
- Philosophy & Technology, Vol.38, pp.1-27
- Publisher
- Springer Dordrecht
- Date published
- 2025
- DOI
- 10.1007/s13347-025-00928-y
- ISSN
- 2210-5441; 2210-5433
- Copyright note
- This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
- Organisation Unit
- School of Science, Technology and Engineering
- Language
- English
- Record Identifier
- 991148640102621
- Output Type
- Journal article
Metrics
2 File views/ downloads
24 Record Views