Tag: Bias

Language models cannot reliably distinguish belief from knowledge and fact

Featured Database

Author: Suzgun, Mirac; Gur, Tayfun; Bianchi, Federico; Ho, Daniel E.; Icard, Thomas; Jurafsky, Dan; Zou, James Description: As language models (LMs) increasingly infiltrate into high-stakes domains such as law, medicine, journalism and science, their ability to distinguish belief from knowledge, and fact from fiction, becomes imperative. Failure to make such distinctions can mislead diagnoses, distort judicial judgments and amplify misinformation. Here we evaluate 24 cutting-edge LMs using a new KaBLE benchmark of 13,000 questions across 13 epistemic tasks. Our findings reveal crucial limitations. In particular, all models tested systematically fail…

See more and a link to full text

The Medium is the Message: How Non-Clinical Information Shapes Clinical Decisions in LLMs

Featured Database

Author: Gourabathina, Abinitha; Gerych, Walter; Pan, Eileen; Ghassemi, Marzyeh Description: The integration of large language models (LLMs) into clinical diagnostics necessitates a careful understanding of how clinically irrelevant aspects of user inputs directly influence generated treatment recommendations and, consequently, clinical outcomes for end-users. Building on prior research that examines the impact of demographic attributes on clinical LLM reasoning, this study explores how non-clinically relevant attributes shape clinical decision-making by LLMs. Through the perturbation of patient messages, we evaluate whether LLM behavior remains consistent, accurate, and unbiased when non-clinical information is…

See more and a link to full text

Political ideology, emotion response, and confirmation bias

Featured Database

Author: Dickinson, David L. Description: Motivated reasoning can serve to help resolve emotional discomfort, which suggests emotion as a likely moderator of such reasoning. This paper addresses a gap in the literature by examining emotion and confirmation bias in the political domain. Results from two preregistered studies, which involved over 900 unique participants, document a confirmation bias across distinct dimensions of belief and preference formation. Also, ideologically dissonant information significantly worsens self-reported emotion. With some exceptions, the evidence generally supports the hypothesis that negative emotion moderates the strength of the…

See more and a link to full text

The Psychology of Prejudice: Ingroup Love and Outgroup Hate?

Featured Database

Author: Brewer, M. Description: Allport (1954) recognized that attachment to one’s ingroups does not necessarily require hostility toward outgroups. Yet the prevailing approach to the study of ethnocentrism, ingroup bias, and prejudice presumes that ingroup love and outgroup hate are reciprocally related. Findings from both cross-cultural research and laboratory experiments support the alternative view that ingroup identification is independent of negative attitudes toward outgroups and that much ingroup bias and intergroup discrimination is motivated by preferential treatment of ingroup members rather than direct hostility toward outgroup members. Thus to understand…

See more and a link to full text
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.