arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

Large Language Models Can Amplify Demographic Inequities in Content Recommendation | arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
cs.CYEnglishPublished

Large Language Models Can Amplify Demographic Inequities in Content Recommendation

November 12, 2026arXiv: 2610.41854v1

Large language models (LLMs) used in online recommendation systems can favor certain kinds of content and, through that preference, surface the voices of particular demographic groups more often than others. In a controlled experiment, researchers fed 10,000 posts from 1,000 unique authors—each author’s age, gender, race, education, income, marital status, religiosity, ideology, and partisan lean were verified—into 90 ranking conditions that varied the LLM provider (three different providers), the prompt style (six variants), and the amount of contextual information (five levels ranging from text only to full platform metadata and explicit demographic disclosure). The results show that even when only the text of a post is given, models consistently recommend longer, more negative, and more opinionated posts, particularly those about news and social concerns. These content preferences vary across authors, and they produce systematic demographic skews: older, male, more educated, and higher‑income authors are often over‑represented, while the exact strength and sometimes direction of the effect differ by provider.

Visualization of model selection preferences when only post text is provided, highlighting higher rates of longer, negatively valenced, and opinionated posts in the news and social‑concern topics.
Directional selection patterns in the text‑only condition, showing that models favor longer, more negative, more opinion‑laden posts, and particularly news and social‑concern content.
Figure 2.
Pagan, Nicolò, Törnberg, Petter, Bail, Christopher A., Barrie, Christopher · arXiv:2610.41854v1 · Figure 2: · CC BY 4.0

When platform metadata such as follower counts and engagement metrics is added, the models begin to rely heavily on those signals. The predictive power of post likes and retweets jumps from near zero to almost one‑fifth of a point more than before, making high‑engagement posts—and the authors who regularly generate such engagement—more likely to be recommended. This amplification of already existing demographic differences is largely driven by the fact that users with larger followings tend to post longer, more negative content, and the models implicitly learn to favour those signals.

Graph showing how platform metadata boosts the explanatory power of engagement metrics for recommendation ranking and widens follower count disparity among recommended authors, with minimal impact from demographic disclosure.
Figure 5. Effects of platform context on feature predictability and recommended values, illustrating how adding engagement signals increases predictability of post likes and retweets and amplifies author follower differences, while explicit demographic disclosure has little effect once these signals are available.Pagan, Nicolò, Törnberg, Petter, Bail, Christopher A., Barrie, Christopher · arXiv:2610.41854v1 · Figure 5: · CC BY 4.0

Providing explicit author demographics to the model, however, changes its recommendations very little once textual and platform signals are available. The models already capture much of the demographic signal through engagement patterns and content style, so disclosing demographics does not significantly alter which posts are surfaced.

The study’s findings underscore that LLM‑based recommendation systems are capable of reproducing and even magnifying demographic inequality, not by using demographics directly but by relying on content and engagement signals that are themselves socially structured. The authors caution that their sample is not representative of the broader social media user base and that the experiment does not include personalization, repeated exposure, or feedback loops that could further affect visibility.

The visual evidence from Figure 2 illustrates how LLMs prefer longer, more negative, and more opinionated content in the text‑only condition, while Figure 5 shows how platform metadata amplifies existing skews through engagement signals and that adding explicit demographics has a small effect once these signals are present.

Source paper

LLM Recommenders Produce Demographic Inequality Through Content Preferences

cs.CYcs.SI
View on arXiv