---
title: "Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)"
description: "Many language models repeatedly land on the same small set of ideas for open-ended prompts. Follow Infinity-Chat, the within-model and across-model similarity measurements, the human study, and a 2026 critique showing why the null baseline changes the strength of the claim."
canonical_url: "https://fanout.sh/daily/2026-11-12-artificial-hivemind-homogeneity"
md_url: "https://fanout.sh/daily/2026-11-12-artificial-hivemind-homogeneity.md"
last_updated: "2026-11-12"
access: "public"
---

# Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)

Many language models repeatedly land on the same small set of ideas for open-ended prompts. Follow Infinity-Chat, the within-model and across-model similarity measurements, the human study, and a 2026 critique showing why the null baseline changes the strength of the claim.

## Paper details

- Authors: Liwei Jiang, Yuanjun Chai, Margaret Li, Mickel Liu, Raymond Fok, Nouha Dziri, Yulia Tsvetkov, Maarten Sap, Alon Albalak, and Yejin Choi

- Venue: NeurIPS 2025 Best Paper

- Track: AI Research

- Difficulty: Medium

- Reading time: 15 min

- Original paper: https://arxiv.org/abs/2510.22954v2

## What you will learn

- How fifty samples, response embeddings, and pairwise cosine similarity turn a cloud of open-ended answers into a homogeneity measurement.

- Why high overlap appears within one model and across model families, even under more aggressive sampling settings.

- How a same-prompt, different-idea null weakens the headline interpretation without erasing the residual effect, and what a production diversity audit should measure next.

## Continue exploring

[Compare metric sensitivity](https://fanout.sh/daily/2026-10-16-emergent-abilities-mirage): See another case where a measurement choice changes the apparent shape of a language-model capability.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md
