[2604.21751] Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs

Abstract:LLMs have been showing limitations when it comes to cultural coverage and competence, and in some cases show regional biases such as amplifying Western and Anglocentric viewpoints. While there have been works analysing the cultural capabilities of LLMs, there has not been specific work on highlighting LLM regional preferences when it comes to cultural-related questions. In this work, we propose a new dataset based on a comprehensive taxonomy of Culture-Related Open Questions (CROQ). The results show that, contrary to previous cultural bias work, LLMs show a clear tendency towards countries such as Japan. Moveover, our results show that when prompting in languages such as English or other high-resource ones, LLMs tend to provide more diverse outputs and show less inclinations towards answering questions highlighting countries for which the input language is an official language. Finally, we also investigate at which point of LLM training this cultural bias emerges, with our results suggesting that the first clear signs appear after supervised fine-tuning, and not during pre-training.

Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs * Joseba Fernandez de Landa1 Carla Perez-Almendros2 Jose Camacho-Collados2 1 HiTZ Center - Ixa, University of the Basque Country EHU 2…

saved by

• Vishal Waghmode

related reading

• [2303.17548] Whose Opinions Do Language Models Reflect?arxiv.org
• [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• [2606.04071] Covert Influence Between Language Modelsarxiv.org
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• What language do language models speak?tcz.hu
• [2606.06614] Re-Centering Humans in LLM Personalizationarxiv.org
• [2607.14345] Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Valuesarxiv.org
• 2308.03958arxiv.org
• [2605.27288] It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertaintyarxiv.org
• 2301.06627arxiv.org
• 2025.acl-srw.17.pdfaclanthology.org
• Training Language Models to Explain Their Own Computationsarxiv.org