Research Borderlands: Analysing Writing Across Research Cultures

This is code for replicating the experiments in the paper Research Borderlands: Analysing Writing Across Research Cultures. In this work, we take a human-centered approach to discover and measure language-based cultural norms, and cultural competence of LLMs towards diverse research communities. Through a set of interviews with interdisciplinary researchers, who are experts at moving between cultures, we create a framework of structural, stylistic, rhetorical, and citational norms that vary across research cultures. We operationalise these features with a suite of computational metrics and use them for (a) surfacing latent cultural norms in human-written research papers at scale; and (b) highlighting the lack of cultural competence of LLMs, and their tendency to homogenize writing. The folder metrics contains the code for replicating the computational metrics for research writing.