Mapping Languages and Demographics with Georeferenced Corpora (2019)
AuthorsDunn J, Adams Bshow all
This paper evaluates large georeferenced corpora, taken from both web-crawled and social media sources, against ground-truth population and language-census datasets. The goal is to determine (i) which dataset best represents population demographics; (ii) in what parts of the world the datasets are most representative of actual populations; and (iii) how to weight the datasets to provide more accurate representations of underlying populations. The paper finds that the two datasets represent very different populations and that they correlate with actual populations with values of r = 0.60 (social media) and r = 0.49 (web-crawled). Further, Twitter data makes better predictions about the inventory of languages used in each country.
CitationDunn J, Adams B (2019). Mapping Languages and Demographics with Georeferenced Corpora. Proceedings of Geocomputation 2019.
This citation is automatically generated and may be unreliable. Use as a guide only.
Keywordsuser-generated content; crowdsourcing; language; demographics; population
ANZSRC Fields of Research20 - Language, Communication and Culture::2004 - Linguistics::200406 - Language in Time and Space (incl. Historical Linguistics, Dialectology)
20 - Language, Communication and Culture::2004 - Linguistics::200402 - Computational Linguistics
16 - Studies in Human Society::1603 - Demography::160399 - Demography not elsewhere classified
16 - Studies in Human Society::1604 - Human Geography::160403 - Social and Cultural Geography