Representations of Language Varieties Are Reliable Given Corpus Similarity Measures

Simple item page
dc.contributor.authorDunn, Jonathan
dc.date.accessioned2021-04-29T04:42:32Z
dc.date.available2021-04-29T04:42:32Z
dc.date.issued2021en
dc.date.updated2021-04-03T00:48:56Z
dc.description.abstractThis paper measures similarity both within and between 84 language varieties across nine languages. These corpora are drawn from digital sources (the web and tweets), allowing us to evaluate whether such geo-referenced corpora are reliable for modelling linguistic variation. The basic idea is that, if each source adequately represents a single underlying language variety, then the similarity between these sources should be stable across all languages and countries. The paper shows that there is a consistent agreement between these sources using frequency-based corpus similarity measures. This provides further evidence that digital geo-referenced corpora consistently represent local language varieties.en
dc.identifier.citationDunn J (2021). Representations of Language Varieties Are Reliable Given Corpus Similarity Measures. Proceedings of the EACL 2021 Eighth Workshop on NLP for Similar Languages, Varieties and Dialects. Proceedings of the EACL 2021 Eighth Workshop on NLP for Similar Languages, Varieties and Dialects.en
dc.identifier.urihttps://hdl.handle.net/10092/101847
dc.language.isoen
dc.publisherAssociation for Computational Linguisticsen
dc.rightsAll rights reserved unless otherwise stateden
dc.rights.urihttp://hdl.handle.net/10092/17651en
dc.subject.anzsrcField of Research::20 - Language, Communication and Culture::2004 - Linguistics::200402 - Computational Linguisticsen
dc.subject.anzsrcField of Research::20 - Language, Communication and Culture::2004 - Linguistics::200406 - Language in Time and Space (incl. Historical Linguistics, Dialectology)en
dc.titleRepresentations of Language Varieties Are Reliable Given Corpus Similarity Measuresen
dc.typeConference Contributions - Publisheden
uc.collegeFaculty of Arts
uc.departmentLanguage, Social and Political Sciences
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Dunn.VarDial_2021.pdf
Size:
568.71 KB
Format:
Adobe Portable Document Format
Description:
Accepted version
Download
Collections
Arts: Conference Contributions