Variation and Instability in Dialect-Based Embedding Spaces
| dc.contributor.author | Dunn, Jonathan | |
| dc.date.accessioned | 2023-04-19T23:21:54Z | |
| dc.date.available | 2023-04-19T23:21:54Z | |
| dc.date.issued | 2023 | en |
| dc.date.updated | 2023-04-13T03:27:57Z | |
| dc.description.abstract | This paper measures variation in embedding spaces which have been trained on different regional varieties of English while controlling for instability in the embeddings. While previous work has shown that it is possible to distinguish between similar varieties of a language, this paper experiments with two follow-up questions: First, does the variety represented in the training data systematically influence the resulting embedding space after training? This paper shows that differences in embeddings across varieties are significantly higher than baseline instability. Second, is such dialectbased variation spread equally throughout the lexicon? This paper shows that specific parts of the lexicon are particularly subject to variation. Taken together, these experiments confirm that embedding spaces are significantly influenced by the dialect represented in the training data. This finding implies that there is semantic variation across dialects, in addition to previously studied lexical and syntactic variation. | en |
| dc.identifier.citation | Dunn J (2023). Variation and Instability in Dialect-Based Embedding Spaces. Proceedings of the Workshop on NLP for Similar Languages, Varieties and Dialects. | en |
| dc.identifier.doi | http://doi.org/10.48550/arXiv.2303.14963 | |
| dc.identifier.uri | https://hdl.handle.net/10092/105359 | |
| dc.language.iso | en | en |
| dc.publisher | Association for Computational Linguistics | en |
| dc.rights | All rights reserved unless otherwise stated | en |
| dc.rights.uri | http://hdl.handle.net/10092/17651 | en |
| dc.subject.anzsrc | Fields of Research::47 - Language, communication and culture::4704 - Linguistics::470403 - Computational linguistics | en |
| dc.title | Variation and Instability in Dialect-Based Embedding Spaces | en |
| dc.type | Conference Contributions - Published | en |
| uc.college | Faculty of Arts | |
| uc.department | Language, Social and Political Sciences |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Dunn.VarDial_2023.pdf
- Size:
- 426.31 KB
- Format:
- Adobe Portable Document Format
- Description:
- Accepted version