Compositional Distributional Semantics with Syntactic Dependencies and Selectional Preferences

Applied Sciences

Pablo Gamallo¹ 

[1] Centro de Investigación en Tecnoloxías da Información (CiTIUS), USC, 15705 Santiago de Compostela, Galicia, Spain;

关键词: compositionality;    dependency parsing;    meaning construction;    compositional distributional semantics;    transformer architecture;    contextualized word embeddings;   

DOI  :  10.3390/app11125743

来源: DOAJ

【 摘 要 】

This article describes a compositional model based on syntactic dependencies which has been designed to build contextualized word vectors, by following linguistic principles related to the concept of selectional preferences. The compositional strategy proposed in the current work has been evaluated on a syntactically controlled and multilingual dataset, and compared with Transformer BERT-like models, such as Sentence BERT, the state-of-the-art in sentence similarity. For this purpose, we created two new test datasets for Portuguese and Spanish on the basis of that defined for the English language, containing expressions with noun-verb-noun transitive constructions. The results we have obtained show that the linguistic-based compositional approach turns out to be competitive with Transformer models.

【 授权许可】

Unknown