Mapping Distributional Semantics to Property Norms with Deep Neural Networks

Big Data and Cognitive Computing

卷:3

Douglas Summers-Stay¹  Dandan Li¹ 

[1] U.S. Army Research Laboratory, Adelphi, MD 20783, USA;

关键词: distributional semantics;    word embeddings;    property norm;    neural networks;   

DOI  :  10.3390/bdcc3020030

来源: DOAJ

【 摘 要 】

Word embeddings have been very successful in many natural language processing tasks, but they characterize the meaning of a word/concept by uninterpretable “context signatures”. Such a representation can render results obtained using embeddings difficult to interpret. Neighboring word vectors may have similar meanings, but in what way are they similar? That similarity may represent a synonymy, metonymy, or even antonymy relation. In the cognitive psychology literature, in contrast, concepts are frequently represented by their relations with properties. These properties are produced by test subjects when asked to describe important features of concepts. As such, they form a natural, intuitive feature space. In this work, we present a neural-network-based method for mapping a distributional semantic space onto a human-built property space automatically. We evaluate our method on word embeddings learned with different types of contexts, and report state-of-the-art performances on the widely used McRae semantic feature production norms.

【 授权许可】

Unknown