A sensorimotor basis of speech communication

speech;langauge;artificial intelligence;speech signal processing;speech communication;speech articulation;sensorimotor primitives;speech primitives;variational autoencoder;inverse channel encoder

Bryan, Jacob

关键词: speech;    langauge;    artificial intelligence;    speech signal processing;    speech communication;    speech articulation;    sensorimotor primitives;    speech primitives;    variational autoencoder;    inverse channel encoder;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/104777/BRYAN-DISSERTATION-2019.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

This dissertation presents the development of sensorimotor primitives as a means of constructing a language-agnostic model of speech communication. Insights from major theories in speech science and linguistics are used to develop a conceptual framework for sensorimotor primitives in the context of control and information theory. Within this conceptual framework, sensorimotor primitives are defined as a system transformation that simplifies the interface to some high dimensional and/or nonlinear system. In the context of feedback control, sensorimotor primitives take the form of a feedback transformation. In the context of communication, sensorimotor primitives are represented as a channel encoder and decoder pair. Using a high fidelity simulation of articulatory speech synthesis, these realizations of sensorimotor primitives are respectively applied to feedback control of the articulators, and communication via the acoustic speech signal. Experimental results demonstrate the construction of a model of speech communication that is capable of both transmitting and receiving information, and imitating simple utterances.