Electrophysiology, agent-based modeling and inverse optimal control applications in neuroethology

Pleurobranchaea;Decision-making;Agent-based model;foraging;Pleurobranchaea californica;Inverse Optimal Control;Markov Processes;Markov Chain;Markov decision process;Netlogo

Catanho, Marianne ; Coleman ; Todd P.

关键词: Pleurobranchaea;    Decision-making;    Agent-based model;    foraging;    Pleurobranchaea californica;    Inverse Optimal Control;    Markov Processes;    Markov Chain;    Markov decision process;    Netlogo;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/31205/Catanho_Marianne.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

Decision-making is based on the integration of sensory information, motivational states and memory, from which assessment of outcomes and optimal action selection emerge. In foraging, animals tend to make decisions that reconcile two core goals: energy maximization and time minimization. The predatory sea-slug Pleurobranchaea californica has a simple, accessible nervous system and exhibits a repertory of simple behavioral elements that constitute effective foraging strategies. In this thesis, we introduce initial findings of sensory neurons identified through intracellular staining and electrophysiology,potentially linked to central sensory processing in the Pleurobranchaea. To further expand the principles underlying sensory integration and behavioral selection, we implemented a multi-agent based NetLogo simulation to model autonomous decision-making in the predatory sea-slug Pleurobranchaea.In particular, the model incorporated cost-benefit decisions in foraging by integrating sensation, internal state and learning in the virtual agent, replicating the particular behavioral selection process of the Pleurobranchaea. Finally, we propose two Markov decision processes to model how the animal makes decisions in its environment. Given the observed behaviors, we utilize inverse optimal control to succinctly characterize a class of utility functions the animal is maximizing. This research methodology combines principles from neurophysiology, agent-based modeling, classical conditioning, Bayesian statistics and control theory to investigateforaging decisions of the Pleurobranchaea, as it integrates sensation, internal state and learning mechanisms.