Bayesian approaches to modelling action selection

We live in an uncertain world, and each decision may have many possible outcomes; choosing the best decision is thus complicated. This chapter describes recent research in Bayesian decision theory, which formalises the problem of decision making in the presence of uncertainty and often provides compact models that predict observed behaviour. With its elegant formalisation of the problems faced by the nervous system, it promises to become a major inspiration for studies in neuroscience. Introduction: Choosing the right action relies on our having the right information. The more information we have, the more capable we become at making intelligent decisions. Ideally, we want to know what the current state of the world is, what possible actions we can take in response to it, and what the outcomes of these actions will be. When we choose actions that will most clearly bring about our desired results, we are said to be behaving rationally (see Chapter 2). Equivalently, we could say that rational behaviour is optimal, in that this behaviour executes the best actions for achieving our desired results (see Chapters 3 and 4).