Finance - Research Publications
Permanent URI for this collection
Search Results
1 - 10 of 16
-
ItemNo Preview AvailableModeling the Evolution of Beliefs Using an Attentional Focus Mechanism(PUBLIC LIBRARY SCIENCE, 2015-10-01)For making decisions in everyday life we often have first to infer the set of environmental features that are relevant for the current task. Here we investigated the computational mechanisms underlying the evolution of beliefs about the relevance of environmental features in a dynamical and noisy environment. For this purpose we designed a probabilistic Wisconsin card sorting task (WCST) with belief solicitation, in which subjects were presented with stimuli composed of multiple visual features. At each moment in time a particular feature was relevant for obtaining reward, and participants had to infer which feature was relevant and report their beliefs accordingly. To test the hypothesis that attentional focus modulates the belief update process, we derived and fitted several probabilistic and non-probabilistic behavioral models, which either incorporate a dynamical model of attentional focus, in the form of a hierarchical winner-take-all neuronal network, or a diffusive model, without attention-like features. We used Bayesian model selection to identify the most likely generative model of subjects' behavior and found that attention-like features in the behavioral model are essential for explaining subjects' responses. Furthermore, we demonstrate a method for integrating both connectionist and Bayesian models of decision making within a single framework that allowed us to infer hidden belief processes of human subjects.
-
ItemNo Preview AvailableThe impact of disappointment in decision making: inter-individual differences and electrical neuroimaging(FRONTIERS MEDIA SA, 2011-01-06)Disappointment, the emotion experienced when faced to reward prediction errors (RPEs), considerably impacts decision making (DM). Individuals tend to modify their behavior in an often unpredictable way just to avoid experiencing negative emotions. Despite its importance, disappointment remains much less studied than regret and its impact on upcoming decisions largely unexplored. Here, we adapted the Trust Game to effectively elicit, quantify, and isolate disappointment by relying on the formal definition provided by Bell's in economics. We evaluated the effects of experienced disappointment and elation on future cooperation and trust as well as the rationality and utility of the different behavioral and neural mechanisms used to cope with disappointment. All participants in our game trusted less and particularly expected less from unknown opponents as a result of disappointing outcomes in the previous trial but not necessarily after elation indicating that behavioral consequences of positive and negative RPEs are not the same. A large variance in the tolerance to disappointment was observed across subjects, with some participants needing only a small disappointment to impulsively bias their subsequent decisions. As revealed by high-density EEG recordings the most tolerant individuals - who thought twice before making a decision and earned more money - relied on different neural generators to contend with neutral and unexpected outcomes. This study thus provides some support to the idea that different neural systems underlie reflexive and reflective decisions within the same individuals as predicted by the dual-system theory of social judgment and DM.
-
ItemNo Preview AvailablePositive temporal dependence of the biological clock implies hyperbolic discounting(FRONTIERS RESEARCH FOUNDATION, 2011-01-01)Temporal preferences of animals and humans often exhibit inconsistencies, whereby an earlier, smaller reward may be preferred when it occurs immediately but not when it is delayed. Such choices reflect hyperbolic discounting of future rewards, rather than the exponential discounting required for temporal consistency. Simultaneously, however, evidence has emerged that suggests that animals and humans have an internal representation of time that often differs from the calendar time used in detection of temporal inconsistencies. Here, we prove that temporal inconsistencies emerge if fixed durations in calendar time are experienced as positively related (positive quadrant dependent). Hence, what are time-consistent choices within the time framework of the decision maker appear as time-inconsistent to an outsider who analyzes choices in calendar time. As the biological clock becomes more variable, the fit of the hyperbolic discounting model improves. A recent alternative explanation for temporal choice inconsistencies builds on persistent under-estimation of the length of distant time intervals. By increasing the expected speed of our stochastic biological clock for time farther into the future, we can emulate this explanation. Ours is therefore an encompassing theoretical framework that predicts context-dependent degrees of intertemporal choice inconsistencies, to the extent that context can generate changes in autocorrelation, variability, and expected speed of the biological clock. Our finding should lead to novel experiments that will clarify the role of time perception in impulsivity, with critical implications for, among others, our understanding of aging, drug abuse, and pathological gambling.
-
ItemNeural Mechanisms Behind Identification of Leptokurtic Noise and Adaptive Behavioral Response(OXFORD UNIV PRESS INC, 2016-04-01)Large-scale human interaction through, for example, financial markets causes ceaseless random changes in outcome variability, producing frequent and salient outliers that render the outcome distribution more peaked than the Gaussian distribution, and with longer tails. Here, we study how humans cope with this evolutionary novel leptokurtic noise, focusing on the neurobiological mechanisms that allow the brain, 1) to recognize the outliers as noise and 2) to regulate the control necessary for adaptive response. We used functional magnetic resonance imaging, while participants tracked a target whose movements were affected by leptokurtic noise. After initial overreaction and insufficient subsequent correction, participants improved performance significantly. Yet, persistently long reaction times pointed to continued need for vigilance and control. We ran a contrasting treatment where outliers reflected permanent moves of the target, as in traditional mean-shift paradigms. Importantly, outliers were equally frequent and salient. There, control was superior and reaction time was faster. We present a novel reinforcement learning model that fits observed choices better than the Bayes-optimal model. Only anterior insula discriminated between the 2 types of outliers. In both treatments, outliers initially activated an extensive bottom-up attention and belief network, followed by sustained engagement of the fronto-parietal control network.
-
ItemEvidence for Model-based Computations in the Human Amygdala during Pavlovian Conditioning(PUBLIC LIBRARY SCIENCE, 2013-02-01)Contemporary computational accounts of instrumental conditioning have emphasized a role for a model-based system in which values are computed with reference to a rich model of the structure of the world, and a model-free system in which values are updated without encoding such structure. Much less studied is the possibility of a similar distinction operating at the level of Pavlovian conditioning. In the present study, we scanned human participants while they participated in a Pavlovian conditioning task with a simple structure while measuring activity in the human amygdala using a high-resolution fMRI protocol. After fitting a model-based algorithm and a variety of model-free algorithms to the fMRI data, we found evidence for the superiority of a model-based algorithm in accounting for activity in the amygdala compared to the model-free counterparts. These findings support an important role for model-based algorithms in describing the processes underpinning Pavlovian conditioning, as well as providing evidence of a role for the human amygdala in model-based inference.
-
ItemDo not bet on the unknown versus try to find out more: estimation uncertainty and "unexpected uncertainty" both modulate exploration(FRONTIERS RESEARCH FOUNDATION, 2012-01-01)Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
-
ItemThe chronometry of risk processing in the human cortex(FRONTIERS MEDIA SA, 2013-01-01)The neuroscience of human decision-making has focused on localizing brain activity correlating with decision variables and choice, most commonly using functional MRI (fMRI). Poor temporal resolution means these studies are agnostic in relation to how decisions unfold in time. Consequently, here we address the temporal evolution of neural activity related to encoding of risk using magnetoencephalography (MEG), and show modulations of electromagnetic power in posterior parietal and dorsomedial prefrontal cortex (DMPFC) which scale with both variance and skewness in a lottery, detectable within 500 ms following stimulus presentation. Electromagnetic responses in somatosensory cortex following this risk encoding predict subsequent choices. Furthermore, within anterior insula we observed early and late effects of subject-specific risk preferences, suggestive of a role in both risk assessment and risk anticipation during choice. The observation that cortical activity tracks specific and independent components of risk from early time-points in a decision-making task supports the hypothesis that specialized brain circuitry underpins risk perception.
-
ItemRisk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings(PUBLIC LIBRARY SCIENCE, 2011-01-01)Recently, evidence has emerged that humans approach learning using Bayesian updating rather than (model-free) reinforcement algorithms in a six-arm restless bandit problem. Here, we investigate what this implies for human appreciation of uncertainty. In our task, a Bayesian learner distinguishes three equally salient levels of uncertainty. First, the Bayesian perceives irreducible uncertainty or risk: even knowing the payoff probabilities of a given arm, the outcome remains uncertain. Second, there is (parameter) estimation uncertainty or ambiguity: payoff probabilities are unknown and need to be estimated. Third, the outcome probabilities of the arms change: the sudden jumps are referred to as unexpected uncertainty. We document how the three levels of uncertainty evolved during the course of our experiment and how it affected the learning rate. We then zoom in on estimation uncertainty, which has been suggested to be a driving force in exploration, in spite of evidence of widespread aversion to ambiguity. Our data corroborate the latter. We discuss neural evidence that foreshadowed the ability of humans to distinguish between the three levels of uncertainty. Finally, we investigate the boundaries of human capacity to implement Bayesian learning. We repeat the experiment with different instructions, reflecting varying levels of structural uncertainty. Under this fourth notion of uncertainty, choices were no better explained by Bayesian updating than by (model-free) reinforcement learning. Exit questionnaires revealed that participants remained unaware of the presence of unexpected uncertainty and failed to acquire the right model with which to implement Bayesian updating.
-
ItemThe Affective Impact of Financial Skewness on Neural Activity and Choice(PUBLIC LIBRARY SCIENCE, 2011-02-15)Few finance theories consider the influence of "skewness" (or large and asymmetric but unlikely outcomes) on financial choice. We investigated the impact of skewed gambles on subjects' neural activity, self-reported affective responses, and subsequent preferences using functional magnetic resonance imaging (FMRI). Neurally, skewed gambles elicited more anterior insula activation than symmetric gambles equated for expected value and variance, and positively skewed gambles also specifically elicited more nucleus accumbens (NAcc) activation than negatively skewed gambles. Affectively, positively skewed gambles elicited more positive arousal and negatively skewed gambles elicited more negative arousal than symmetric gambles equated for expected value and variance. Subjects also preferred positively skewed gambles more, but negatively skewed gambles less than symmetric gambles of equal expected value. Individual differences in both NAcc activity and positive arousal predicted preferences for positively skewed gambles. These findings support an anticipatory affect account in which statistical properties of gambles--including skewness--can influence neural activity, affective responses, and ultimately, choice.
-
ItemActivity in Inferior Parietal and Medial Prefrontal Cortex Signals the Accumulation of Evidence in a Probability Learning Task(PUBLIC LIBRARY SCIENCE, 2013-01-01)In an uncertain environment, probabilities are key to predicting future events and making adaptive choices. However, little is known about how humans learn such probabilities and where and how they are encoded in the brain, especially when they concern more than two outcomes. During functional magnetic resonance imaging (fMRI), young adults learned the probabilities of uncertain stimuli through repetitive sampling. Stimuli represented payoffs and participants had to predict their occurrence to maximize their earnings. Choices indicated loss and risk aversion but unbiased estimation of probabilities. BOLD response in medial prefrontal cortex and angular gyri increased linearly with the probability of the currently observed stimulus, untainted by its value. Connectivity analyses during rest and task revealed that these regions belonged to the default mode network. The activation of past outcomes in memory is evoked as a possible mechanism to explain the engagement of the default mode network in probability learning. A BOLD response relating to value was detected only at decision time, mainly in striatum. It is concluded that activity in inferior parietal and medial prefrontal cortex reflects the amount of evidence accumulated in favor of competing and uncertain outcomes.