Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task
Abstract
Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants recent choice history, finds that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. This study examines the mechanism by which this state knowledge influences choice behavior. We examine the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We find support for this hypothesis in a study where generalizations based on this state information work to the benefit or detriment of task performance, depending on the task's payoff structure.
Keywords
Bibtex entry:
@article{otto2009navigating,
abstract = {Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants recent choice history, finds that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. This study examines the mechanism by which this state knowledge influences choice behavior. We examine the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We find support for this hypothesis in a study where generalizations based on this state information work to the benefit or detriment of task performance, depending on the task's payoff structure.},
author = {Otto, A.R. and Gureckis, T.M. and Markman, A.B. and Love, B.C.},
journal = {Psychonomic Bulletin and Review},
number = {5},
pages = {957--963},
publisher = {Springer-Verlag},
title = {Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task},
volume = {16},
year = {2009}}QR Code:
Download SVG