Why is the environment important for decision making? Local reservoir model for choice-based learning

Makoto Naruse, Eiji Yamamoto, Takashi Nakao, Takuma Akimoto, Hayato Saigo, Kazuya Okamura, Izumi Ojima, Georg Northoff, Hirokazu Hori

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Decision making based on behavioral and neural observations of living systems has been extensively studied in brain science, psychology, neuroeconomics, and other disciplines. Decision-making mechanisms have also been experimentally implemented in physical processes, such as single photons and chaotic lasers. The findings of these experiments suggest that there is a certain common basis in describing decision making, regardless of its physical realizations. In this study, we propose a local reservoir model to account for choicebased learning (CBL). CBL describes decision consistency as a phenomenon where making a certain decision increases the possibility of making that same decision again later. This phenomenon has been intensively investigated in neuroscience, psychology, and other related fields. Our proposed model is inspired by the viewpoint that a decision is affected by its local environment, which is referred to as a local reservoir. If the size of the local reservoir is large enough, consecutive decision making will not be affected by previous decisions, thus showing lower degrees of decision consistency in CBL. In contrast, if the size of the local reservoir decreases, a biased distribution occurs within it, which leads to higher degrees of decision consistency in CBL. In this study, an analytical approach for characterizing local reservoirs is presented, as well as several numerical demonstrations. Furthermore, a physical architecture for CBL based on single photons is discussed, and the effects of local reservoirs are numerically demonstrated. Decision consistency in human decisionmaking tasks and in recruiting empirical data is evaluated based on the local reservoir. This foundation based on a local reservoir offers further insights into the understanding and design of decision making.

Original languageEnglish
Article numbere0205161
Pages (from-to)1-17
Number of pages17
JournalPLoS One
Volume13
Issue number10
DOIs
Publication statusPublished - Oct 1 2018
Externally publishedYes

Fingerprint

decision making
Decision Making
learning
Decision making
Learning
Photons
psychology
Physical Phenomena
Psychology
neurophysiology
Neurosciences
Brain
Demonstrations
Lasers
lasers
brain
Experiments

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

Naruse, M., Yamamoto, E., Nakao, T., Akimoto, T., Saigo, H., Okamura, K., ... Hori, H. (2018). Why is the environment important for decision making? Local reservoir model for choice-based learning. PLoS One, 13(10), 1-17. [e0205161]. https://doi.org/10.1371/journal.pone.0205161

Why is the environment important for decision making? Local reservoir model for choice-based learning. / Naruse, Makoto; Yamamoto, Eiji; Nakao, Takashi; Akimoto, Takuma; Saigo, Hayato; Okamura, Kazuya; Ojima, Izumi; Northoff, Georg; Hori, Hirokazu.

In: PLoS One, Vol. 13, No. 10, e0205161, 01.10.2018, p. 1-17.

Research output: Contribution to journalArticle

Naruse, M, Yamamoto, E, Nakao, T, Akimoto, T, Saigo, H, Okamura, K, Ojima, I, Northoff, G & Hori, H 2018, 'Why is the environment important for decision making? Local reservoir model for choice-based learning', PLoS One, vol. 13, no. 10, e0205161, pp. 1-17. https://doi.org/10.1371/journal.pone.0205161
Naruse M, Yamamoto E, Nakao T, Akimoto T, Saigo H, Okamura K et al. Why is the environment important for decision making? Local reservoir model for choice-based learning. PLoS One. 2018 Oct 1;13(10):1-17. e0205161. https://doi.org/10.1371/journal.pone.0205161
Naruse, Makoto ; Yamamoto, Eiji ; Nakao, Takashi ; Akimoto, Takuma ; Saigo, Hayato ; Okamura, Kazuya ; Ojima, Izumi ; Northoff, Georg ; Hori, Hirokazu. / Why is the environment important for decision making? Local reservoir model for choice-based learning. In: PLoS One. 2018 ; Vol. 13, No. 10. pp. 1-17.
@article{f2a4fbb86c3f4e9aa971c0d13162ff46,
title = "Why is the environment important for decision making? Local reservoir model for choice-based learning",
abstract = "Decision making based on behavioral and neural observations of living systems has been extensively studied in brain science, psychology, neuroeconomics, and other disciplines. Decision-making mechanisms have also been experimentally implemented in physical processes, such as single photons and chaotic lasers. The findings of these experiments suggest that there is a certain common basis in describing decision making, regardless of its physical realizations. In this study, we propose a local reservoir model to account for choicebased learning (CBL). CBL describes decision consistency as a phenomenon where making a certain decision increases the possibility of making that same decision again later. This phenomenon has been intensively investigated in neuroscience, psychology, and other related fields. Our proposed model is inspired by the viewpoint that a decision is affected by its local environment, which is referred to as a local reservoir. If the size of the local reservoir is large enough, consecutive decision making will not be affected by previous decisions, thus showing lower degrees of decision consistency in CBL. In contrast, if the size of the local reservoir decreases, a biased distribution occurs within it, which leads to higher degrees of decision consistency in CBL. In this study, an analytical approach for characterizing local reservoirs is presented, as well as several numerical demonstrations. Furthermore, a physical architecture for CBL based on single photons is discussed, and the effects of local reservoirs are numerically demonstrated. Decision consistency in human decisionmaking tasks and in recruiting empirical data is evaluated based on the local reservoir. This foundation based on a local reservoir offers further insights into the understanding and design of decision making.",
author = "Makoto Naruse and Eiji Yamamoto and Takashi Nakao and Takuma Akimoto and Hayato Saigo and Kazuya Okamura and Izumi Ojima and Georg Northoff and Hirokazu Hori",
year = "2018",
month = "10",
day = "1",
doi = "10.1371/journal.pone.0205161",
language = "English",
volume = "13",
pages = "1--17",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "10",

}

TY - JOUR

T1 - Why is the environment important for decision making? Local reservoir model for choice-based learning

AU - Naruse, Makoto

AU - Yamamoto, Eiji

AU - Nakao, Takashi

AU - Akimoto, Takuma

AU - Saigo, Hayato

AU - Okamura, Kazuya

AU - Ojima, Izumi

AU - Northoff, Georg

AU - Hori, Hirokazu

PY - 2018/10/1

Y1 - 2018/10/1

N2 - Decision making based on behavioral and neural observations of living systems has been extensively studied in brain science, psychology, neuroeconomics, and other disciplines. Decision-making mechanisms have also been experimentally implemented in physical processes, such as single photons and chaotic lasers. The findings of these experiments suggest that there is a certain common basis in describing decision making, regardless of its physical realizations. In this study, we propose a local reservoir model to account for choicebased learning (CBL). CBL describes decision consistency as a phenomenon where making a certain decision increases the possibility of making that same decision again later. This phenomenon has been intensively investigated in neuroscience, psychology, and other related fields. Our proposed model is inspired by the viewpoint that a decision is affected by its local environment, which is referred to as a local reservoir. If the size of the local reservoir is large enough, consecutive decision making will not be affected by previous decisions, thus showing lower degrees of decision consistency in CBL. In contrast, if the size of the local reservoir decreases, a biased distribution occurs within it, which leads to higher degrees of decision consistency in CBL. In this study, an analytical approach for characterizing local reservoirs is presented, as well as several numerical demonstrations. Furthermore, a physical architecture for CBL based on single photons is discussed, and the effects of local reservoirs are numerically demonstrated. Decision consistency in human decisionmaking tasks and in recruiting empirical data is evaluated based on the local reservoir. This foundation based on a local reservoir offers further insights into the understanding and design of decision making.

AB - Decision making based on behavioral and neural observations of living systems has been extensively studied in brain science, psychology, neuroeconomics, and other disciplines. Decision-making mechanisms have also been experimentally implemented in physical processes, such as single photons and chaotic lasers. The findings of these experiments suggest that there is a certain common basis in describing decision making, regardless of its physical realizations. In this study, we propose a local reservoir model to account for choicebased learning (CBL). CBL describes decision consistency as a phenomenon where making a certain decision increases the possibility of making that same decision again later. This phenomenon has been intensively investigated in neuroscience, psychology, and other related fields. Our proposed model is inspired by the viewpoint that a decision is affected by its local environment, which is referred to as a local reservoir. If the size of the local reservoir is large enough, consecutive decision making will not be affected by previous decisions, thus showing lower degrees of decision consistency in CBL. In contrast, if the size of the local reservoir decreases, a biased distribution occurs within it, which leads to higher degrees of decision consistency in CBL. In this study, an analytical approach for characterizing local reservoirs is presented, as well as several numerical demonstrations. Furthermore, a physical architecture for CBL based on single photons is discussed, and the effects of local reservoirs are numerically demonstrated. Decision consistency in human decisionmaking tasks and in recruiting empirical data is evaluated based on the local reservoir. This foundation based on a local reservoir offers further insights into the understanding and design of decision making.

UR - http://www.scopus.com/inward/record.url?scp=85054463572&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054463572&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0205161

DO - 10.1371/journal.pone.0205161

M3 - Article

C2 - 30286186

AN - SCOPUS:85054463572

VL - 13

SP - 1

EP - 17

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 10

M1 - e0205161

ER -