Learning a commonsense moral theory
- PMID: 28351662
- DOI: 10.1016/j.cognition.2017.03.005
Learning a commonsense moral theory
Abstract
We introduce a computational framework for understanding the structure and dynamics of moral learning, with a focus on how people learn to trade off the interests and welfare of different individuals in their social groups and the larger society. We posit a minimal set of cognitive capacities that together can solve this learning problem: (1) an abstract and recursive utility calculus to quantitatively represent welfare trade-offs; (2) hierarchical Bayesian inference to understand the actions and judgments of others; and (3) meta-values for learning by value alignment both externally to the values of others and internally to make moral theories consistent with one's own attachments and feelings. Our model explains how children can build from sparse noisy observations of how a small set of individuals make moral decisions to a broad moral competence, able to support an infinite range of judgments and decisions that generalizes even to people they have never met and situations they have not been in or observed. It also provides insight into the causes and dynamics of moral change across time, including cases when moral change can be rapidly progressive, changing values significantly in just a few generations, and cases when it is likely to move more slowly.
Keywords: Hierarchical Bayesian models; Moral change; Moral learning; Social cognition; Value alignment.
Copyright © 2017 Elsevier B.V. All rights reserved.
Similar articles
-
Modeling Morality in 3-D: Decision-Making, Judgment, and Inference.Top Cogn Sci. 2019 Apr;11(2):409-432. doi: 10.1111/tops.12382. Epub 2018 Sep 14. Top Cogn Sci. 2019. PMID: 31042018 Free PMC article.
-
Can model-free reinforcement learning explain deontological moral judgments?Cognition. 2016 May;150:232-42. doi: 10.1016/j.cognition.2016.02.002. Epub 2016 Feb 23. Cognition. 2016. PMID: 26918742
-
Moral learning: Psychological and philosophical perspectives.Cognition. 2017 Oct;167:1-10. doi: 10.1016/j.cognition.2017.06.008. Epub 2017 Jun 16. Cognition. 2017. PMID: 28629599
-
Theory of mind and moral cognition: exploring the connections.Trends Cogn Sci. 2005 Aug;9(8):357-9. doi: 10.1016/j.tics.2005.06.011. Trends Cogn Sci. 2005. PMID: 16006176 Review.
-
Deontological coherence: A framework for commonsense moral reasoning.Psychol Bull. 2016 Nov;142(11):1179-1203. doi: 10.1037/bul0000075. Epub 2016 Oct 6. Psychol Bull. 2016. PMID: 27709981 Review.
Cited by
-
Virtue Discounting: Observability Reduces Moral Actors' Perceived Virtue.Open Mind (Camb). 2023 Jul 26;7:460-482. doi: 10.1162/opmi_a_00085. eCollection 2023. Open Mind (Camb). 2023. PMID: 37637300 Free PMC article.
-
Cosmopolitan morality trades off in-group for the world, separating benefits and protection.Proc Natl Acad Sci U S A. 2021 Oct 5;118(40):e2100991118. doi: 10.1073/pnas.2100991118. Proc Natl Acad Sci U S A. 2021. PMID: 34580214 Free PMC article.
-
Learning how to behave: cognitive learning processes account for asymmetries in adaptation to social norms.Proc Biol Sci. 2021 Jun 9;288(1952):20210293. doi: 10.1098/rspb.2021.0293. Epub 2021 Jun 2. Proc Biol Sci. 2021. PMID: 34074119 Free PMC article.
-
Ethical and Statistical Considerations in Models of Moral Judgments.Front Robot AI. 2019 Aug 16;6:39. doi: 10.3389/frobt.2019.00039. eCollection 2019. Front Robot AI. 2019. PMID: 33501055 Free PMC article.
-
Selection, adaptation, inheritance and design in human culture: the view from the Price equation.Philos Trans R Soc Lond B Biol Sci. 2020 Apr 27;375(1797):20190358. doi: 10.1098/rstb.2019.0358. Epub 2020 Mar 9. Philos Trans R Soc Lond B Biol Sci. 2020. PMID: 32146878 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous