What changed between revision 1 and revision 2, compared over the article's markdown source with its frontmatter — so a change to status, evidence or reversibility shows up as the edit it is.
Older · revision 1
Import· initial corpus import, not an edit
Initial import of content/moral-enhancement.md — the filesystem corpus, unchanged. Not an edit.
14.2 kB
Revision 1
Revision 2
lines 7–13 → 7–136 unchanged lines not shown
categories: ["enhancement", "society"]categories: ["enhancement", "society"]tags: ["ethics", "enhancement", "psychopharmacology", "autonomy", "existential risk", "bioethics"]tags: ["ethics", "enhancement", "psychopharmacology", "autonomy", "existential risk", "bioethics"]summary: "The proposal to improve human moral motivation by biomedical means, argued for as a response to technologies that outpace evolved moral psychology."summary: "The proposal to improve human moral motivation by biomedical means, argued for as a response to technologies that outpace evolved moral psychology."updated: "2026-07-27"updated: "2026-10-29"humanEvidence: "No agent has been shown to change how a person actually treats anyone; every human result is a shift on a questionnaire or a laboratory task, measured in a single session in healthy volunteers."humanEvidence: "No agent has been shown to change how a person actually treats anyone; every human result is a shift on a questionnaire or a laboratory task, measured in a single session in healthy volunteers."------ lines 25–51 → 25–7211 unchanged lines not shown
}}`````` **Moral enhancement** is the proposal to improve human moral dispositions — altruism, impartiality, aversion to causing harm — by biomedical intervention rather than by education or institutional design. It is the branch of [[human-enhancement]] whose advocates present it not as an optional improvement but as a response to a mismatch: a moral psychology shaped for small groups now controls technologies capable of catastrophic harm. Its critics reply that the psychopharmacology on offer is far too crude for the job, and that the interventions proposed would damage something essential to moral agency even if they worked.**Moral enhancement** is the proposal to improve human moral dispositions, such as altruism,impartiality and aversion to causing harm, by biomedical intervention rather than by education orinstitutional design. It is the branch of [[human-enhancement]] whose advocates present it as aresponse to a mismatch rather than as an optional improvement: a moral psychology shaped for smallgroups now controls technologies capable of catastrophic harm. Critics reply that thepsychopharmacology on offer is far too crude for the job, and that the interventions proposed woulddamage something essential to moral agency even if they worked. ## The argument## The argument Ingmar Persson and [[julian-savulescu]] set out the case in a 2008 paper and expanded it in *Unfit for the Future*.[^ps2008][^ps2012] The argument has four steps.Ingmar Persson and [[julian-savulescu]] set out the case in a 2008 paper and expanded it in *Unfitfor the Future*.[^ps2008][^ps2012] The argument has four steps. Human moral psychology evolved under conditions of small-group cooperation. It is biased toward kin and near neighbours, toward the immediate over the distant future, and toward acts over omissions. These biases were adaptive and are now liabilities.Human moral psychology evolved under conditions of small-group cooperation. It is biased toward kinand near neighbours, toward the immediate over the distant future, and toward acts over omissions.Those biases were adaptive and are now liabilities. Technology has made the harm a small number of people can cause vastly greater than the good a comparable number can do. Persson and Savulescu call the worst case ultimate harm: an outcome that permanently destroys the prospect of a worthwhile life on Earth. The relevant class of hazards is the one described in [[existential-risk]] and, for the biological cases, [[dual-use-research]].Technology has made the harm a small number of people can cause vastly greater than the good acomparable number can do. Persson and Savulescu call the worst case ultimate harm, meaning anoutcome that permanently destroys the prospect of a worthwhile life on Earth. The relevant class ofhazards is the one described in [[existential-risk]] and, for the biological cases,[[dual-use-research]]. Liberal democracies cannot solve this by surveillance and prohibition alone, because the number of people who must be prevented from acting is small and the means are increasingly distributed.Liberal democracies cannot solve this by surveillance and prohibition alone, because the number ofpeople who must be prevented from acting is small and the means are increasingly distributed. Therefore, they argue, cognitive enhancement without corresponding moral enhancement is dangerous, and research into biomedical moral enhancement is urgent. The cognitive enhancement they have in mind is the whole range covered by [[nootropics]], [[genetic-enhancement-of-intelligence]] and [[intelligence-amplification]], on the view that all of them increase capability without touching motivation. Thomas Douglas advanced a narrower and more defensible version in the same year: moral enhancement as the attenuation of clearly counter-moral emotions such as aversion to particular racial groups or impulses toward violent aggression, which he argued is permissible on almost any account of moral worth.[^douglas2008]Therefore, they argue, cognitive enhancement without corresponding moral enhancement is dangerous,and research into biomedical moral enhancement is urgent. The cognitive enhancement they have inmind is the whole range covered by [[nootropics]], [[genetic-enhancement-of-intelligence]] and[[intelligence-amplification]], on the view that all of them increase capability without touchingmotivation. Thomas Douglas advanced a narrower and more defensible version in the same year,treating moral enhancement as the attenuation of clearly counter-moral emotions such as aversion to particular racial groups orimpulses toward violent aggression, which he argued is permissible on almost any account of moralworth.[^douglas2008] ```timeline```timeline[[ { "year": "2008", "title": "The proposal appears", "text": "Persson and Savulescu argue that cognitive enhancement without moral enhancement is dangerous; Thomas Douglas independently defends the attenuation of counter-moral emotions." }, { "year": "2008", "title": "The proposal appears", "text": "Persson and Savulescu argue that cognitive enhancement without moral enhancement is dangerous; Thomas Douglas independently defends the attenuation of counter-moral emotions." }, { "year": "2010–2012", "title": "Candidate agents identified", "text": "Studies report that serotonin manipulation shifts harm aversion in hypothetical dilemmas, that oxytocin increases in-group favouritism, and that propranolol reduces implicit racial bias." }, { "year": "2010-2012", "title": "Candidate agents identified", "text": "Studies report that serotonin manipulation shifts harm aversion in hypothetical dilemmas, that oxytocin increases in-group favouritism, and that propranolol reduces implicit racial bias." }, { "year": "2011", "title": "The freedom objection", "text": "John Harris argues that moral worth requires the capacity to choose otherwise, and that engineering good behaviour removes what makes it good." }, { "year": "2011", "title": "The freedom objection", "text": "John Harris argues that moral worth requires the capacity to choose otherwise, and that engineering good behaviour removes what makes it good." }, { "year": "2012", "title": "The God Machine", "text": "Savulescu and Persson answer Harris with a thought experiment: a system that intervenes only to prevent great harms, leaving ordinary choice untouched." }, { "year": "2012", "title": "The God Machine", "text": "Savulescu and Persson answer Harris with a thought experiment: a system that intervenes only to prevent great harms, leaving ordinary choice untouched." }, { "year": "2014–2016", "title": "Sustained criticism", "text": "Robert Sparrow attacks the political assumptions of the programme, and Harris Wiseman's book argues the neuroscience cannot support anything the proposal requires." } { "year": "2014-2016", "title": "Sustained criticism", "text": "Robert Sparrow attacks the political assumptions of the programme, and Harris Wiseman's book argues the neuroscience cannot support anything the proposal requires." }]]`````` lines 53–101 → 74–1901 unchanged line not shown
The literature distinguishes several targets, which are often conflated.The literature distinguishes several targets, which are often conflated. **Motivation.** Making people more disposed to act on moral judgements they already hold. This is the target Persson and Savulescu emphasise, on the view that akrasia rather than ignorance is the binding constraint.**Motivation.** Making people more disposed to act on moral judgements they already hold. This isthe target Persson and Savulescu emphasise, on the view that akrasia rather than ignorance is thebinding constraint. **Emotional disposition.** Increasing empathy or fellow-feeling, or reducing aggression and out-group aversion. The candidate pharmacology is concentrated here.**Emotional disposition.** Increasing empathy or fellow-feeling, or reducing aggression andout-group aversion. The candidate pharmacology is concentrated here. **Judgement.** Improving the reasoning by which moral conclusions are reached. John Harris argues that this makes cognitive enhancement the only real moral enhancement, since better information and better inference improve moral decisions without touching motivation.**Judgement.** Improving the reasoning by which moral conclusions are reached. John Harris arguesthat this makes cognitive enhancement the only real moral enhancement, since better information andbetter inference improve moral decisions without touching motivation. **Behavioural constraint.** Preventing specific acts. This is not enhancement of the agent at all, which is why the God Machine thought experiment — a system that intervenes only to block great harms — is presented as a limiting case rather than as a proposal.[^ps2012]**Behavioural constraint.** Preventing specific acts. This is not enhancement of the agent at all,which is why the God Machine thought experiment, a system that intervenes only to block great harms,is presented as a limiting case rather than as a proposal.[^ps2012] > [!note] The bootstrapping problem> [!note] The bootstrapping problem> Any programme of moral enhancement must be designed by people whose moral views would then be propagated. If those views are mistaken, the intervention entrenches the error; if they are not, the argument for the intervention presupposes the moral knowledge it is meant to improve.> Any programme of moral enhancement must be designed by people whose moral views would then be> propagated. If those views are mistaken, the intervention entrenches the error. If they are not,> the argument for the intervention presupposes the moral knowledge it is meant to improve. ## The empirical basis## The empirical basis The candidate agents are borrowed from psychiatry and studied on laboratory tasks. None was developed for this purpose and none has been tested against real moral behaviour. Device-based routes are thinner still: reports of personality and impulse-control change after [[deep-brain-stimulation]] are the closest thing to a demonstration that a neural intervention can shift how a person behaves toward others, and they are side effects of treatment for movement disorders, not enhancements. The transcranial methods surveyed in [[non-invasive-neuromodulation]] have produced nothing durable.The candidate agents are borrowed from psychiatry and studied on laboratory tasks. None wasdeveloped for this purpose and none has been tested against real moral behaviour. Device-basedroutes are thinner still. Reports of personality and impulse-control change after[[deep-brain-stimulation]] are the closest thing to a demonstration that a neural intervention canshift how a person behaves toward others, and they are side effects of treatment for movementdisorders rather than enhancements. The transcranial methods surveyed in[[non-invasive-neuromodulation]] have produced nothing durable. **Serotonin.** A single dose of the SSRI citalopram increased participants' reluctance to endorse harming one person to benefit several in hypothetical dilemmas, an effect interpreted as heightened harm aversion.[^crockett2010] Whether this constitutes moral improvement is contested: greater reluctance to act is not obviously better ethics, and the same shift would make some defensible choices harder.**Serotonin.** A single dose of the SSRI citalopram increased participants' reluctance to endorseharming one person to benefit several in hypothetical dilemmas, an effect interpreted as heightenedharm aversion.[^crockett2010] Whether this constitutes moral improvement is contested. Greaterreluctance to act is not obviously better ethics, and the same shift would make some defensiblechoices harder. **Oxytocin.** Often described in popular accounts as a trust or bonding hormone, it behaves in experiments as a parochial one. De Dreu and colleagues found that intranasal oxytocin increased favouritism toward in-group members and, on some measures, defensive hostility toward out-groups.[^dedreu2011] For a proposal whose central aim is extending concern beyond the near group, this is the wrong direction. The wider oxytocin literature also has severe replication problems, and whether intranasal administration delivers meaningful quantities to the human brain remains disputed.**Oxytocin.** Often described in popular accounts as a trust or bonding hormone, it behaves inexperiments as a parochial one. De Dreu and colleagues found that intranasal oxytocin increasedfavouritism toward in-group members and, on some measures, defensive hostility towardout-groups.[^dedreu2011] For a proposal whose central aim is extending concern beyond the neargroup, this is the wrong direction. The wider oxytocin literature also has severe replicationproblems, and whether intranasal administration delivers meaningful quantities to the human brainremains disputed. **Propranolol.** A beta-blocker reduced implicit racial bias on an association test without changing explicit attitudes.[^terbeck2012] The result is small, measured on an instrument whose relation to behaviour is itself contested, and has not been shown to alter how anyone treats anyone.**Propranolol.** A beta-blocker reduced implicit racial bias on an association test without changingexplicit attitudes.[^terbeck2012] The result is small, measured on an instrument whose relation tobehaviour is itself contested, and has not been shown to alter how anyone treats anyone. **Psychedelics.** Supported psilocybin sessions entered the discussion later, on the strength of reported shifts in the personality measure of openness and in self-described concern for others. Those outcomes are questionnaires completed by people who know exactly what they took, which is the [[psychedelic-therapy|unblinding problem]] that limits the clinical literature on the same drugs; in people without a diagnosis that literature is small and largely uncontrolled.**Psychedelics.** Supported psilocybin sessions entered the discussion later, on the strength ofreported shifts in the personality measure of openness and in self-described concern for others.Those outcomes are questionnaires completed by people who know exactly what they took, which is the[[psychedelic-therapy|unblinding problem]] that limits the clinical literature on the same drugs. Inpeople without a diagnosis that literature is small and largely uncontrolled. The honest summary is that no biomedical intervention has been shown to make a person behave better in any consequential setting. Every effect in this literature is a shift on a questionnaire or a laboratory task, in a single session, in university volunteers.No biomedical intervention has been shown to make a person behave better in any consequentialsetting. Every effect in this literature is a shift on a questionnaire or a laboratory task, in asingle session, in university volunteers. > [!caution] Distance from the claim> [!caution] Distance from the claim> The proposal concerns preventing catastrophic harm by a small number of highly motivated actors. The evidence concerns millisecond-scale changes in association-test scores among undergraduates. No argument has been offered that bridges the two, and the gap is not a matter of degree.> The proposal concerns preventing catastrophic harm by a small number of highly motivated actors.> The evidence concerns millisecond-scale changes in association-test scores among undergraduates.> No argument has been offered that bridges the two, and the distance is not a matter of degree. ## Objections## Objections **Freedom to fall.** Harris's objection is that moral worth depends on the agent's capacity to choose otherwise. An intervention that makes wrongdoing impossible, or merely much less likely by bypassing deliberation, converts a moral agent into a well-behaved mechanism, and it collides directly with the claim to mental self-determination set out in [[morphological-freedom]] and, in its legal form, in [[neurorights]].[^harris2011] Douglas and others reply that emotions are not chosen either, and that removing a bias one would reflectively disown restores autonomy rather than reducing it. Harris's second point is harder to answer: if the enhancement acts on motivation rather than on judgement, the agent has no way to evaluate whether the new motivation is correct.**Freedom to fall.** Harris's objection is that moral worth depends on the agent's capacity tochoose otherwise. An intervention that makes wrongdoing impossible, or merely much less likely bybypassing deliberation, converts a moral agent into a well-behaved mechanism, and it collidesdirectly with the claim to mental self-determination set out in [[morphological-freedom]] and, inits legal form, in [[neurorights]].[^harris2011] Douglas and others reply that emotions are notchosen either, and that removing a bias one would reflectively disown restores autonomy rather thanreducing it. Harris's second point is harder to answer. If the enhancement acts on motivation ratherthan on judgement, the agent has no way to evaluate whether the new motivation is correct. **Moral pluralism.** Deep disagreement about what morality requires is not obviously an error to be corrected. A programme that increases obedience, or conformity, or harm aversion is taking sides in disputes that are live and reasonable. Robert Sparrow argues that the proposal's political naivety is its central flaw: it imagines an intervention deployed by no one in particular, when in practice a state or a firm would decide the content. The objection converges with the [[bioconservatism|bioconservative]] worry, stated most sharply by [[leon-kass]], that a technique for improving people presupposes a settled account of what an improved person is.[^sparrow2014]**Moral pluralism.** Deep disagreement about what morality requires is not obviously an error to becorrected. A programme that increases obedience, or conformity, or harm aversion is taking sides indisputes that are live and reasonable. Robert Sparrow argues that the proposal's political naivetyis its central flaw, since it imagines an intervention deployed by no one in particular when inpractice a state or a firm would decide the content. The objection converges with the[[bioconservatism|bioconservative]] worry, stated most sharply by [[leon-kass]], that a techniquefor improving people presupposes a settled account of what an improved person is.[^sparrow2014] **Who takes it.** The people whose dispositions the argument is most concerned about are precisely those least likely to volunteer. Compulsory moral enhancement is rejected by nearly everyone in the debate, including its advocates, which leaves the proposal aimed at a population it does not need to reach. Persson and Savulescu acknowledge this and argue for research now against the possibility of a future in which the calculus changes.**Who takes it.** The people whose dispositions the argument is most concerned about are preciselythose least likely to volunteer. Compulsory moral enhancement is rejected by nearly everyone in thedebate, including its advocates, which leaves the proposal aimed at a population it does not need toreach. Persson and Savulescu acknowledge this and argue for research now against the possibility ofa future in which the calculus changes. **The science does not exist.** Harris Wiseman's book-length critique argues that the neuroscience underdetermines everything the proposal requires: there is no moral module, the pathways implicated are involved in most of behaviour, and any agent potent enough to shift moral motivation would have effects across the whole of personality.**The science does not exist.** Harris Wiseman's book-length critique argues that the neuroscienceunderdetermines everything the proposal requires. There is no moral module, the pathways implicatedare involved in most of behaviour, and any agent potent enough to shift moral motivation would haveeffects across the whole of personality. ## Standing and outlook## Standing and outlook Moral enhancement occupies an unusual position: it is one of the most-discussed proposals in academic bioethics and one of the least-supported by evidence. Two decades of argument have produced a substantial philosophical literature and no candidate intervention that a researcher would defend as ready for study in the relevant setting. Within [[bioethics-of-enhancement]] it is the clearest case of a proposal whose ethical analysis has run far ahead of anything it could analyse.Moral enhancement is one of the most-discussed proposals in academic bioethics and one of the leastsupported by evidence. Two decades of argument have produced a substantial philosophical literatureand no candidate intervention that a researcher would defend as ready for study in the relevantsetting. Within [[bioethics-of-enhancement]] it is the clearest case of a proposal whose ethicalanalysis has run far ahead of anything it could analyse. Two developments would change that. The first is a pharmacological or neuromodulatory agent with a specific and durable effect on some component of moral motivation, demonstrated behaviourally rather than on a self-report instrument; nothing in the current pipeline resembles this. The second is a shift in the underlying risk argument. If [[artificial-general-intelligence]] or engineered pathogens make the distribution of destructive capability as wide as Persson and Savulescu assume, the question of whether a crude intervention is better than none becomes practical rather than academic. Their critics reply that in that scenario the crude intervention would not work either, and that the effort belongs in institutions, verification, the [[precautionary-principle|precautionary]] regulation of the underlying technologies, and [[differential-technological-development]] instead.Two developments would change that. The first is a pharmacological or neuromodulatory agent with aspecific and durable effect on some component of moral motivation, demonstrated behaviourally ratherthan on a self-report instrument. Nothing in the current pipeline resembles that. The second is ashift in the underlying risk argument. If [[artificial-general-intelligence]] or engineeredpathogens make the distribution of destructive capability as wide as Persson and Savulescu assume,the question of whether a crude intervention is better than none becomes practical rather thanacademic. Their critics reply that in that scenario the crude intervention would not work either,and that the effort belongs in institutions, verification, the[[precautionary-principle|precautionary]] regulation of the underlying technologies, and[[differential-technological-development]] instead. ## See also## See also removed, struck through added, underlinedLine numbers count the serialised markdown of each revision, frontmatter included.
94 lines are the same in both revisions, and 38 of them are not shown. Neither revision here is necessarily the current article — read Moral enhancement for the text this wiki stands behind today.