Loading
What changed between revision 1 and revision 3, compared over the article's markdown source with its frontmatter — so a change to status, evidence or reversibility shows up as the edit it is.
Older · revision 1
Import· initial corpus import, not an edit
Initial import of content/precautionary-principle.md — the filesystem corpus, unchanged. Not an edit.
12.6 kB
Revision 1
Revision 3
lines 7–14 → 7–136 unchanged lines not shown
categories: ["society", "foundations"]categories: ["society", "foundations"]tags: ["governance", "risk", "regulation", "biotechnology", "law", "uncertainty"]tags: ["governance", "risk", "regulation", "biotechnology", "law", "uncertainty"]summary: "The regulatory doctrine that scientific uncertainty about a serious or irreversible harm is not by itself a reason to permit the activity that might cause it."summary: "The regulatory doctrine that scientific uncertainty about a serious or irreversible harm is not by itself a reason to permit the activity that might cause it."updated: "2026-07-27"updated: "2026-10-29"issues: ["The WTO 2006 panel, 2018 CJEU ruling and 2024 Philippine decision carry no citations."]------ ```infobox```infoboxlines 25–31 → 24–3010 unchanged lines not shown
}}`````` **The precautionary principle** holds that where an activity threatens serious or irreversible harm, the absence of scientific certainty about that harm is not a sufficient reason to allow the activity to proceed unrestricted. It exists in weak versions that merely license regulators to act under uncertainty and strong versions that shift the burden of proof onto whoever proposes the activity. The difference between those versions is not a matter of degree, and most arguments about the principle are really arguments about which one is being invoked.**The precautionary principle** holds that where an activity threatens serious or irreversible harm, the absence of scientific certainty about that harm is not a sufficient reason to allow the activity to proceed unrestricted. It exists in weak versions that merely license regulators to act under uncertainty and strong versions that shift the burden of proof onto whoever proposes the activity. The two versions differ in kind rather than degree, and most arguments about the principle turn out to be arguments about which one is being invoked. ## Formulations## Formulations lines 42–95 → 41–10410 unchanged lines not shown
}}`````` The weak form authorises action; the strong form requires it. A third and stronger reading, sometimes attributed to the principle by its critics and rarely defended in print, would prohibit any activity whose safety cannot be affirmatively demonstrated. That reading is genuinely incoherent, since no activity can be shown safe in that sense and inaction has consequences of its own — but it is a straw man of the versions that appear in law.The weak form authorises action; the strong form requires it. A third and stronger reading, sometimes attributed to the principle by its critics and rarely defended in print, would prohibit any activity whose safety cannot be affirmatively demonstrated. That reading is incoherent, since no activity can be shown safe in that sense and inaction has consequences of its own, but it is a straw man of the versions that appear in law. ## Origins and legal status## Origins and legal status The German *Vorsorgeprinzip* — roughly, the principle of taking care in advance — entered environmental legislation in the 1970s as a rationale for acting on forest damage and air pollution before causal chains were established. The idea spread through North Sea protection conferences in the 1980s and reached its most-quoted formulation as Principle 15 of the 1992 Rio Declaration.The German *Vorsorgeprinzip* (roughly, the principle of taking care in advance) entered environmental legislation in the 1970s as a rationale for acting on forest damage and air pollution before causal chains were established. The idea spread through North Sea protection conferences in the 1980s and reached its most-quoted formulation as Principle 15 of the 1992 Rio Declaration. In European Union law the principle has treaty status as one of the bases of environmental policy, and a European Commission communication in 2000 set out how it should be applied: measures must be proportionate, non-discriminatory, consistent with comparable measures elsewhere, based on an examination of costs and benefits, and subject to review as evidence accumulates.[^ec2000] That document is the most operationally careful statement of the doctrine in existence, and it is considerably more restrained than the principle's reputation suggests.In European Union law the principle has treaty status as one of the bases of environmental policy, and a European Commission communication in 2000 set out how it should be applied: measures must be proportionate, non-discriminatory, consistent with comparable measures elsewhere, based on an examination of costs and benefits, and subject to review as evidence accumulates.[^ec2000] That document is the most operationally careful statement of the doctrine in existence, and it is considerably more restrained than the principle's reputation. The Cartagena Protocol on Biosafety, adopted in 2000, is the main instrument applying precaution to biotechnology specifically, permitting parties to restrict imports of living modified organisms where scientific information is insufficient. UNESCO's world commission on the ethics of scientific knowledge issued a report in 2005 attempting a general definition and application framework.The Cartagena Protocol on Biosafety, adopted in 2000, is the main instrument applying precaution to biotechnology specifically, permitting parties to restrict imports of living modified organisms where scientific information is insufficient. UNESCO's world commission on the ethics of scientific knowledge issued a report in 2005 attempting a general definition and application framework. ## How it operates in biotechnology## How it operates in biotechnology The principle's record in this field is genuinely mixed, and both camps cite it selectively.The principle's record in this field is mixed, and both camps cite it selectively. **Where precaution has been vindicated.** The 1975 [[asilomar-conference]] is the field's founding case: researchers imposed a moratorium on recombinant DNA work under acknowledged uncertainty, developed containment levels, and resumed. The moratorium lasted under a year and produced a containment framework that is still the template for self-governance in the field. The requirement that drug sponsors demonstrate safety and efficacy before marketing — a burden-shifting rule of exactly the strong-form type — is uncontroversial and followed a series of harms including thalidomide.**Where precaution has been vindicated.** The 1975 [[asilomar-conference]] is the field's founding case: researchers imposed a moratorium on recombinant DNA work under acknowledged uncertainty, developed containment levels, and resumed. The moratorium lasted under a year and produced a containment framework that is still the template for self-governance in the field. The requirement that drug sponsors demonstrate safety and efficacy before marketing is a burden-shifting rule of exactly the strong-form type. It is uncontroversial, and it followed a series of harms including thalidomide. **Where precaution has been costly.** The European Union's de facto moratorium on approvals of genetically modified crops from 1999 was found by a World Trade Organization panel in 2006 to have caused undue delay. A 2018 Court of Justice ruling brought organisms produced by genome editing within the EU's GMO directive, subjecting edits indistinguishable from natural mutations to the full approval regime; the Commission subsequently proposed a separate regime for new genomic techniques. In 2024 a Philippine appellate court revoked biosafety permits for Golden Rice and Bt eggplant on precautionary grounds, a decision that was appealed. In each case, the costs of delay fell on people who would have benefited and are not counted in the risk assessment.**Where precaution has been costly.** The European Union's de facto moratorium on approvals of genetically modified crops from 1999 was found by a World Trade Organization panel in 2006 to have caused undue delay.[^wto2006] A 2018 Court of Justice ruling brought organisms produced by genome editing within the EU's GMO directive, subjecting edits indistinguishable from natural mutations to the full approval regime; the Commission subsequently proposed a separate regime for new genomic techniques.[^cjeu2018] In 2024 a Philippine appellate court revoked biosafety permits for Golden Rice and Bt eggplant on precautionary grounds, a decision that was appealed.[^ca2024] In each case the costs of delay fell on people who would have benefited, and those costs are not counted in the risk assessment. **Where the argument is live.** [[gene-drive]] releases are the clearest current test, because a self-propagating edit cannot be recalled and field trials are the only way to obtain the missing information. Proposals for [[germline-editing]] are governed by an explicitly precautionary international consensus, discussed in [[governance-of-genome-editing]], which the [[he-jiankui-affair]] hardened rather than created. The 2024 call by a large group of scientists to halt work toward [[mirror-life]] is a precautionary argument in its purest modern form: the authors argue that chirally inverted organisms could evade immune recognition across many species, that no adequate defence is known, and that the research should stop before the capability exists.[^adamala2024]**Where the argument is live.** [[gene-drive]] releases are the clearest current test, because a self-propagating edit cannot be recalled and field trials are the only way to obtain the missing information. Proposals for [[germline-editing]] are governed by an explicitly precautionary international consensus, discussed in [[governance-of-genome-editing]], which the [[he-jiankui-affair]] hardened rather than created. The 2024 call by a large group of scientists to halt work toward [[mirror-life]] is the purest modern example of a precautionary argument. The authors argue that chirally inverted organisms could evade immune recognition across many species, that no adequate defence is known, and that the research should stop before the capability exists.[^adamala2024] > [!key] Why the biotechnology cases differ> [!key] Why the biotechnology cases differ> Most environmental applications of the principle concern harms that are gradual and in principle reversible. The cases that dominate this wiki — self-spreading edits, heritable modification, novel replicators — involve irreversibility as a structural feature. That is the condition under which even the principle's critics tend to concede it has force.> Most environmental applications of the principle concern harms that are gradual and in principle reversible. The cases that dominate this wiki (self-spreading edits, heritable modification, novel replicators) are irreversible by their structure. That is the condition under which even the principle's critics tend to concede it has force. ## Criticisms## Criticisms The central objection, argued at length by Cass Sunstein, is that the principle is incoherent as a decision rule because it forbids the very steps it requires.[^sunstein2005] Regulation has risks; so does non-regulation. Banning a pesticide risks crop loss; approving it risks toxicity. If the principle counsels avoiding uncertain serious harm, it counsels both action and inaction simultaneously, and it appears to give determinate guidance only because attention has been selectively directed at one side of the ledger. Sunstein attributes this selectivity to known features of risk perception: availability, loss aversion, and greater aversion to harms caused by human action than to statistically larger harms caused by omission.The central objection, argued at length by Cass Sunstein, is that the principle is incoherent as a decision rule because it forbids the very steps it requires.[^sunstein2005] Regulation has risks, and so does the absence of regulation: banning a pesticide risks crop loss, while approving it risks toxicity. A principle that counsels avoiding uncertain serious harm therefore counsels action and inaction at once. It appears to give determinate guidance only because attention has been directed at one side of the ledger. Sunstein attributes this selectivity to known features of risk perception: availability, loss aversion, and greater aversion to harms caused by human action than to statistically larger harms caused by omission. A second objection concerns *risk–risk tradeoffs*: interventions displace risk rather than removing it, and the displaced risk is systematically undercounted because it lands on different people at a later time.A second objection concerns *risk-risk tradeoffs*. Interventions displace risk rather than removing it, and the displaced risk is systematically undercounted because it lands on different people at a later time. A third objection is that the principle has no stopping rule. Since certainty is unavailable in principle, any threshold for "sufficient evidence" is a judgement imported from outside the principle, which means the principle is not doing the work its invocation implies.A third objection is that the principle has no stopping rule. Since certainty is unavailable in principle, any threshold for "sufficient evidence" is a judgement imported from outside the principle, so the principle does less work than its invocation implies. A fourth is that it is applied asymmetrically to novel technologies. Existing practices with well-characterised large harms are grandfathered, while novel practices with speculative small harms face the burden — a pattern visible in the regulatory treatment of [[xenotransplantation]] relative to the ongoing mortality documented in [[organ-shortage]].A fourth is that it is applied asymmetrically to novel technologies. Existing practices with well-characterised large harms are grandfathered, while novel practices with speculative small harms face the burden. The pattern is visible in the regulatory treatment of [[xenotransplantation]] relative to the ongoing mortality documented in [[organ-shortage]]. > [!debate] Is the incoherence fatal?> Whether Sunstein's paralysis argument refutes the principle or only a caricature of it is itself> disputed. Daniel Steel's book-length defence recasts the weak principle as a meta-rule (scientific> uncertainty must not by itself justify inaction) and binds stronger versions to consistency and> efficiency constraints under which a precaution cannot be both recommended and forbidden by the> same rule.[^steel2015] Reviewers of that repair answer that permitting different versions in> different contexts revives the incoherence objection one level up. What divides the camps is> whether the principle is a decision rule at all or a constraint on other rules. No regulatory> outcome can settle that, because each side classifies the same outcome differently. ## The proactionary reply## The proactionary reply [[max-more]] proposed the *proactionary principle* in 2004 as an explicit counterweight, articulating a presumption in favour of proceeding: freedom to innovate is valuable, restriction has costs that must be counted symmetrically, and evaluation should use the best available evidence rather than worst cases, weighting probability rather than mere possibility.[^more2013] The formulation has roots in [[extropianism]] and has been developed at book length by Steve Fuller and Veronika Lipinska.[[max-more]] proposed the *proactionary principle* in 2004 as an explicit counterweight, articulating a presumption in favour of proceeding: freedom to innovate is valuable, restriction has costs that must be counted symmetrically, and evaluation should use the best available evidence rather than worst cases, weighting probability rather than mere possibility.[^more2013] The formulation has roots in [[extropianism]] and has been developed at book length by Steve Fuller and Veronika Lipinska. Its weakness mirrors the precautionary principle's. Stated weakly it is a plea for symmetric accounting, which almost everyone accepts. Stated strongly it presumes in favour of action under uncertainty, which is as arbitrary as presuming against. The strand of [[effective-accelerationism]] that treats technological advance as intrinsically good takes the strong reading, generally without the accounting.Its weakness mirrors that of the precautionary principle. Stated weakly, it is a plea for symmetric accounting, which almost everyone accepts. Stated strongly, it presumes in favour of action under uncertainty, which is as arbitrary as presuming against. The strand of [[effective-accelerationism]] that treats technological advance as intrinsically good takes the strong reading, generally without the accounting. ## Asymmetric-risk versions## Asymmetric-risk versions The most defensible modern formulations abandon the attempt at a general rule and specify the conditions under which precaution is rational. Nassim Taleb and colleagues argue that precaution is warranted where potential harm is *systemic* and *ruinous* — where the affected system is coupled enough that damage propagates and the downside includes irreversible collapse — and unwarranted for risks that are local and bounded, however alarming.[^taleb2014] On their analysis, an activity with a small chance of unbounded harm repeated indefinitely has a probability of ruin approaching one, which is an argument from the structure of the payoff rather than from uncertainty as such.The most defensible modern formulations abandon the attempt at a general rule and specify the conditions under which precaution is rational. Nassim Taleb and colleagues argue that precaution is warranted where potential harm is *systemic* and *ruinous*, meaning that the affected system is coupled enough for damage to propagate and the downside includes irreversible collapse. It is unwarranted, on their account, for risks that are local and bounded, however alarming.[^taleb2014] On their analysis, an activity with a small chance of unbounded harm repeated indefinitely has a probability of ruin approaching one, which is an argument from the structure of the payoff rather than from uncertainty as such. Sunstein himself endorses a narrower "anti-catastrophe" version on similar grounds: where a harm is potentially irreversible and catastrophic, and the option to wait has value, paying to preserve future flexibility can be justified even under deep uncertainty. [[nick-bostrom]]'s work on [[existential-risk]] arrives at the same structure from a different direction, and [[differential-technological-development]] can be read as an attempt to convert that structure into a policy that sequences technologies rather than blocking them.Sunstein himself endorses a narrower "anti-catastrophe" version on similar grounds: where a harm is potentially irreversible and catastrophic, and the option to wait has value, paying to preserve future flexibility can be justified even under deep uncertainty. [[nick-bostrom]]'s work on [[existential-risk]] arrives at the same structure from a different direction, and [[differential-technological-development]] can be read as an attempt to convert that structure into a policy that sequences technologies rather than blocking them. ## Outlook## Outlook The principle's practical future in biotechnology depends on a question it cannot answer internally: who counts the costs of delay. Approval regimes make the risks of action visible and attributable, while the harms of inaction — untreated disease, forgone yield, deaths on transplant waiting lists — are diffuse and statistical. Proposals to fix the asymmetry range from mandatory counting of forgone benefits in regulatory impact assessment to conditional approval with mandatory post-market surveillance, the model already used for accelerated drug approvals. None has been adopted broadly enough to test whether it changes outcomes, and the technologies now arriving in [[synthetic-genomes]] and self-propagating systems are precisely the ones where getting the accounting wrong in either direction is expensive.The principle's practical future in biotechnology depends on a question it cannot answer internally: who counts the costs of delay. Approval regimes make the risks of action visible and attributable, while the harms of inaction (untreated disease, forgone yield, deaths on transplant waiting lists) are diffuse and statistical. Proposals to fix the asymmetry range from mandatory counting of forgone benefits in regulatory impact assessment to conditional approval with mandatory post-market surveillance, the model already used for accelerated drug approvals. None has been adopted broadly enough to test whether it changes outcomes. The technologies now arriving in [[synthetic-genomes]] and self-propagating systems are exactly the ones where getting the accounting wrong in either direction is expensive. ## See also## See also lines 106–112 → 115–12510 unchanged lines not shown
[^ec2000]: `report` European Commission. *Communication from the Commission on the Precautionary Principle*, COM(2000) 1. Brussels, 2000. {A Commission communication is guidance on how the principle should be applied, not a binding instrument in itself.}[^ec2000]: `report` European Commission. *Communication from the Commission on the Precautionary Principle*, COM(2000) 1. Brussels, 2000. {A Commission communication is guidance on how the principle should be applied, not a binding instrument in itself.}[^adamala2024]: `paper` Adamala, K. P. et al. "Confronting risks of mirror life." *Science*, 2024. {A policy argument signed by a large group of researchers, not an experimental result; no mirror organism exists to have been studied.}[^adamala2024]: `paper` Adamala, K. P. et al. "Confronting risks of mirror life." *Science*, 2024. {A policy argument signed by a large group of researchers, not an experimental result; no mirror organism exists to have been studied.}[^wto2006]: `law` World Trade Organization. *European Communities — Measures Affecting the Approval and Marketing of Biotech Products*, Panel Reports WT/DS291/R, WT/DS292/R, WT/DS293/R, 2006. {The panel found undue delay in the completion of approval procedures for 24 of 27 products under the SPS Agreement. This was a procedural finding, not an assessment of the products themselves.}[^cjeu2018]: `law` *Confédération paysanne and Others v Premier ministre*, Case C-528/16, Court of Justice of the European Union, Grand Chamber, 25 July 2018.[^ca2024]: `law` Court of Appeals of the Philippines, decision of 17 April 2024 granting a writ of kalikasan against the commercial propagation of Golden Rice and Bt eggplant. {The court cited conflicting scientific views and uncertainty about risks and halted propagation until agencies submit proof of safety and legal compliance.}[^sunstein2005]: `book` Sunstein, C. R. *Laws of Fear: Beyond the Precautionary Principle*. Cambridge University Press, 2005.[^sunstein2005]: `book` Sunstein, C. R. *Laws of Fear: Beyond the Precautionary Principle*. Cambridge University Press, 2005.[^steel2015]: `book` Steel, D. *Philosophy and the Precautionary Principle: Science, Evidence, and Environmental Policy*. Cambridge University Press, 2015.[^more2013]: `book` More, M. "The Proactionary Principle: Optimizing Technological Outcomes." In More, M. and Vita-More, N. (eds), *The Transhumanist Reader*. Wiley-Blackwell, 2013.[^more2013]: `book` More, M. "The Proactionary Principle: Optimizing Technological Outcomes." In More, M. and Vita-More, N. (eds), *The Transhumanist Reader*. Wiley-Blackwell, 2013.[^taleb2014]: `preprint` Taleb, N. N., Read, R., Douady, R., Norman, J. and Bar-Yam, Y. "The Precautionary Principle (with Application to the Genetic Modification of Organisms)." Extreme Risk Initiative working paper, NYU School of Engineering, 2014. {A working paper rather than a reviewed article; its argument is about payoff structure, and it takes genetically modified crops as the worked example.}[^taleb2014]: `preprint` Taleb, N. N., Read, R., Douady, R., Norman, J. and Bar-Yam, Y. "The Precautionary Principle (with Application to the Genetic Modification of Organisms)." Extreme Risk Initiative working paper, NYU School of Engineering, 2014. {A working paper rather than a reviewed article; its argument is about payoff structure, and it takes genetically modified crops as the worked example.} removed, struck through added, underlinedLine numbers count the serialised markdown of each revision, frontmatter included.
94 lines are the same in both revisions, and 36 of them are not shown. Neither revision here is necessarily the current article — read Precautionary principle for the text this wiki stands behind today.