Loading
What changed between revision 1 and revision 2, compared over the article's markdown source with its frontmatter — so a change to status, evidence or reversibility shows up as the edit it is.
Older · revision 1
Import· initial corpus import, not an edit
Initial import of content/dual-use-research.md — the filesystem corpus, unchanged. Not an edit.
13.7 kB
Revision 1
Revision 2
lines 7–13 → 7–136 unchanged lines not shown
categories: ["society", "genetics"]categories: ["society", "genetics"]tags: ["biosecurity", "governance", "pandemics", "gain of function", "policy", "risk"]tags: ["biosecurity", "governance", "pandemics", "gain of function", "policy", "risk"]summary: "Life-science research that produces knowledge or tools with legitimate purposes but foreseeable potential for catastrophic misuse, and the oversight regimes built around it."summary: "Life-science research that produces knowledge or tools with legitimate purposes but foreseeable potential for catastrophic misuse, and the oversight regimes built around it."updated: "2026-07-27"updated: "2026-10-29"humanEvidence: "No documented case exists of published dual-use research being used to cause mass harm; the recorded human toll is from laboratory-acquired infections and containment failures."humanEvidence: "No documented case exists of published dual-use research being used to cause mass harm; the recorded human toll is from laboratory-acquired infections and containment failures."access: "The enabling capability is widely available: gene synthesis is a commercial service and pathogen sequences are public, with order screening voluntary and incomplete."access: "The enabling capability is widely available: gene synthesis is a commercial service and pathogen sequences are public, with order screening voluntary and incomplete."reversibility: "irreversible"reversibility: "irreversible"lines 28–46 → 28–4614 unchanged lines not shown
}}`````` **Dual-use research of concern**, or DURC, is life-science research conducted for legitimate purposes that could reasonably be anticipated to yield knowledge, methods, or materials directly applicable to causing large-scale harm. The category was formalised in US policy in the 2000s, following a National Research Council report that identified a short list of experiments of concern,[^fink2004] and covers a narrow slice of biology — work that increases a pathogen's transmissibility, virulence, host range, or resistance to countermeasures, or that renders a dangerous agent easier to produce. It is the clearest case in which the same result is both a public good and a hazard, and it has no solution, only trade-offs.**Dual-use research of concern**, or DURC, is life-science research conducted for legitimate purposes that could reasonably be anticipated to yield knowledge, methods, or materials directly applicable to causing large-scale harm. The category was formalised in US policy in the 2000s, following a National Research Council report that identified a short list of experiments of concern.[^fink2004] It covers a narrow slice of biology: work that increases a pathogen's transmissibility, virulence, host range, or resistance to countermeasures, or that renders a dangerous agent easier to produce. The category is the clearest case in which the same result is both a public good and a hazard, and every available response is a trade-off rather than a solution. ## The mechanism## The mechanism Biological risk differs from other technological risk in three ways that shape the governance problem.Biological risk differs from other technological risk in three ways that shape the governance problem. **Information is the weapon.** A method published in a journal cannot be recalled, is available identically to everyone who reads it, and does not degrade. The barrier to misuse is tacit skill and materials rather than knowledge, and both barriers have fallen.**The information itself carries the hazard.** A method published in a journal cannot be recalled, is available identically to everyone who reads it, and does not degrade. What stands between knowledge and misuse is tacit skill and materials, and both of those barriers have fallen. **Capability is dual by construction.** Understanding what makes an influenza virus transmissible between mammals is the same knowledge that would allow one to be made transmissible. Surveillance, vaccine design, and countermeasure development all require it. There is no version of the research that produces only the defensive half.**Capability is dual by construction.** Understanding what makes an influenza virus transmissible between mammals is the same knowledge that would allow one to be made transmissible. Surveillance, vaccine design, and countermeasure development all require it, and no version of the research produces only the defensive half. **Self-replication.** Unlike chemical or radiological agents, a pathogen released once can propagate beyond the point of release. This is why biological risk features in the taxonomies discussed under [[existential-risk]] and why engineered pandemics are usually named as the most plausible near-term route to a global catastrophe. The same property drives concern about the self-spreading constructs described in [[gene-drive]] and about the chirally inverted organisms in [[mirror-life]], and it is what distinguished real biological hazard from the self-replicating machines imagined in [[grey-goo]], which never existed.**Self-replication.** Unlike chemical or radiological agents, a pathogen released once can propagate beyond the point of release. For that reason biological risk features in the taxonomies discussed under [[existential-risk]], and engineered pandemics are usually named as the most plausible near-term route to a global catastrophe. The same property drives concern about the self-spreading constructs described in [[gene-drive]] and about the chirally inverted organisms in [[mirror-life]]. It also separates real biological hazard from the self-replicating machines imagined in [[grey-goo]], which never existed. [[nick-bostrom|Nick Bostrom]]'s typology of information hazards supplies the vocabulary the field now uses: the harm can come from the specific data, from the demonstration that something is possible, or merely from directing attention to a vulnerability.[^bostrom2011][[nick-bostrom|Nick Bostrom]]'s typology of information hazards supplies the vocabulary the field now uses. On that account the harm can come from the specific data, from the demonstration that something is possible, or merely from directing attention to a vulnerability.[^bostrom2011] ## The cases that defined the category## The cases that defined the category lines 49–105 → 49–1052 unchanged lines not shown
{ "year": "2001", "title": "Mousepox", "text": "Australian researchers inserting an immune-signalling gene into mousepox found it killed vaccinated mice. The result was incidental to the project's contraceptive aim and demonstrated that virulence enhancement could be stumbled into." }, { "year": "2001", "title": "Mousepox", "text": "Australian researchers inserting an immune-signalling gene into mousepox found it killed vaccinated mice. The result was incidental to the project's contraceptive aim and demonstrated that virulence enhancement could be stumbled into." }, { "year": "2002", "title": "Poliovirus synthesised", "text": "A team assembled infectious poliovirus from mail-order DNA fragments using the published sequence, showing that a virus could be reconstructed without access to a natural sample." }, { "year": "2002", "title": "Poliovirus synthesised", "text": "A team assembled infectious poliovirus from mail-order DNA fragments using the published sequence, showing that a virus could be reconstructed without access to a natural sample." }, { "year": "2005", "title": "1918 influenza reconstructed", "text": "The virus responsible for the deadliest pandemic on record was rebuilt from sequence recovered from preserved tissue and characterised in animals." }, { "year": "2005", "title": "1918 influenza reconstructed", "text": "The virus responsible for the deadliest pandemic on record was rebuilt from sequence recovered from preserved tissue and characterised in animals." }, { "year": "2011–2012", "title": "H5N1 transmissibility", "text": "Two laboratories produced avian influenza variants transmissible between ferrets by respiratory droplet. A US advisory board first recommended redacting the methods, then reversed; the papers were published in full after a voluntary research moratorium." }, { "year": "2011-2012", "title": "H5N1 transmissibility", "text": "Two laboratories produced avian influenza variants transmissible between ferrets by respiratory droplet. A US advisory board first recommended redacting the methods, then reversed; the papers were published in full after a voluntary research moratorium." }, { "year": "2018", "title": "Horsepox", "text": "A Canadian group synthesised horsepox virus, a relative of smallpox, from commercially ordered DNA at modest cost, reopening the question of whether smallpox could be reconstructed." } { "year": "2018", "title": "Horsepox", "text": "A Canadian group synthesised horsepox virus, a relative of smallpox, from commercially ordered DNA at modest cost, reopening the question of whether smallpox could be reconstructed." }]]`````` The 2011 episode is the field's reference case because it exposed every unresolved question at once: whether a journal should publish methods, who decides, whether redaction is feasible when dozens of laboratories can reproduce the work, and whether a voluntary moratorium accomplishes anything beyond delay. The papers were published, no misuse followed, and both camps regard this as confirming their position.The 2011 episode is the field's reference case because it raised every unresolved question at once: whether a journal should publish methods, who decides, whether redaction is feasible when dozens of laboratories can reproduce the work, and whether a voluntary moratorium accomplishes anything beyond delay. The papers were published and no misuse followed, an outcome both camps read as confirming their position. ## Plausibility## Plausibility Assessing how likely deliberate misuse is requires separating three questions that are routinely merged.Assessments of how likely deliberate misuse is turn on three questions that are routinely merged. **Capability** has clearly increased. Gene synthesis is a commercial service; sequences for most known pathogens are in public databases; the reverse-genetics methods for reconstructing RNA viruses are taught in graduate programmes, and the editing tools described in [[crispr-cas9]] made targeted modification of a genome a routine laboratory operation. The whole-genome construction methods surveyed in [[synthetic-genomes]] were developed for microbial engineering and apply without modification to viral genomes. The 2018 horsepox work was performed by a small academic team at a reported cost of about a hundred thousand dollars.**Capability** has clearly increased. Gene synthesis is a commercial service; sequences for most known pathogens are in public databases; the reverse-genetics methods for reconstructing RNA viruses are taught in graduate programmes, and the editing tools described in [[crispr-cas9]] made targeted modification of a genome a routine laboratory operation. The whole-genome construction methods surveyed in [[synthetic-genomes]] were developed for microbial engineering and apply without modification to viral genomes. The 2018 horsepox work was performed by a small academic team at a reported cost of about a hundred thousand dollars. **Intent** is the term with the least evidence behind it. Historical bioweapons programmes were state-run, expensive, and largely unsuccessful at producing usable weapons; the small number of non-state attempts caused limited casualties. There is no observed case of a modern actor using published dual-use research to cause mass harm. Analysts disagree sharply about whether this reflects a genuine difficulty or a period of good fortune.**Intent** has the least evidence behind it. Historical bioweapons programmes were state-run, expensive, and largely unsuccessful at producing usable weapons, and the small number of non-state attempts caused limited casualties. There is no observed case of a modern actor using published dual-use research to cause mass harm. Analysts disagree sharply over whether that record reflects a genuine difficulty or a period of good fortune. **Accident** is the neglected term and the one with a documented record. Laboratory-acquired infections and containment failures have occurred repeatedly in high-containment facilities across multiple countries, including with smallpox and with influenza strains. Any assessment of research risk that considers only malice omits the more frequent pathway.**Accident** is the neglected term, and the one with a documented record. Laboratory-acquired infections and containment failures have occurred repeatedly in high-containment facilities across multiple countries, including with smallpox and with influenza strains. An assessment of research risk that considers only malice leaves out the more frequent pathway. > [!caution] What the debate cannot resolve> [!caution] What the debate cannot resolve> The costs of restricting research are diffuse and counterfactual — vaccines not developed, variants not anticipated — while the benefits are also counterfactual. Neither side can produce the comparison that would settle the question, which is why two decades of argument have not converged.> The costs of restricting research are diffuse and counterfactual, consisting of vaccines not developed and variants not anticipated, and the benefits are counterfactual as well. Neither side can produce the comparison that would settle the question, which is why two decades of argument have not converged. ## AI-assisted biodesign## AI-assisted biodesign The newest input is machine learning, and it has changed the analysis in a specific way rather than a general one.Machine learning is the newest input, and it has changed the analysis in one specific respect rather than across the board. A 2022 paper reported that a [[ai-drug-discovery|drug-discovery model]] built to avoid toxicity could be inverted to seek it, generating tens of thousands of candidate toxic molecules in under six hours.[^urbina2022] The molecules were never synthesised, and synthesis remains the hard step, but the demonstration reframed the bottleneck: design is no longer scarce.A 2022 paper reported that a [[ai-drug-discovery|drug-discovery model]] built to avoid toxicity could be inverted to seek it, generating tens of thousands of candidate toxic molecules in under six hours.[^urbina2022] The molecules were never synthesised, and synthesis remains the hard step, but the demonstration moved the bottleneck: design is no longer the scarce part. [[ai-protein-design|Protein design models]] raise a sharper version. In 2025 researchers reported that AI-generated variants of known toxin sequences could evade the sequence-screening software used by commercial DNA synthesis providers, with patches developed and distributed before publication. The episode is notable less for the vulnerability than for the response, which followed a coordinated-disclosure model borrowed from computer security and is the first such process in biosecurity.[[ai-protein-design|Protein design models]] raise a sharper version of the problem. In 2025 researchers reported that AI-generated variants of known toxin sequences could evade the sequence-screening software used by commercial DNA synthesis providers, with patches developed and distributed before publication. What makes the episode notable is the response rather than the vulnerability. It followed a coordinated-disclosure model borrowed from computer security, the first such process in biosecurity. Frontier AI developers began applying elevated deployment safeguards to their models on biological-weapons-relevant capability grounds from 2025, and biosecurity evaluations are now a standard component of frontier model assessment. Whether the safeguards constrain a determined user or merely raise the effort required is not publicly established, and the same models are available in open-weight form from other developers without comparable restrictions. [[artificial-general-intelligence]] treats the broader capability question.Frontier AI developers began applying elevated deployment safeguards to their models on biological-weapons-relevant capability grounds from 2025, and biosecurity evaluations are now a standard component of frontier model assessment. Whether those safeguards constrain a determined user or only raise the effort required is not publicly established, and comparable models are available in open-weight form from other developers without similar restrictions. [[artificial-general-intelligence]] treats the broader capability question. ## Mitigation## Mitigation Controls operate at four points, and their effectiveness declines as one moves down the list.Controls operate at four points, and they get weaker further down the list. **Physical containment** — biosafety levels, negative pressure, personnel training — is mature, well specified, and addresses accidents rather than misuse. Genetic containment is the newer variant: the synthetic auxotrophy built into the strains described in [[recoded-organisms]] makes an escaped organism unable to survive outside a supplemented medium, which is a stronger guarantee than a physical barrier and applies only to engineered organisms rather than to natural pathogens.**Physical containment**, meaning biosafety levels, negative pressure and personnel training, is mature and well specified, and it addresses accidents rather than misuse. Genetic containment is the newer variant. The synthetic auxotrophy built into the strains described in [[recoded-organisms]] leaves an escaped organism unable to survive outside a supplemented medium, a stronger guarantee than a physical barrier, though one that applies only to engineered organisms and not to natural pathogens. **Synthesis screening** is the most-discussed intervention. Members of the International Gene Synthesis Consortium, formed in 2009, screen order sequences against lists of agents of concern and verify customer legitimacy. Coverage is voluntary and incomplete, the screening is defeatable by ordering fragments from multiple providers, and benchtop synthesisers distribute the capability to sites that no consortium reaches. The US required screening for federally funded work under a 2023 executive order that was revoked in January 2025, leaving the status of the associated framework unclear as of 2026.**Synthesis screening** is the most-discussed intervention. Members of the International Gene Synthesis Consortium, formed in 2009, screen order sequences against lists of agents of concern and verify customer legitimacy. Coverage is voluntary and incomplete, the screening can be defeated by ordering fragments from multiple providers, and benchtop synthesisers put the capability in sites that no consortium reaches. The US required screening for federally funded work under a 2023 executive order that was revoked in January 2025, leaving the status of the associated framework unclear as of 2026. **Funding-stage review** allows a funder to decline work before it is done, which is the only intervention that acts before the information exists. The US paused federal funding for certain gain-of-function influenza and coronavirus work from 2014 to 2017, replaced the pause with a review framework, and in 2024 issued a unified policy covering both DURC and research on pathogens with enhanced pandemic potential. An executive order in May 2025 further restricted federal support for dangerous gain-of-function research. All of this binds federally funded work in one country.**Funding-stage review** lets a funder decline work before it is done, and it is the only intervention that acts before the information exists. The US paused federal funding for certain gain-of-function influenza and coronavirus work from 2014 to 2017, replaced the pause with a review framework, and in 2024 issued a unified policy covering both DURC and research on pathogens with enhanced pandemic potential. An executive order in May 2025 further restricted federal support for dangerous gain-of-function research. All of these measures bind federally funded work in one country. **Publication review** is the last line and the weakest. Journals have no investigative capacity, editors are not biosecurity analysts, and by the time a manuscript is submitted the work has been done and discussed at conferences.**Publication review** is the last control and the weakest. Journals have no investigative capacity, editors are not biosecurity analysts, and by the time a manuscript arrives the work has been done and discussed at conferences. ## Governance## Governance The Biological Weapons Convention, in force since 1975, prohibits development, production, and stockpiling of biological weapons and has near-universal membership. It has no verification mechanism: negotiations on a compliance protocol collapsed in 2001 and have not been revived. Its implementation support unit is very small. There is no international body that inspects laboratories, no reporting obligation for dual-use experiments, and no forum with authority to stop a specific project.The Biological Weapons Convention, in force since 1975, prohibits development, production, and stockpiling of biological weapons and has near-universal membership. It has no verification mechanism, since negotiations on a compliance protocol collapsed in 2001 and have not been revived. Its implementation support unit is very small. There is no international body that inspects laboratories, no reporting obligation for dual-use experiments, and no forum with authority to stop a specific project. What exists instead is national policy of varying rigour, institutional review committees, and the professional norms inherited from the [[asilomar-conference]] — a model whose limits were demonstrated in the [[he-jiankui-affair]] and which assumes the relevant actors care about standing among peers. The same structural weakness runs through [[governance-of-genome-editing]]: the enforceable layer is domestic law, and it reaches only those who submit to it.What exists instead is national policy of varying rigour, institutional review committees, and the professional norms inherited from the [[asilomar-conference]]. That model assumes the relevant actors care about standing among peers, and the [[he-jiankui-affair]] demonstrated its limits. The same structural weakness runs through [[governance-of-genome-editing]]: the enforceable layer is domestic law, and it reaches only those who submit to it. The field's characteristic policy proposal is not prohibition but sequencing. [[differential-technological-development]] argues for advancing detection, countermeasures, and protective capability ahead of the research that creates the hazard, which avoids the objection that a blanket [[precautionary-principle]] would also block the work needed to respond to natural outbreaks.The field's characteristic policy proposal concerns sequencing rather than prohibition. [[differential-technological-development]] argues for advancing detection, countermeasures, and protective capability ahead of the research that creates the hazard. That ordering avoids the objection that a blanket [[precautionary-principle]] would also block the work needed to respond to natural outbreaks. The open problem is what happens as the capability distributes. The controls described above are designed for a world in which dangerous work requires institutional resources: a laboratory, a funder, a supplier. Benchtop synthesis, contract research organisations, and design tools that run on a laptop each erode that assumption. The proposals for what replaces it — from licensing of synthesis equipment to the surveillance architectures contemplated in the vulnerable-world literature — are either insufficient or, as their own authors concede, worse than the problem.The open problem is what happens as the capability spreads. The controls described above are designed for a world in which dangerous work requires institutional resources: a laboratory, a funder, a supplier. Benchtop synthesis, contract research organisations, and design tools that run on a laptop each erode that assumption. Proposals for what should replace it run from licensing of synthesis equipment to the surveillance architectures contemplated in the vulnerable-world literature, and they are either insufficient or, as their own authors concede, worse than the problem. ## See also## See also removed, struck through added, underlinedLine numbers count the serialised markdown of each revision, frontmatter included.
95 lines are the same in both revisions, and 37 of them are not shown. Neither revision here is necessarily the current article — read Dual-use research of concern for the text this wiki stands behind today.