Preparedness Simulation Evidence Framework

PSEF-X

Evidence-based analysis of 40 years of pandemic exercises, crisis simulations, and strategic war games — documenting the patterns of preparedness failure that define our biological response readiness.

1983 · Proud Prophet
1983 · Able Archer
2000 · TOPOFF 1
2001 · Dark Winter
2002 · Millennium Challenge
2003 · Global Mercury
2005 · Atlantic Storm
2017 · SPARS
2018 · Clade X
2016 · Exercise Cygnus
2019 · Event 201
2019 · Crimson Contagion
2016 · Exercise Alice
2018 · Mataika
2019 · Pacific Eclipse
2021 · NTI Bio
2022 · Catastrophic Contagion
2007 · Winter Willow
2010 · Lock Step
2025 · Exercise Pegasus
20
Exercises
1983–2025
Time Span
5
Categories
$500M+
Combined Cost
2B+
Simulated Deaths
HSEEP Exercise Type Taxonomy

The U.S. Homeland Security Exercise and Evaluation Program (HSEEP) defines 7 exercise types across two categories. Each PSEF-X exercise is classified below according to this framework. Full Glossary   QC Validation Report   ETEM Matrix

Discussion-Based Exercises HSEEP Category 1
SeminarSEM
A low-stress, informal discussion used to orient participants on plans, policies, or procedures. No simulation involved — purely informational briefing in a group setting.
Informational Group setting 1–3 hours
PSEF-X Exercises of This Type
None — lowest complexity level
WorkshopWKS
Like a seminar but produces a deliverable — a draft plan, policy, SOP, or mutual aid agreement. Participants collaborate to build or refine specific products.
Produces output Collaborative 3–8 hours
PSEF-X Exercises of This Type
None — product-focused, not scenario-driven
Tabletop ExerciseTTX
A discussion-based exercise where senior officials discuss simulated crisis scenarios in an informal setting. No resources deployed — participants walk through plans, policies, and decision-making to identify gaps and validate procedures.
Discussion-only Senior officials Tests plans 4–8 hours
PSEF-X Exercises of This Type
Dark Winter (2001) Global Mercury (2003) Atlantic Storm (2005) SPARS (2017) Clade X (2018) Event 201 (2019) NTI Bio (2021) Lock Step (2010)
GameGAME
A competitive, rule-bound exercise where teams explore decision-making under simulated conditions. Distinguished from TTX by structured rules, scoring, and adversarial or competitive dynamics between players.
Competitive Rules-based Strategic 4–48 hours
PSEF-X Exercises of This Type
See “War Game” below — military variant
Operations-Based Exercises HSEEP Category 2
DrillDRL
A coordinated, supervised activity used to test a single specific operation or function. Equipment is deployed, personnel execute real procedures, but scope is deliberately limited to one capability.
Single function Resources deployed Validates SOPs 2–8 hours
PSEF-X Exercises of This Type
None — Able Archer reclassified to CPX/FE
Functional ExerciseFE
A multi-agency coordination test that validates command, control, and communication without full “boots on the ground.” Participants operate from EOCs, use MSEL injects, and test inter-agency protocols in realistic time pressure. Also known as Command Post Exercise (CPX) in military doctrine (FEMA GovInfo).
Multi-agency Command & control MSEL-driven Days to weeks
PSEF-X Exercises of This Type
Able Archer 83 (1983) — CPX Exercise Cygnus (2016) — CPX Crimson Contagion (2019) — FE series Winter Willow (2007) — FE Exercise Pegasus (2025) — FE
Full-Scale ExerciseFSE
The most complex and resource-intensive exercise type. Multi-agency, multi-jurisdictional, with full deployment of equipment, personnel, and real-world response actions. Tests end-to-end crisis response, management, and recovery.
Full deployment Multi-jurisdiction Highest cost Weeks to months
PSEF-X Exercises of This Type
TOPOFF Series (2000–2007)
Military / Strategic Variant Beyond HSEEP
War GameWG
An analytic simulation of military or strategic operations involving two or more adversarial sides (Red/Blue), governed by rules and classified data to model conflict, escalation, or crisis outcomes. The defining feature vs. a TTX is the adversarial structure — someone is actively playing against you.
Adversarial sides Often classified Strategic analysis DoD / military
PSEF-X Exercises of This Type
Proud Prophet (1983) Millennium Challenge (2002)
LIVE
Atlantic Storm
Jan 14, 2005 — Washington, D.C.
Category
Bioterror — Smallpox
Tabletop Exercise

Confronted 10 heads of government with a simultaneous smallpox aerosol attack on 6 cities across NATO nations, revealing catastrophic gaps in international coordination.

6
Cities Hit
3,320
Cases in 4.5h
12
Principals
Vaccine nationalism predicted 15 years before COVID-19
WHO bioterror budget: only $6.3M — "like a mid-sized hospital"
TTX PSEF: Detection, Response RSKB: IHR, BWC
LIVE
Operation Dark Winter
Jun 22–23, 2001 — Andrews AFB, MD
Category
Bioterror — Smallpox
Tabletop Exercise

The exercise that started it all. A covert smallpox attack on 3 U.S. malls — designed to be inherently unwinnable. Conducted 3 months before 9/11.

3
States Hit
3,000
Infections
12
Principals
No surge capacity in U.S. healthcare system
Led to $3B in vaccine stockpiling post-9/11
TTX PSEF: Surge Capacity RSKB: PHSA, SNS
LIVE
Event 201
Oct 18, 2019 — The Pierre Hotel, NYC
Category
Pandemic — Novel Coronavirus
Tabletop Exercise

Held 2.5 months before COVID-19's first case. Simulated "CAPS" — a novel coronavirus from Brazilian pig farms killing 65M in 18 months. JHU + WEF + Gates Foundation.

65M
Deaths
18mo
Duration
15
Players
Pandemics cause avg $570B/year loss (0.7% global GDP)
4th in series: Dark Winter → Atlantic Storm → Clade X → Event 201
TTX PSEF: Surveillance, PPE RSKB: IHR, CEPI
LIVE
Clade X
May 15, 2018 — Washington, D.C.
Category
Pandemic — Engineered Virus
Tabletop Exercise

A fringe group engineered a parainfluenza/Nipah hybrid virus. Within one year: 900M dead worldwide, 15M in the U.S. alone. The most lethal scenario in exercise history.

900M
Dead
~150
Attendees
~10%
CFR
20mo
Vaccine
Must produce new vaccines in months, not years
First public pandemic exercise — livestreamed on Facebook
TTX PSEF: MCM, Genomics RSKB: PAHPA, EUA
LIVE
Millennium Challenge 2002
Jul 24 – Aug 15, 2002 — U.S. Military Bases
War Game

Most expensive war game in U.S. history ($250M). Lt. Gen. Van Riper sank 16 warships with asymmetric tactics. Exercise was stopped, ships "re-floated," and rules changed to ensure Blue victory.

$250M
Cost
16
Ships Sunk
13K
Troops
20K+
Casualties
Asymmetric tactics defeated network-centric warfare
Van Riper: "rigged" and "$250M wasted"
WAR GAME PSEF: C2, Asymmetric RSKB: UCMJ, Title 10
LIVE
Able Archer 83
Nov 7–11, 1983 — SHAPE HQ, Belgium
Command Post / Functional Exercise

5-day NATO exercise that simulated DEFCON 1 nuclear strike. Soviets believed it was real — loaded nuclear warheads onto bombers. One of the closest moments to nuclear war since Cuba 1962.

5
Day Exercise
19K
Troops
Nukes Armed
Soviet nuclear-capable aircraft on 30-minute alert
Perroots' restraint likely averted nuclear exchange
CPX / FE RSKB: NATO Art. 5, NPT
LIVE
Proud Prophet
June 1983 — National War College, D.C.
War Game

Classified for 29 years. Every nuclear scenario ended in global annihilation: 500M+ dead, Northern Hemisphere uninhabitable. Destroyed the concept of "limited nuclear war" forever.

500M+
Dead
200+
Personnel
Until 2012
Paris, London, Amsterdam, Brussels — all destroyed in simulation
Reagan moderated rhetoric; JCS Chair revamped U.S. war plans
WAR GAME RSKB: NSDD-13, PD-59
LIVE
Crimson Contagion
Jan – Aug 2019 — 12 U.S. States
Functional Exercise

8-month HHS exercise simulating H7N9 influenza from China. The 70-page after-action report, completed months before COVID-19, found the U.S. catastrophically unprepared.

110M
Infected
7.7M
Hospital
586K
Deaths
100+
Orgs
U.S. lacked PPE and ventilator production capacity
Federal agencies confused about who leads
FE (series) PSEF: Surge, ILI Net RSKB: Stafford Act, PDD-1
LIVE
SPARS 2025–2028
Published 2017 — JHU CHS
Tabletop Exercise / Scenario

A 75-page narrative scenario predicting with eerie accuracy: novel coronavirus from SE Asia, vaccine hesitancy via social media, EUA controversies, and post-pandemic accountability crises.

Coronavirus
4.7%
Initial CFR
Scenario Doc
Social media echo chambers amplify misinformation beyond control
Successful prevention makes threat appear exaggerated
TTX / SCENARIO PSEF: Risk Comms RSKB: EUA, PREP Act
LIVE
TOPOFF Series
2000–2007 — Multiple U.S. Cities + Allies
Category
CBRN Bioterror — Plague, Chemical, Rad
Full-Scale Exercise

The congressionally mandated national exercise series that tested America's "Top Officials" against real-world CBRN terrorism — the only true full-scale exercises in the U.S. biodefense archive. 4 iterations, 25,000+ participants.

4
Iterations
25K+
Participants
+ Canada, UK
Only true full-scale CBRN exercises in U.S. history
Led directly to creation of DHS and National Exercise Program
FSE PSEF: Detection, Decon RSKB: Stafford Act, NRF
LIVE
Global Mercury
Sep 2003 — Ottawa, Canada (WHO-coordinated)
Category
Bioterror — Smallpox
Tabletop Exercise

A WHO-coordinated multinational TTX testing crisis communication between G7+ health security partners during a simultaneous smallpox bioterror attack — the missing link between Dark Winter (2001) and Atlantic Storm (2005).

G7+
Nations
WHO
Coordinator
IHR
Framework Tested
First test of international health security communication systems
Bridge from Dark Winter to Atlantic Storm in the smallpox trilogy
TTX PSEF: Communication RSKB: IHR, GHSA
LIVE
NTI Bio — Munich 2021
Mar 2021 — Munich Security Conference
Category
Bioterror — Engineered Monkeypox
Tabletop Exercise

A tabletop exercise at the Munich Security Conference simulating an engineered monkeypox bioterror attack — published 6 months before the real 2022 mpox outbreak, making it the "Event 201 of monkeypox."

19
Senior Leaders
271M
Simulated Deaths
14
Countries
Predicted monkeypox outbreak 6 months before it happened
271M simulated deaths from engineered pathogen in 18 months
TTX PSEF: Bio Surveillance RSKB: BWC, GHSA
LIVE
Exercise Cygnus
Oct 18–20, 2016 — United Kingdom
Category
Pandemic — H2N2 “Swan Flu”
Command Post / Functional Exercise

A 3-day UK government CPX that simulated peak pandemic with 950+ officials across 12 departments. Found the NHS would collapse. Report classified as "too terrifying" for 4 years until forced release during COVID-19.

950+
Participants
400K
UK Deaths
22
Recommendations
Report suppressed for 4 years — "too terrifying to reveal"
Every major finding validated by COVID-19 four years later
CPX / FE PSEF: Surge, Triage RSKB: Coronavirus Act
Tabletop Exercise
CATASTROPHIC CONTAGION
JHU CHS + WHO + Gates Foundation
2022

The “Event 201 sequel” — first major pandemic TTX conducted after COVID-19. Simulated a novel pathogen (SEERS) with higher lethality than COVID that disproportionately kills children. Even post-COVID leaders couldn’t agree on basic containment measures.

10
Health Ministers
SEERS
Novel Pathogen
Post-COVID
First TTX After
Children disproportionately affected
COVID lessons not retained
TTX PSEF: Equity, Communication
Tabletop Exercise
EXERCISE ALICE
Public Health England / DHSC
2016

The “hidden sister” of Exercise Cygnus — a UK MERS-CoV coronavirus simulation classified for 5 years. Found PPE stockpile gaps and contact tracing infrastructure absent. Released only after FOI battles during COVID-19. The UK tested coronavirus response and buried the report.

50
Simulated Cases
MERS
Coronavirus
5 yrs
Classified
PPE warnings ignored before COVID
12 actions, 4 themes — unimplemented
TTX PSEF: PPE, Contact Tracing
Tabletop Exercise
EXERCISE MATAIKA
UNSW ISER / Fiji MoH / 14 Nations
2018

Smallpox bioterrorism at Fiji’s Nadi Airport — testing Pacific region vulnerability after the 2017 horsepox synthesis proved synthetic smallpox is feasible for $100K. Mathematical modelling showed 1B+ vaccine doses needed if containment fails. 26 countries affected by Day 40.

26
Countries Hit
$100K
Horsepox Synthesis Cost
1B+
Doses Needed
Impact worse than single nuclear strike
Synthetic biology outpaced legislation
TTX PSEF: Biosecurity, Vaccine Stockpile
Tabletop Exercise
PACIFIC ECLIPSE
UNSW ISER / US INDOPACOM
2019

The Mataika sequel — conducted in December 2019, the same month COVID-19 emerged. Mathematical modelling proved every 7-day vaccination delay doubles epidemic size. WHO stockpile pledges broke under pressure. Speed of response is the single most critical variable.

Dec ’19
Same Month as COVID
R₀ 4–5
Reproduction No.
7 days
Delay = 2x Epidemic
Every day of delay matters exponentially
Pledged doses ≠ available doses
TTX PSEF: Speed, Stockpile, Detection
LIVE
Exercise Winter Willow
Feb 2007 — Whitehall & Nationwide, UK
Category
Pandemic — Influenza (H5N1-type)
Functional Exercise

The first major nationwide pandemic flu simulation in the UK. Revealed the need for mass burial sites, exposed broken antiviral distribution chains, and found local authorities overwhelmed across every metric. Published Aug 2007.

750K
Deaths (Worst)
H5N1
Flu Context
1st
Nationwide Drill
Greenfield burial sites ordered for mass pandemic deaths
Tamiflu distribution “last mile” problem unsolved
FE PSEF: Surge, Antivirals RSKB: CCA 2004
LIVE
Lock Step
Published May 2010 — Rockefeller Foundation + GBN
Category
Scenario Planning — Pandemic Influenza
Scenario Planning

A 2010 Rockefeller Foundation scenario predicting with startling accuracy: a pandemic from China, mandatory masks, temperature scanning, border closures, authoritarian government responses, and citizen pushback — a full decade before COVID-19.

8M
Deaths (7 mo)
2010
Published
4
Scenarios
Predicted masks, border closures, authoritarian responses 10 yrs early
Became one of the most viral COVID-19 conspiracy theories
SCENARIO PSEF: Governance, Surveillance
LIVE
Exercise Pegasus
Sep – Nov 2025 — United Kingdom (Nationwide)
Category
Pandemic — Novel Enterovirus EV-D68
Functional Exercise

The largest pandemic simulation in UK history — a Tier 1 national emergency exercise involving every government department post-COVID. Simulated a novel enterovirus disproportionately affecting children with respiratory failure and paralysis.

Tier 1
Emergency Level
Every Dept
Government
Children
Primarily Affected
Schools locked down in secret pandemic drills
Ministers admitted UK “still isn’t ready”
FE PSEF: Paediatric, School Closure RSKB: COVID Inquiry