A problem family — different problems, same issues

the regulator demands
evidence that cannot exist

21 problems across 10 fields

These 21 problems meet the same obstacle: the evidence the regulator demands doesn't match how the technology behaves. AI medical devices keep learning, and FDA clearance assumes an algorithm that stays fixed. Hydrogen pipeline welds operate under conditions existing fatigue tests did not anticipate. Methods for assessing the risk of neonicotinoid pesticides were designed in ways that underestimated harm to pollinators. In the “the rulebook was written for a world that no longer exists” family no rules exist. Here rules exist and require the wrong evidence.

A regulatory framework exists, and it demands evidence in a form that doesn't match how the technology behaves.

Ways this family shows up

Wrong kind of evidence. The framework exists but requires a type of evidence the technology can't supply
Measurement doesn't apply. Standards exist but their measurement methods don't work on the new technology
Outdated comparison. The reference products regulators compare against are too far from current technology for the comparison to mean anything

The 21 problems in this family

the pesticide that killed the wrong insecttested in the wrong worldhigh

old wool, new wool, same skipthe rules got in the wayhigh

three billion people, no building codethe rules got in the wayhigh

also in the rulebook was written for a world that no longer exists

twenty-five hundred gigawatts in linethe rules got in the waymedium

hydrogen flows before the rules arrivetested in the wrong worldhigh

guilty by pixelthe rules got in the wayhigh

cleared by a ghost devicethe rules got in the wayhigh

also in the rulebook was written for a world that no longer exists

approved without proofbuilt without the people who'd live with ithigh

also in the rulebook was written for a world that no longer exists

no way to know if the drug workedthe rules got in the wayhigh

brain data for sale, no rulesthe rules got in the wayhigh

also in the rulebook was written for a world that no longer exists

every lab, a different answerthe rules got in the wayhigh

also in the infrastructure that generates bad science

the app was prescribed, the outcome unknownthe rules got in the waymedium

nearly eighty thousand tests, no fda oversightbuilt without the people who'd live with ithigh

also in the rulebook was written for a world that no longer exists

the joint replacement corrodes in silencethe rules got in the wayhigh

approved, available, unusedthe rules got in the waymedium

materials rated for a climate that's gonethe rules got in the wayhigh

also in the model was never trained on this

building codes that ignore the tornado's spinthe rules got in the wayhigh

also in the model was never trained on this

injured on the job, invisible to the systemthe rules got in the wayhigh

also in the rulebook was written for a world that no longer exists

nobody counts the whole daymeasured the wrong thinghigh

also in the wrong ruler

every printed part needs its own certificationtested in the wrong worldhigh

pipes sized by a 1940s formulathe rules got in the wayhigh

also in the rulebook was written for a world that no longer exists

Confidence: high = from a primary expert source (Tier 1) · medium = from an analyst, conference, or community source (Tier 2 or 3) · needs sourcing = flagged until we find a better source · the dot's size is its tier; a dashed dot needs sourcing

Loading…

the regulator demandsevidence that cannot exist

Ways this family shows up

The 21 problems in this family

the regulator demandsevidence that cannot exist

Ways this family shows up

The 21 problems in this family

the regulator demands
evidence that cannot exist

the regulator demands
evidence that cannot exist