Series note. To mark the completion of my ECE 5864 Critical Engineering capstone, I’m publishing a seven-part adaptation for a special week of ITE 135: AI Awareness. These posts are longer and more formal than my usual entries because they began as a graduate research paper. This is Part 6 of 7.
Introduction and Context
World models are AI systems that try to predict how the physical world will change. In a factory, that prediction can become a robot action. This makes the technology more dangerous than an ordinary generative AI system. A bad chatbot answer may ‘hallucinate’ or confuse someone. A bad robot command may crush a hand, damage equipment, or kill someone. FLUX-mimic is already being tested at Audi, even though its reliability has not been independently established. The main policy problem is therefore simple: companies are moving experimental AI from video generation into industrial control before workers, regulators, and the public have reliable ways to judge whether it is safe.
Relevance to Policy and Practice
Policy action is needed because the costs and benefits will fall on different groups. Audi and its vendors may gain faster production, lower labor costs, and a new market for foundation models. Workers may face injury, job loss, lower wages, or reassignment to monitoring roles with less skill and bargaining power. The safety risk is already real and urgent. NIOSH identified 41 robot-related deaths in the United States between 1992 and 2017, and it warns that unexpected contact, crushing, trapping, and concern about job loss remain important risks as robots work closer to people (CDC 2024). In May 2026, federal regulators opened a defect investigation into Avride, an Uber robotaxi partner operating in Austin and Dallas, after sixteen crashes in which the automated driving system merged into occupied lanes, failed to slow for traffic ahead, and struck objects partly blocking the road (O’Kane 2026). Interestingly, a trained human monitor sat in the driver’s seat for every one of them, and in only a single incident did that monitor attempt to take over. The regulator’s warning about “inappropriate assertiveness and insufficient competence” provokes the very question this report is concerned with: can a world model remain safe at the moment an ordinary reality stops resembling its training data?
Current world models add another problem: their actions may be difficult to predict and control because the models learn stochastic patterns instead of following a complete set of explicit rules. Symbolic guardrails and explicit prohibitions at some point become necessary again to avoid worst-case statistical blunders. Public stakeholders should have the right to participate in the deliberation and articulation of such absolute prohibitions. These protections remain necessary, but a learned controller raises questions that ordinary guarding and emergency stops cannot answer. Regulators also need to know how the model was trained, how often it fails, what changes after fine-tuning, and whether it behaves safely outside its demonstration data. The NIST AI Risk Management Framework can help organizations identify and manage these risks, but it is voluntary and does not itself prevent an unsafe system from entering a factory (NIST 2023). In short, the current system relies too heavily on vendors and employers to judge their own technology.
References
CDC (Centers for Disease Control and Prevention). 2024. “Robotics in the Workplace: An Overview.” National Institute for Occupational Safety and Health, February 9, 2024.
NIST (National Institute of Standards and Technology). 2023. Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1. Gaithersburg, MD: National Institute of Standards and Technology.
O’Kane, Sean. 2026. “Uber Partner Avride Is under Investigation for Self-Driving Crashes.” TechCrunch, May 8, 2026.
Leave a Reply