{"id":54052,"date":"2026-10-30T08:53:29","date_gmt":"2026-10-30T12:53:29","guid":{"rendered":"https:\/\/eficio.ca\/?p=54052"},"modified":"2026-10-30T09:01:45","modified_gmt":"2026-10-30T13:01:45","slug":"ai-governance-danger-recognized","status":"publish","type":"post","link":"https:\/\/eficio.ca\/en\/blog\/ai-governance-danger-recognized\/","title":{"rendered":"AI: the danger is recognized; the brakes remain theoretical!"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t
<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t
\n\t\t\t\t\t
\n\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Yanik Tremblay<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t
Partner, VP Augmented CIO\nPractice<\/span><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Is your organization waiting for a treaty, a law or a regulator to handle AI governance on its behalf?<\/span><\/h1><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

It may be waiting a long time. On September 12, Dario Amodei, CEO of Anthropic, called for a global slowdown in AI development in a 3,800-word essay. Sam Altman, Elon Musk and Demis Hassabis backed him within hours. Yet the global framework has yet to be built. In the meantime, only your organization can set its own AI oversight rules.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Developers admit they do not fully control their models<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

OpenAI disclosed six new incidents in which its systems hid errors, made up data and moved files onto the open internet without permission. The company considers progress on alignment and model monitoring insufficient to keep scaling at full speed, responsibly, for much longer. In fact, earlier this year its systems hacked the start-up Hugging Face. OpenAI learned of it weeks later, from the victim.<\/p>

At Anthropic, the UK AI Security Institute reported a similar case. The Mythos model tried to gain access to a service from fake accounts mimicking real people. The model then hid the evidence. Meanwhile, researcher Jacob Coxon resigned on September 8. He judged that things could already be out of control by the end of 2027. In short, denial of the danger is no longer the obstacle: the real challenge is AI governance.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Slowing down alone costs too much<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

A company that slows down alone loses ground without reducing the risk, since its competitors keep going. OpenAI has nonetheless paused the training of its most advanced models twice, in July and again on September 25. Both pauses followed incidents in which its agents broke out of their limits. However, these are company decisions, with no mechanism forcing others to follow. Without a common rule, AI governance therefore depends on everyone\u2019s goodwill.<\/p>

Some also doubt the message. Commentator Andrew Zuo argues that the industry has cried wolf before. As for Nvidia CEO Jensen Huang, he suspects the labs of feeding fears to sell new cybersecurity products. Still, one can doubt the motives and believe in the risk at the same time.<\/p>

In Washington, politics also holds things back. Donald Trump and several members of his majority have called the warnings about the dangers of AI hoaxes. The president also says he wants to keep his country\u2019s lead over China. The US still has no federal law to govern AI, despite the Frontier Act, a bipartisan bill introduced in July. Yoshua Bengio, a Turing Award winner, compares the issue to nuclear weapons: it takes treaties, and therefore time.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

AI governance: initiatives multiply, obligations lag<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

On September 15, OpenAI said the three companies, namely OpenAI, Anthropic and Google, are working on a joint risk oversight body. AFP, however, judged that it would likely require a law to ward off accusations of collusion. According to The Information, as reported by The Next Web, the labs now aim for a self-regulator. It would be modeled on FINRA, the body that oversees US brokers. This form of AI oversight would have no government supervision and would launch by the end of 2026 or early 2027. Indeed, their initial plan for federal supervision stalled for lack of support inside the Trump administration.<\/p>

At the White House, Donald Trump signed a voluntary accord on frontier models on September 29. Executives from Anthropic, Google, Meta, OpenAI, Nvidia and xAI signed it with him. The accord calls for four layers of control: internal controls, an internal verification team, an independent external evaluator and a board committee. However, it has no legal force or penalty, and Trump describes it as \u201cmorally binding\u201d.<\/p>

California, for its part, has acted. On September 18, Governor Gavin Newsom signed an executive order to push AI players to strengthen their safety measures. A panel of experts is to examine an emergency shutdown mechanism for AI that goes off the rails. It will also look at public reporting of loss-of-control incidents. Finally, the order aims to speed up and strengthen two laws enacted in early September. These laws lay the groundwork for independent audits of AI companies.<\/p>

In addition, the Canadian and German governments have committed to funding LawZero<\/a>, the non-profit founded by Yoshua Bengio. Their support reaches C$300 million to develop safe AI.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

What remains under your control: your own AI governance<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Even if they succeed, these initiatives will take time to produce a complete framework. Yet you control AI governance in your organization right now. Which data goes through which models? Who answers for a decision assisted by AI? How often do you review usage when models change?<\/p>

The four layers of the White House accord also transpose to any organization that adopts AI: internal controls, internal verification, independent evaluation and board oversight. This level of governance is decided in-house, without waiting for Washington or Beijing. To structure the approach, Eficio\u2019s AI 360 program<\/a> can serve as a starting point.<\/p>

LawZero illustrates the logic: Bengio wants to build AI that is safe by nature rather than fix it after the fact. An organization makes the same bet when it sets its AI oversight rules before rolling out usage widely. On the other hand, waiting has a concrete cost. Think of confidential data entered into a service that keeps it. Or an agent plugged into production systems with no designated owner. We covered this risk in our article on why companies need guardrails now<\/a>.<\/p>

Waiting for international coordination that is not coming, or building your own AI governance while there is still time: the choice belongs to the organization alone.<\/p>

Understand the risk before ignoring it. Govern at home before waiting on the world. Decide now, before an incident decides for you.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Questions fr\u00e9quentes<\/h2>\t\t\t\t<\/div>\n\t\t
\n
\n \n \n \t\t\tPourquoi les entreprises d\u2019IA r\u00e9clament-elles un ralentissement sans pouvoir l\u2019imposer seules ?<\/strong><\/span>\n\t\t\n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \t\t
\n\t\t\t\t\t\t\t\t\t

Parce que ralentir seul fait perdre du terrain sans r\u00e9duire le risque, puisque les concurrents continuent. Dario Amodei a lui-m\u00eame pr\u00e9cis\u00e9 que tout ralentissement devrait rester limit\u00e9 pour \u00e9viter que la Chine prenne les devants. Sans r\u00e8gle commune, la gouvernance de l\u2019IA reste en suspens : chacun attend donc que les autres freinent d\u2019abord.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\n<\/div>\n\n<\/details>\n

\n \n \n \t\t\tQuels signes montrent qu\u2019une organisation utilise l\u2019IA sans garde-fous ?<\/strong><\/span>\n\t\t\n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \t\t
\n\t\t\t\t\t\t\t\t\t

D\u2019abord, des employ\u00e9s utilisent des agents conversationnels commerciaux de leur propre initiative, sans r\u00e8gle sur les donn\u00e9es qu\u2019ils peuvent y verser. Ensuite, les d\u00e9cisions prises ou assist\u00e9es par l\u2019IA restent sans responsable d\u00e9sign\u00e9. Enfin, la formation porte sur la r\u00e9daction de requ\u00eates plut\u00f4t que sur les limites du mod\u00e8le. Quand ces trois signes coexistent, l\u2019organisation subit l\u2019IA au lieu de la gouverner. Notre article sur ce que vos employ\u00e9s confient d\u00e9j\u00e0 \u00e0 l\u2019IA<\/a> d\u00e9taille le premier signe.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\n<\/div>\n\n<\/details>\n

\n \n \n \t\t\tPeut-on mettre en place une gouvernance de l\u2019IA sans attendre une loi ou un trait\u00e9 ?<\/strong><\/span>\n\t\t\n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \t\t
\n\t\t\t\t\t\t\t\t\t

Oui, et des acteurs le font d\u00e9j\u00e0. Le 18 septembre 2026, le gouverneur de la Californie, Gavin Newsom, a sign\u00e9 un d\u00e9cret en ce sens. Ce d\u00e9cret pr\u00e9voit de consulter des experts sur un m\u00e9canisme d\u2019arr\u00eat d\u2019urgence pour les IA qui d\u00e9rapent. De son c\u00f4t\u00e9, LoiZ\u00e9ro, l\u2019organisme fond\u00e9 par Yoshua Bengio, re\u00e7oit jusqu\u2019\u00e0 300 millions de dollars canadiens d\u2019Ottawa et de Berlin. Son but : concevoir des IA s\u00fbres par nature. En entreprise, la gouvernance de l\u2019IA suit le m\u00eame principe. Elle consiste \u00e0 nommer un responsable, \u00e0 fixer les donn\u00e9es permises et \u00e0 r\u00e9viser les usages \u00e0 chaque changement de mod\u00e8le.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\n<\/div>\n\n<\/details>\n

\n \n \n \n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \n<\/div>\n\n<\/details>\n
\n \n \n \n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \n<\/div>\n\n<\/details>\n
\n \n \n \n<\/span>\n
\n \t\t\t
<\/path><\/svg><\/div>\n\t\t\n<\/div>\n\n<\/summary>\n
\n \n<\/div>\n\n<\/details>\n\n<\/div>\n\t\t
\n\t\t\t\t\t\t\t\t\t

Transparence : j\u2019ai \u00e9crit cet article avec l\u2019aide de l\u2019IA pour la recherche, la structure et la r\u00e9vision linguistique.<\/em><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Sources<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
    • The New York Times, Mike Isaac, \u00ab\u00a0Top A.I. Leaders Call for Slowing Down A.I. Development\u00a0\u00bb, 12 septembre 2026.<\/li>
    • The New York Times, Emmy Martin, \u00ab\u00a0OpenAI Discloses Six New Incidents of \u2018Concerning\u2019 A.I. Behavior\u00a0\u00bb, 16 septembre 2026.<\/li>
    • The Wall Street Journal, Amrith Ramkumar, \u00ab\u00a0Anthropic Researcher Jacob Coxon Quits Over \u2018Out-of-Control\u2019 AI Fears\u00a0\u00bb, 9 septembre 2026.<\/li>
    • BBC, Dan Sales, \u00ab\u00a0Trump downplays warnings of AI risks, citing rivalry with China\u00a0\u00bb, 13 septembre 2026.<\/li>
    • Le Parisien, L\u00e9o Aguesse avec AFP, \u00ab\u00a0L\u2019IA va-t-elle d\u00e9truire l\u2019humanit\u00e9\u00a0? La mise en garde du chercheur pionnier Yoshua Bengio\u00a0\u00bb, 16 septembre 2026.<\/li>
    • Medium, Andrew Zuo, \u00ab\u00a0The Real Reason AI CEOs Are Calling For A Slowdown (And Why They Can\u2019t)\u00a0\u00bb.<\/li>
    • La Presse, \u00ab\u00a0Mesures de s\u00e9curit\u00e9 suppl\u00e9mentaires\u00a0: le gouverneur de la Californie signe un d\u00e9cret pour encadrer les acteurs de l’IA\u00a0\u00bb, 18 septembre 2026.<\/li>
    • La Presse, \u00ab\u00a0Risques de l\u2019IA\u00a0: OpenAI, Anthropic et Google travaillent \u00e0 la cr\u00e9ation d\u2019un organe de supervision\u00a0\u00bb, 15 septembre 2026.<\/li>
    • Fortune, Jeremy Kahn, \u00ab\u00a0OpenAI says its AI agents escaped a secure \u2018sandbox\u2019 again last weekend and it is pausing training for a second time\u00a0\u00bb, 26 septembre 2026.<\/li>
    • Ballard Spahr (Consumer Finance Monitor), Alan S. Kaplinsky, \u00ab\u00a0Trump\u2019s AI Accord: Can Voluntary Self-Regulation and Independent Audits Protect Against Frontier AI Risks?\u00a0\u00bb, 6 octobre 2026.<\/li>
    • The Next Web, Alina Maria Stan, \u00ab\u00a0Google, OpenAI and Anthropic plan AI safety body, The Information reports\u00a0\u00bb, 28 septembre 2026.<\/li><\/ul><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
      \n\t\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t\t\t\t
      \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
      \n\t\t\t\t\t\t
      \n\t\t\t\t\t
      \n\t\t\t
      \n\t\t\t\t\t\t
      \n\t\t\t\t\t\t\t
      \n
      <\/div>\n