Amid growing concerns about instances of AI agents behaving unpredictably, there is a rising call from experts and stakeholders for governmental oversight of increasingly advanced AI systems. However, some experts acknowledge the challenges posed by the need for global cooperation and the rapid evolution of AI technology.

While figures like U.S. President Donald Trump express confidence in tech giants’ ability to self-regulate, others such as Microsoft co-founder Bill Gates and Geoffrey Hinton emphasize the necessity of external safeguards for AI beyond industry self-regulation. Jaxson Khan, an AI policy expert at the University of Toronto, highlights the precedent of government regulation in various industries like food, aviation, and nuclear energy, suggesting a similar approach for AI.

The rapid pace of AI development presents a significant hurdle for regulatory efforts, as models continuously enhance their capabilities. A recent report by Anthropic indicates that AI agents double their abilities roughly every four months, with some models demonstrating recursive self-improvement capabilities. This velocity of technological advancement poses challenges for governmental adaptation and understanding, according to experts like Manon Paquet from McGill University.

Calls for global oversight and cooperation in AI regulation have been made by leaders like Prime Minister Mark Carney, with proposals for a non-industry body to manage international AI risks. The establishment of an international agency to supervise AI containment standards and incident reporting has been advocated by around 400 scientists, including Geoffrey Hinton and Yoshua Bengio, to foster collaboration among nations and prevent misuse of AI technology.

In Canada, the absence of comprehensive federal AI regulations is being addressed through initiatives like Bill C-34, the Safe Social Media Act, which sets criteria for AI chatbots to mitigate harmful content generation. Additionally, the creation of a national council on artificial intelligence aims to guide the government’s AI strategy and enhance technology safety. While challenges exist in enforcing federal legislation due to the global presence of major AI companies, policies can be implemented to ensure incident reporting and accountability, potentially leading to improved AI governance and citizen awareness.