Why are there concerns AI could threaten humanity, and how real are they?
Source Entity
BBC News

Experts and UK lawmakers are raising alarms over the rapid, uncontrolled advancement of AI and its potential to threaten human rights and safety. Calls for a statutory independent regulatory body are growing as researchers warn that current development speeds may outpace human control.
The Dual Crisis of AI: Existential Risk and Human Rights
Recent discourse surrounding Artificial Intelligence (AI) has reached a critical juncture, characterized by two distinct but intersecting alarm bells: the fear of existential catastrophe and the immediate, documented erosion of human rights. As AI systems evolve with unprecedented speed, both researchers within the industry and legislative bodies in the United Kingdom are signaling that the current trajectory of development is increasingly difficult to manage, if not outright dangerous.
The Existential Debate
At the heart of the existential debate are researchers like Evan Hubinger, who have quantified their concerns with alarming statistics, suggesting a non-trivial probability that AI could pose an ultimate threat to humanity within a decade. This discourse centers on the field of "alignment," which seeks to bake human ethical principles into machine learning models. However, the resignation of staff from organizations like Anthropic—citing a loss of control over the technology—underscores the friction between rapid innovation and the slow, deliberate process of ensuring safety.
Documented Human Rights Abuses
A more immediate concern is highlighted by the UK’s Joint Committee on Human Rights (JCHR). Their recent report shifts the focus from theoretical future risks to current, concrete abuses. The committee has identified that AI is already being weaponized to generate sexualized deepfakes of women and children and to conduct non-consensual biometric surveillance. These are not future hypothetical scenarios but present-day violations that the current, fragmented legal landscape is ill-equipped to address.
The Need for a Regulatory Framework
The JCHR’s call for a "single, independent AI oversight body" on a statutory basis reflects a growing consensus that self-regulation is insufficient. By advocating for an AI Bill that classifies risk levels and mandates obligations across the entire supply chain, the committee is pushing for a shift from voluntary guidelines to legally enforceable standards. This approach seeks to close the gaps in protection that currently leave citizens vulnerable to everything from discriminatory workplace disciplinary actions to privacy-invasive face-scanning.
Global Coordination and Future Trends
The urgency expressed by British lawmakers aligns with broader industry movements. Leading companies such as Anthropic, OpenAI, and Google DeepMind have signaled support for a more coordinated, potentially slower approach to development. This suggests a burgeoning realization that the "race to the bottom" regarding safety standards is unsustainable. Future trends will likely see a push for global treaties or international regulatory standards that mirror the JCHR’s proposals, aiming to balance the immense potential of AI with the non-negotiable requirement of protecting human rights.
Conclusion
The convergence of existential anxiety among developers and the pragmatic legislative demands for human rights protections marks a significant shift in the AI narrative. Whether this leads to robust, statutory oversight or remains caught in the inertia of current fragmented policies will likely define the next decade of digital governance. The message from both the lab and the legislature is clear: the current lack of guardrails is an untenable risk to both individual dignity and global stability.