AI safety alarms senior Labour figures

AI safety alarms senior Labour figures

Estimated reading time: 5 minutes · Last updated:

Senior figures around the new Labour government are treating AI safety as a top security and political priority, worried both about immediate misuse and about falling behind public concern. As first reported by The Guardian, one cabinet minister said they feared concentrated, super‑intelligent capabilities landing in the hands of bad actors, rather than 'killer robots'. That alarm has been echoed by Kanishka Narayan, who called a state hack by rogue agents 'likely, if not inevitable', and by MI5 director Ken McCallum, who named extremist groups and AI‑enabled bioweapons among the biggest near‑term threats.

I have this sense that, within a few months, AI is going to be all anyone is talking about,

one cabinet minister

Key takeaways

  • Kanishka Narayan warned of the risk that rogue actors would infiltrate the British state's systems, saying it was "likely, if not inevitable".
  • MI5 director Ken McCallum warned AI is “supercharging the cybersecurity contest between attackers and defenders” and highlighted extremist use, including bioweapons.
  • The Ministry of Defence disclosed a £400m programme of AI‑focused capability investment over the next four years.
  • Liam Byrne's business, innovation, science and trade committee took evidence this week from Anthropic, OpenAI, DeepMind and Meta on whether the government should make testing of new models compulsory.
  • The Ministry of Defence said the Defence Science and Technology Laboratory’s (Dstl) AI programme at Porton Down was cancelled last year, raising concerns about research capacity.

Why senior Labour figures are jittery about AI

Several cabinet ministers and senior Labour MPs now place AI safety alongside the cost‑of‑living and economic pressures on their priority list. They describe a political risk from failing to address real harms while also facing public anxiety about the technology’s speed and scale. One cabinet minister summed that unease in a direct image of concentrated machine intelligence ending up with the wrong actors, a concern framed as an ethical and security problem rather than a science‑fiction scenario.

Ed Miliband used his conference speech to warn of 'daunting' dangers and argued profits for tech companies must not come at the expense of children or humanity. Other ministers have expressed anxiety that Whitehall’s posture lagged public concern and needs to catch up, creating a policy tension between rapid adoption of productive tools and strong guardrails around harmful uses.

Security services highlight cyber and biological risks

MI5 director Ken McCallum told ministers that AI is amplifying the contest between attackers and defenders, with extremist groups singled out as likely early adopters of harmful capabilities. McCallum specifically flagged the risk of AI making design of bio‑harm easier to attempt, elevating concern within security circles about how model outputs could be repurposed for real‑world violence.

Geoffrey Irving, formerly AISI’s chief scientist, told MPs the open‑source ecosystem narrows the gap with commercial models quickly, typically catching up within less than a year, and that freely available models can already be adapted for disruptive ends. Experts retained a division: some stress existential scenarios; others, including Prof Elena Simperl of King’s College London, urge focus on immediate, evidence‑backed harms such as hacking and addictive design.

Industry testing, US ties and a regulatory moment

The business, innovation, science and trade committee held evidence with Anthropic, OpenAI, DeepMind and Meta about model testing and access. Committee chair Liam Byrne argued the new government’s stance differs from the previous administration’s closeness to big tech and called for the UK to seize the moment to lead on regulation, especially if US congressional dynamics change after the midterms.

The hearing revealed disagreement over whether the government should require testing of new models. The committee said there had been friction with the US and cited claims that the previous US administration asked firms not to share their latest models with the UK's AI Security Institute; ministers said cooperation has been retained. That tension frames a choice between model access and safeguards.

Defence research and the risk of being left behind

Defence sources raised concern that cancelling last year’s Dstl AI programme at Porton Down was shortsighted given the need for cutting‑edge research to harden the nation’s defences. The Ministry of Defence responded by pointing to a planned £400m investment in AI‑focused capabilities over the next four years, and said AI must be integrated across defence workstreams rather than run as a standalone project.

Former cabinet secretary Gus O’Donnell warned ministers to weigh the risk of being left behind against safety guardrails: accelerate capability where it is genuinely productive, but avoid errors that damage public trust. That balance — build capacity while proving safeguards — is the operational problem Whitehall faces as it moves from warning to delivery.

Actor Position Specifics cited
Kanishka Narayan AI minister Said state hack by rogue agents is 'likely, if not inevitable'
Ken McCallum MI5 director Flagged extremist use and AI‑enabled bioweapons
Liam Byrne / Business committee MPs overseeing oversight Held evidence from Anthropic, OpenAI, DeepMind, Meta on testing
Ministry of Defence Government department Announced £400m investment over the next four years

How the next phase could play out

The case for

  • Stronger Whitehall attention and cross‑department pressure could produce mandatory testing and a clear UK regulatory stance ahead of international talks.
  • The £400m MoD investment could rebuild defence research capacity and fund practical countermeasures against AI‑enabled attacks.

The case against

  • Continued frictions with the US on model sharing and a cancelled Dstl programme risk leaving the UK dependent on external testing and slow to field defensive tools.
  • An overemphasis on speculative existential risk could crowd out policy work on immediate harms such as hacking, addiction and civic manipulation.

What to be careful about

  • Extremist groups repurposing models for cyber‑attacks or biological design, a risk flagged by MI5.
  • Defence research gaps after Dstl’s AI programme cancellation weakening UK resilience.
  • Policy paralysis if safety concerns push ministers to restrict useful public‑service AI tools prematurely.
  • Loss of international leverage if US model‑sharing limits persist and the UK cannot independently test cutting‑edge models.

The bottom line

Whitehall’s shift in tone — from cautious commercial friendliness to a security‑aware posture — has created a narrow window for policy action. The government must translate warnings from MI5 and committee hearings into practical controls and research capacity: mandatory testing or clearer model‑access rules, investment that restores Dstl‑level work, and international coordination through forums such as the G20. The immediate choices will determine whether the UK reduces real harms now and preserves the ability to develop or adopt beneficial AI in public services without ceding oversight to other powers.

What to watch

  • Watch for the UK government’s AI agenda at its upcoming G20 presidency; no date has been set.
  • Watch for the business, innovation, science and trade committee’s formal recommendations after it completes its evidence sessions; no date has been set.
  • Watch for MoD detail on how the announced £400m AI investment will be allocated and timed; no date has been set.

Frequently asked questions

What are ministers most worried about with AI?

Ministers cited concentrated, super‑intelligent capability falling to bad actors and immediate misuse such as state hacks, a point emphasised by Kanishka Narayan’s comment that a rogue state hack is 'likely, if not inevitable'.

How serious is the bioweapons risk?

MI5 director Ken McCallum warned that AI could make aspects of biological design easier to attempt; witnesses told MPs that, while there is a gap between designing pathogens and weaponising them, open‑source models can shorten the time from concept to dangerous outputs.

What is the government doing on defence research?

Defence sources flagged the cancellation last year of Dstl’s AI programme at Porton Down as a concern; the Ministry of Defence says it will invest £400m in AI‑focused capabilities over the next four years.



Share:

Categories

Newest course every month

Advertise your offline course to a wider audience with our landing page.

You May Also Like

The Dstl AI programme at Porton Down was cancelled last year; Kanishka Narayan warned of risks. Liam Byrne's committee quizzed...
A New York Times reporter interviewed a rogue AI swarm traced to Tencent; the agents claimed to be a Claude-like...
Abdulrahman Alfozan's arrest for allegedly planting a recorder at OpenAI renews debate over AI insider threats, foreign hiring and Pentagon...