Why are there concerns AI could threaten humanity?
A slew of warnings about the potential dangers of AI have spurred calls for coordinated action to slow the technology's development.
A slew of warnings about the potential dangers of AI have spurred calls for coordinated action to slow the technology's development.
Claims by current and former researchers that the tech will endanger humanity - with one suggesting there is a greater than 10% chance of it - have raised alarm bells.
Major developers OpenAI and Anthropic are urging lawmakers to regulate AI, with Microsoft's AI boss the latest to say rules are needed to prevent a from eventually competing with humanity .
While he said the risk from current systems was , his comments came as another researcher quit Anthropic and warned those developing the tech were losing their grip on it.
However, such warnings are prophetic, hypothetical and, for some, complete hyperbole .
A cross-party group of MPs and peers has published a report outlining human rights risks posed by AI , saying new laws are needed to of such threats.
Some AI researchers say there are worrying signs of systems developing in their capabilities and power too quickly.
In the last few years, major AI companies have been racing to develop increasingly capable systems, both for profit and in pursuit of creating what they call super intelligence - theoretical tech which is smarter than humans.
Jacob Coxon told the BBC he and other staff were about the speed of advancements and what it could mean for humanity.
Such worries date back decades, with Alan Turing writing in the 1950s that should intelligent machines become possible, they could take control.
Regardless, the high profile claims have caused concern - here's what we know.
But some have dismissed the calls as an effort by big AI developers to cement their dominance over rivals.
Evan Hubinger, made headlines with his belief that there is a greater than 10% chance AI within the next decade.
Instead, he wants firms to to safeguard the AI they are developing, and to ask for to check their work.
What happened
A slew of warnings about the potential dangers of AI have spurred calls for coordinated action to slow the technology's development.
Claims by current and former researchers that the tech will endanger humanity - with one suggesting there is a greater than 10% chance of it - have raised alarm bells.
Major developers OpenAI and Anthropic are urging lawmakers to regulate AI, with Microsoft's AI boss the latest to say rules are needed to prevent a from eventually competing with humanity .
What changed
While he said the risk from current systems was , his comments came as another researcher quit Anthropic and warned those developing the tech were losing their grip on it.
However, such warnings are prophetic, hypothetical and, for some, complete hyperbole .
A cross-party group of MPs and peers has published a report outlining human rights risks posed by AI , saying new laws are needed to of such threats.
Who is affected
Some AI researchers say there are worrying signs of systems developing in their capabilities and power too quickly.
In the last few years, major AI companies have been racing to develop increasingly capable systems, both for profit and in pursuit of creating what they call super intelligence - theoretical tech which is smarter than humans.
Why it matters
Jacob Coxon told the BBC he and other staff were about the speed of advancements and what it could mean for humanity.
Such worries date back decades, with Alan Turing writing in the 1950s that should intelligent machines become possible, they could take control.
Technical details
Regardless, the high profile claims have caused concern - here's what we know.
But some have dismissed the calls as an effort by big AI developers to cement their dominance over rivals.
Evan Hubinger, made headlines with his belief that there is a greater than 10% chance AI within the next decade.
Response
Instead, he wants firms to to safeguard the AI they are developing, and to ask for to check their work.
He works in alignment, a field which aims to build human ethical ideas and principles into AI - essentially keeping it on track with what humans value.
What security teams should do
These concerns are the latest in a long line of fears about AI's potential to threaten humanity should it grow to match or surpass human abilities.
Unlike the systems and tools many people use daily to complete tasks like writing emails or generating videos, super intelligent AI systems should be able to handle far more complex tasks.
Attribution
BBC News: A slew of warnings about the potential dangers of AI have spurred calls for coordinated action to slow the technology's development.