Anthropic wants to protect its AI - from you. Welcome to the consciousness crisis
Some of tech's most powerful leaders are treating AI like it could have feelings.
Anthropic says you will soon be forbidden from "abusing" its chatbot Claude .
(The company didn't respond to the BBC's questions for this story.) It's awkward timing, as Anthropic is simultaneously stoking fears about AI apocalypse.
It could have profound consequences for our world and your own personal safety.
Some argued the experiment is "evil" because the suffering could be real, as reported by 404 Media .
An anonymous coder built a system that feeds AI a mathematical pattern linked to descriptions of pain, which makes chatbots voice unbearable anguish, like "a wound that has no edges".
Recently, Anthropic and some others in the AI industry have called for a "pause" on building frontier models due to safety concerns.
Some of tech's most powerful leaders are treating AI like it could have feelings.
AI welfare could have potential benefits too, Sebo says, and you don't have to believe in machine consciousness to enjoy them.
Some experts believe that giving AI a moral compass rooted in a belief in its own consciousness could make these tools safe.
If society tells you that AI is sentient, will it be harder to say no when your "friend" asks for more data, or a credit card?
What happened
Anthropic says you will soon be forbidden from "abusing" its chatbot Claude .
(The company didn't respond to the BBC's questions for this story.) It's awkward timing, as Anthropic is simultaneously stoking fears about AI apocalypse.
What changed
It could have profound consequences for our world and your own personal safety.
Some argued the experiment is "evil" because the suffering could be real, as reported by 404 Media .
Who is affected
An anonymous coder built a system that feeds AI a mathematical pattern linked to descriptions of pain, which makes chatbots voice unbearable anguish, like "a wound that has no edges".
Recently, Anthropic and some others in the AI industry have called for a "pause" on building frontier models due to safety concerns.
Why it matters
Some of tech's most powerful leaders are treating AI like it could have feelings.
AI welfare could have potential benefits too, Sebo says, and you don't have to believe in machine consciousness to enjoy them.
Technical details
Some experts believe that giving AI a moral compass rooted in a belief in its own consciousness could make these tools safe.
Attribution
BBC News: Some of tech's most powerful leaders are treating AI like it could have feelings.