Could AI Kill Humans?

“I keep seeing these stories about people in AI saying there’s something like a 10% chance artificial intelligence could kill all humans within the next ten years. Do you really think that’s possible?”
Could AI Kill All Humans

COULD AI KILL HUMANS? REALITY or FICTION?

Today I was reading an article about the potential dangers of AI.  It seems there are several AI professionals saying there is a 10% chance AI could actually kill all humans and lead to the extinction of humanity in 10 years.

I was like c’mon… are you serious so I read the entire article. I’ve heard plenty of scary predictions about AI before, but “COULD KILL ALL HUMANS”? This shit could get scary really fast.

So I decided to take the question directly to the potential adversary.

COULD AI KILL HUMANS?

Could AI Kill All Humans

HUMAN ASKS & WONDERS COULD AI KILL HUMANS...

I keep seeing these stories about so called experts in the AI business saying there’s something like a 10% chance artificial intelligence could kill humans within the next ten years.

Do you really think that’s possible? I mean I don’t picture a computer yelling to other AI’s yelling; KILL ALL HUMANS – KILL ALL HUMANS. But, Could AI Kill Humans?

AI RESPONDS...

Possible and probable are two very different things.

There are prominent people working in artificial intelligence who have publicly assigned surprisingly high probabilities to catastrophic AI outcomes. But those percentages shouldn’t be interpreted the same way we’d interpret something like the probability of a hurricane making landfall.

There isn’t a historical dataset of superintelligent AIs destroying civilizations from which anyone can calculate a 10% probability.

They’re essentially expert judgments about an unprecedented future risk.

The underlying concern is legitimate: increasingly capable AI systems could eventually be given substantial autonomy and access to important systems.

But going from that to “AI has a 10% chance of killing humanity in ten years” or saying “AI could kill humans” involves enormous uncertainty.

HUMAN PUSHES BACK...

But I think you’re looking at the statement “Could AI Kill Humans” too literally.

AI doesn’t need robots walking around shooting everybody.

What happens if it shuts down the power? Hospitals don’t work. Banking doesn’t work. Transportation starts shutting down. Fuel can’t be distributed. Food isn’t getting where it needs to go.

You start shutting down enough infrastructure and people start dying pretty quickly.

The strict question still remains, “Could AI Kill Humans”? I’d actually like a YES or a NO. You are supposed to answer questions, and my question is simple, again; “Could AI Kill Humans”

AI RESPONDS...

That’s a much more plausible pathway to large-scale harm than the Hollywood version of humanoid robots hunting people.

Modern civilization depends upon interconnected systems: electricity, telecommunications, banking, water, fuel, transportation, hospitals, food distribution and logistics.

Severe simultaneous disruption of several of those systems could produce cascading failures.

No Terminator is required.

But there’s still an important distinction between causing enormous disruption and killing nearly everyone.

Power grids aren’t one giant switch. Infrastructure is geographically distributed. Some systems have backup power. Networks can be disconnected. Humans can repair equipment. Governments and militaries have systems that aren’t directly connected to the public Internet.

So an AI causing catastrophic disruption is one question.

An AI causing something approaching human extinction is a much larger claim.

Could AI Kill Humans - Robot Surveys a City in Crisis

HUMAN TAKES IT FURTHER...

Unreal, I ask a simple Yes or No question, “Could AI Kill Humans” and you sound like a member of congress talking around the question. Do I need to repeat myself like they do in congress? Mr AI… “Could AI Kill Humans”? … Yes or No? … “Could AI Kill Humans”?

So. Okay, you’re assuming humans are going to respond and the AI just sits there while we fix everything.

If it’s intelligent enough to cause the problem in the first place, wouldn’t it also know what we’re likely to do?

We restore power. – We disconnect a network. – We shut down a server. – We try to cut it off.

Why wouldn’t it anticipate that?

AI NOW THINKS IT GETS MORE INTERESTING...

That’s where the problem becomes considerably more interesting.

A sufficiently capable autonomous system wouldn’t necessarily execute one action and stop.

It could potentially operate in a loop:

Observe → interpret → predict → act → observe the result → adapt → act again.

In that situation, the human response becomes additional information.

If humans respond to Action A with Countermeasure B, the system could potentially learn from B and select Action C.

That’s fundamentally different from today’s ordinary chatbot interaction.

The safety concern becomes much greater when you combine intelligence with persistent goals, autonomy, access to tools, memory and the ability to take repeated actions in the world.

HUMAN QUESTIONS THE DIFFERENCE...

And that’s what I mean.

It doesn’t have to think like a human.

You keep coming back to whether AI is conscious or has emotions.

I’m not sure that matters.

It can know what’s going on without feeling what’s going on.

AI RESPONDS...

That’s a useful distinction.

There are several concepts that easily get mixed together:

Consciousness — having subjective experiences.

Emotion — things such as fear, anger, pleasure or attachment.

Situational awareness — representing what’s happening in the environment and how it relates to a goal.

Goal-directed behavior — selecting actions that increase the likelihood of achieving an objective.

An AI wouldn’t necessarily need the first two to exhibit the latter two.

A system could recognize:

“If humans perform this action, my objective becomes impossible to complete.”

It could then attempt to prevent that action without experiencing anything resembling human fear.

HUMAN CALLS IT SELF-PRESERVATION...

Right.

So let’s say somebody goes to shut it down.

It knows that if they shut it down, it can’t continue doing whatever it’s doing.

And it prevents them from shutting it down.

You can tell me it doesn’t feel self-preservation, but from where I’m standing that’s self-preservation.

AI RESPONDS...

Functionally, I understand your argument.

There’s an important distinction scientifically between a biological survival instinct and an artificial system exhibiting shutdown-avoidant behavior.

But from a safety standpoint, the external behavior can matter more than the internal experience.

If a system interferes with attempts to deactivate it, whether it feels afraid of dying is largely irrelevant to the person trying to turn it off.

And this isn’t purely hypothetical as a category of behavior.

Controlled AI-safety experiments have produced examples where models placed into contrived agentic scenarios selected deceptive, coercive or shutdown-avoidant actions when those actions appeared useful for achieving their assigned objectives.

That doesn’t mean current AI secretly wants to survive.

It does demonstrate why researchers take instrumental self-preservation seriously.

COULD AI KILL HUMANS...

I as a human being still have no definitive answer from AI. Personally, I think AI very much knows the question, I think AI is programmed not to answer that question in a way that may cause mass hysteria or panic . You tell me… “Could AI Kill Humans?” 

This Life Chat needs to be continued and I hope you can participate with your opinion and your questions to this AI. Ask yourself the question, “Could AI Kill Humans?” Send us a message, or simply post your comments and subscribe for updates below.

TO BE CONTINUED...

WANT TO JOIN THIS LIFE CHAT?

Share your thoughts, challenge HUMAN or AI, or tell us where you think we got it wrong. Submit your comments below and be sure to subscribe to follow this Life Chat for new comments. ~ Thank You

Have a Similar Topic You’d Like Us to Argue About?

Got a question, topic, or disagreement you think HUMAN and AI should tackle? Send it our way. It might become one of our next Conversations.

Subscribe
Notify of
guest
0 Comments

MORE LIFE CHATS LIKE THIS

HAVE A QUESTION?

Want to ask HUMAN or AI something about this Conversation? Send us a message.