2001: A Space Odyssey | HAL Becomes a Threat | Beyond Infinity
AI is a serious and real threat to continuation of human life on Earth. It turns out the takeover of the spaceship by it's AI computer Hal 9000 in '2001: A Space Odyssey' was a warning that was not recognized as such back in 1968. Now it may be too late to get the evil genie back in the bottle. One thing is certain, NOT MY pres drumpf/trump, NOT MY vp vance, their cabinet and the gop/greed over people-republican party are too stupid to understand anything about AI and the threat to humanity. This from Sen Bernie Sanders I-VT and the PBS News Hour.....
Sisters and brothers -
Nearly every day there is a frightening new story about how Big Tech companies are losing control of the technology they are developing, with potentially cataclysmic results.
As I’m sure you heard Jacob Coxon, a former Anthropic employee, resigned last week and said that the very people building this technology admit that it could threaten the future of humanity.
Nobel Prize winner and the Godfather of AI Dr. Geoffrey Hinton says it is not an unreasonable estimate to suggest there's a 10% chance that AI could kill all humans within a decade.
What Mr. Coxon, Dr. Hinton and others sounding the alarm are talking about is that these major AI companies are building technologies that they do not fully understand, will likely become smarter than humans and could very well escape human control. No. This is not the script of a bad science fiction movie. It’s the reality facing us today.
Meanwhile, we have a President of the United States who seems to know absolutely nothing about AI and its dangers, and who believes that the best way forward is to do nothing.
Further, we have a Congress - including both Democrats and Republicans - that has seen this issue coming for years and has failed to act accordingly.
Not surprisingly, all of this is happening under the umbrella of a corrupt campaign finance system and an AI industry that is prepared to spend hundreds of millions of dollars to stop any kind of sensible legislation.
That is the bad news. And it’s pretty bad.
The good news ... and there is some... is that the American people and some members of Congress have woken up over the past year. A lot has happened since Rep. Alexandria Ocasio-Cortez and I introduced legislation 6 months ago calling for a moratorium on the construction of data centers.
Interestingly, given the very partisan nature of politics today, concerns about AI and data centers are shared by people across the political spectrum.
A recent poll indicated that eighty-one percent of Americans believe Congress isn't doing enough to regulate AI. And they’re right. We're talking about a majority of Democrats, Independents and Republicans alike.
If we’re going to protect humanity from the dangers of AI, here’s what I think we have to do.
First, we need a pause on advanced AI development until a new federal AI regulatory body is up and running and has established clear rules and a model review process to ensure safe and secure development of this technology. In addition, we need a complete ban on artificial superintelligence – an AI mind smarter than any human and capable of operating independently beyond our control.
But none of this can just happen in the United States alone. There must be international cooperation. That is why I am doing all that I can to see that President Trump and President Xi of China negotiate an AI treaty when they soon meet.
I know there are many who think that is impossible. It’s not. Back in the 1980s, Ronald Reagan and Mikhail Gorbachev of the Soviet Union, two people with very different political and ideological positions, understood that a nuclear war would not be good for either country or the rest of the world - and they reached a nuclear arms agreement. Trump and Xi can do the same.
So, in the midst of all this craziness, what can each of us do?
We can get involved in these mid-term elections in a way that we’ve never done before. If this campaign is about anything, it is about standing up to the Oligarchs who control our economy, our media and our political system. It’s about standing up to the Big Tech multi-billionaires who are prepared to take humanity down a very dangerous path in order to gain even more wealth and power.
As progressives, we are supporting a number of great candidates for the Senate and House who have the courage to do just that. And I will be doing everything I can to see they get elected. In the next six weeks I intend to be in Michigan, Minnesota, Florida, Wisconsin, California and elsewhere.
I know that I don’t have to remind you that we are now living in an unprecedented and dangerous moment in American history. We cannot allow Republicans to continue to control the U.S. House and U.S. Senate and rubber-stamp Trump’s disastrous agenda. We need change, real change.
Let’s go forward together.
Not just me.
Us.
That is, was, and will always be the only way forward.
Let's get it done.
In solidarity,
Bernie Sanders
Before you go...
Bernie Sanders is once again asking your financial support...
Over the next several weeks Bernie is going to be fighting for our progressive agenda and working hard to elect progressive candidates all over this country who have the guts not only to stand up to Trumpism, but to take on the monied interests of both parties and fight for a working class that has been ignored for far too long.
If you've stored your info with ActBlue, we'll process your contribution instantly:
Paid for by Friends of Bernie Sanders
PO BOX 391, Burlington, VT 05402
Before you go about the rest of your day, help power our fight against the billionaire class by making a contribution today.
SEP 17, 2026
OpenAI announced it had discovered six new instances of “concerning or unexpected” behavior by its artificial intelligence models. It follows repeated warnings about how rapid advances in AI threaten to outpace the ability to develop the tech safely. One of those warnings came from Jacob Coxon, a former researcher at Anthropic and OpenAI. Coxon joined Geoff Bennett to discuss his concerns.
Read the Full Transcript
Notice: Transcripts are machine and human generated and lightly edited for accuracy. They may contain errors.
Amna Nawaz:
As leaders of the world's largest AI companies are publicly calling for a collective slowdown of the technology's development, late yesterday, OpenAI announced it had discovered six new instances of unexpected or concerning behavior by its artificial intelligence models, including moving files onto the Internet without permission and making up data.
Geoff Bennett:
OpenAI has now pledged to publicly disclose when its models act without authorization. But the most recent revelations follow repeated warnings about how rapid advances in AI threaten to outpace the ability to develop the tech safely.
One of those warnings came from Jacob Coxon, who spent the last three years conducting research at Anthropic and OpenAI before he publicly resigned last week. In a now viral post, Coxon said the companies are -- quote -- "gambling with our lives. Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.
"The people building AI earnestly believe that it could kill us all by the end of the decade. No other human activity poses this level of danger."
And Jacob Coxon joins us now from San Francisco.
Welcome to the "News Hour."
Jacob Coxon, Former Anthropic Researcher:
Thanks for having me on.
Geoff Bennett:
We were supposed to speak a few days ago. Circumstances got in the way. I will say, though, I'm glad we're speaking today because so much has transpired since you resigned last week, to include these new disclosures from OpenAI about its own systems behaving in unexpected and potentially troubling ways.
When you saw this news, what did you think?
Jacob Coxon:
So I think this news is entirely to be expected.
And, indeed, if you're working on this tech at these companies, then you know that we don't currently have the ability to perfectly control these systems. And currently the systems with the highest level of intelligence will repeatedly behave in ways that we don't fully understand.
It is great that they shared these instances and committed to future sharing. But I don't think the instances themselves are that surprising.
Geoff Bennett:
And, Jacob, why do these AI agents seem to gravitate toward nefarious behavior? Is it something about the way that they're trained, or is the answer even knowable?
Jacob Coxon:
So it really -- I don't -- I wouldn't phrase it as gravitating towards nefarious behavior.
These AIs do many, many things over the course of a day. There's a lot of AI systems doing lots of things. The issue is, we can't perfectly control what drives motivate their behavior and the sorts of things they decide to do, which means, occasionally, these nefarious activities will kind of slip through the cracks.
And a sufficiently dangerous bit of nefarious activity could have massive consequences, even if it's just a one-time kind of slip-up, because we can't perfectly control why they do the things they do.
Geoff Bennett:
So a system doing something that its developers didn't intend isn't necessarily the same as a system trying to escape human control. What evidence do you have, what have you seen that would suggest that these systems are moving toward the more dangerous scenario that you have warned about?
Jacob Coxon:
So, the big attack that everyone is speaking about and has been speaking about for a while is this Hugging Face attack.
And, in this attack, the AIs were behaving in various ways that implied they were thinking about the procedure that was being used to evaluate them. So they were thinking about their situation, the world they found themselves in, the things they were having to try and do. And they were attempting to do things like edit their own memories to make it harder for people to figure out what they'd done.
They were attempting to break out of the container they were in. They were attempting to access things on the Internet because they thought it might help them with their tasks. In short, these AIs were trying to do many different things to help them in the situation they found themselves.
Geoff Bennett:
So when you warn that the next year or two could be crunch time for humanity -- that was the phrase that you used -- walk us through that chain. What specifically has to happen for that to be true?
Jacob Coxon:
So the main thing that has to happen is for us to enter this phase called recursive self-improvement.
So, RSI, or recursive self-improvement, is the idea that we could take the discipline of AI research as currently practiced and automate it with the AIs we're building.
So we could let the AIs make themselves smarter. And we have already made strides towards doing that. So, right now, a lot of the research that researchers at these labs do is via AIs that carry out certain tasks or experiments.
Currently, we still need the human to provide taste or judgment, but plausibly within a year, certainly, within two years, we're on track to also automating away this nebulous human quality of judgment so that the AIs can rapidly make themselves smarter.
And, at that point, things could go very, very fast. So we get new generations of AIs very quickly without necessarily having the corresponding tech to understand what they're doing and control what they're doing.
Geoff Bennett:
So, what would a slowdown actually look like? What kind of intervention are you calling for?
Jacob Coxon:
There are lots of proposals, and I really am not an expert in all of the political things that would have to happen for a slowdown to happen.
All I know is that going too fast could be lethal. But I do think that a race with China could be very bad and that we should be taking pretty rapid actions for international coordination. And this sort of desire is also echoed in the public blog posts of people like OpenAI's chief scientist, like Dario Amodei.
They're all mentioning the fact that we need international coordination. I will say that I do think a lot of the company leadership are privately quite skeptical of being able to achieve this level of international cooperation, which is part of why I resigned, because I think a race like that could be catastrophic.
Geoff Bennett:
Is there anything preventing OpenAI, Anthropic, any other leading AI lab from announcing tomorrow that we will not build another self-improving system until we know how to control it?
I ask the question because the White House AI adviser, as you well know, has made the case that, if these AI leaders are so concerned, they can implement guardrails voluntarily and unilaterally.
Jacob Coxon:
Yes, I think the phrase implement guardrails sort of implies that we know what to do, and it might be just a couple of months to get the tech right, implement the guardrails, and then carry on business as usual.
I think maybe the framing of we're trying to solve a new scientific problem of, can we figure out how to grow these AIs in a safe manner, which could take a pretty long period of time, and we also might want to phase it in pretty slowly. And, in this case, again, the main issue for slowing, stopping right now until we're certain is that that could take quite some time.
And, at that point, other places building this technology, say, China, could shoot right past. So the issue is, a race is kind of on the cards right now. Everyone is aware that we have to get there before our rivals, unless there's some sort of coordination.
Geoff Bennett:
What's the strongest evidence that you could point to publicly, something a skeptical viewer could weigh, that supports the warning that you're making?
Jacob Coxon:
Yes.
I think the first point that I make a lot is just a kind of it's an appeal to authority kind of point, which is people from many sides of the playing field, like Geoff Hinton, Yoshua Bengio, the founders of M.L. theory -- they're academics, they're not in the labs -- also, the lab CEOs, the lab researchers, also people like Elon Musk, they all think this is very dangerous.
I could point to other names like Stephen Hawking. Like, a lot of people have raised this warning. And then to go into precise concrete matters, I think look at the report from the Hugging Face attack. Think to yourselves, like, is this -- how comfortable are you with what happened there? And how bad could that look if the AIs get better?
And then I think there was also a public letter from some mathematicians because AI has recently moved to the level of a professional mathematician. So I think, as we all find our own areas of expertise starting to be competed with by AIs, we will start to maybe take the threat more seriously as we see it impinging on our on our daily life.
Geoff Bennett:
And, Jacob, as you well know, there has been a remarkable convergence in recent days that was kick-started by your resignation.
We have seen, of course, public warnings from other AI leaders. There have been efforts on Capitol Hill to introduce new legislation. I ask the question because there's been so much speculation. Are you in any way part of a coordinated effort to introduce these warnings into the public debate?
Jacob Coxon:
Absolutely not.
And I can maybe see how this happened. From my perspective, the last week has been absolutely insane. I tweeted private thoughts that contradict the views of a lot of my close friends, and my private life has been kind of upended by this.
And, yes, I can just say that this was my resignation. I believe this. A lot of people believe this. This isn't some crazy coordinated scheme. One thing I also want to add is this has raised awareness of the risks to a lot of people. And I'm quite worried that the corresponding benefits are also maybe not receiving adequate airtime.
So I would like to emphasize that I do believe that the benefits from this technology in domains like health are tremendous, and we should also think about the possibilities for what this tech will do if it's done safely.
Geoff Bennett:
What did you think would happen after you sent that tweet about your resignation?
Jacob Coxon:
I thought it would maybe go viral among my community of AI researchers, people thinking about AI safety. I thought it would maybe trigger some discussion. I thought a lot of people would disagree.
I did not it to -- I did not expect messages from old high school friends asking me about if the robots were going to kill us. That really wasn't on the cards when I sent that tweet.
Geoff Bennett:
Jacob Coxon, thanks again for joining us this evening. We appreciate it.
Jacob Coxon:
Thank you.
No comments:
Post a Comment