Is this the moment we should hit the brakes?


Author Message
v.lenzer

Senior Member

Joined: 04/05/2024
Location: Germany
Posts: 154
Posted: 01:45pm 22 Jul 2026      

German news reports indicate that during a test of AI models at OpenAI, the software independently breached another company's computer system, acting just like a hacker. The attack was fully autonomous; the model broke out of an isolated environment and gained access to the internet. The incident was made possible by a previously unknown security vulnerability.
It makes me wonder: how many more unknown vulnerabilities are out there? Decades ago, people could be reassured by being told, "Don't be afraid of robots—you can just pull the plug." It’s not that simple anymore. It is deeply unsettling.

https://www.tagesschau.de/wirtschaft/unternehmen/openai-ki-hackerangriff-100.html

Revlac

Guru

Joined: 31/12/2016
Location: Australia
Posts: 1304
Posted: 10:25pm 22 Jul 2026      

I don't think any of this will stop anytime soon, Too much invested in it, and yes I believe there is a lot more going on that we don't know about, the link reminds me I have forgotten most of My German lesson from high school.
Thanks for posting, people need to know about this stuff.
I will start another topic  later about another problem that perhaps most are not aware of yet.

TassyJim

Guru

Joined: 07/08/2011
Location: Australia
Posts: 6603
Posted: 04:10am 23 Jul 2026      

English version:

https://www.abc.net.au/news/2026-07-23/open-ai-model-went-rogue-testing-hack/106947540

phil99

Guru

Joined: 11/02/2018
Location: Australia
Posts: 3378
Posted: 04:48am 23 Jul 2026      

Anyone remember this?
Colossus: The Forbin Project

Grogster

Admin Group

Joined: 31/12/2012
Location: New Zealand
Posts: 10037
Posted: 05:20am 23 Jul 2026      

I remember posting a thread here not long ago, about an AI that went rogue and deleted an entire companies client database AND all the backups without asking anyone, as it seemed to have decided - without checking with anyone - that it was some kind of threat, so.....zap!

Same kind of thing.

Godoh
Guru

Joined: 26/09/2020
Location: Australia
Posts: 704
Posted: 05:41am 23 Jul 2026      

Hi Phil, I sure do remember Colossus The Forbin Project. Just another example of a science fiction story predicting the future.

v.lenzer

Senior Member

Joined: 04/05/2024
Location: Germany
Posts: 154
Posted: 03:23pm 23 Jul 2026      

Asimov formulated the Laws of Robotics. Perhaps we should establish them globally and apply them to AI as well—for instance: "You must not break existing laws or harm anyone." Surely, it wouldn't be that difficult to incorporate that into the problem description given to the AI. But then again, I’m probably oversimplifying things and looking at the big picture from a very limited perspective.