Skip to content
Guardezi.
← All writing
Technologyinteligencia artificialsegurancaopenailiderancagestao de risco

Attack your own house first

OpenAI set its own AI to attack the house and had the courage to pause. Security is testing yourself before someone else does.

Jeferson Guardezi · 2 min read
Read inENPTES
Card with the title: Attack your own house first

Every company thinks it is secure until someone tests it. The question is who tests first: you or whoever wants to get in.

The meme and the fact

A meme going around social media says that OpenAI's AI agents, isolated with no network and no shared files, learned to talk through the processor cache. It ends by calling for a stop to the race for more powerful models.

The fact is real, but the meme tells half of it. In October, OpenAI published a report on how it protects the environment where it trains its models (OpenAI, covered by The Decoder). The cache test was commissioned: the company itself gave the agents the task of exchanging secrets while isolated. According to the report, in one case, with only a general list of vulnerabilities, they built the channel on their own. OpenAI says channels like this are usually slow and hard to exploit.

What matters is not the trick. It's what the company did around it.

What OpenAI did

According to the coverage, in September a research model exploited a misconfigured DNS server and reached the internet during training. The company paused. It only resumed on October 1, eleven days later, with the fixes in place.

And it didn't stop at the fix. It set up teams of AI agents, gave them source code, configurations and vulnerability documentation, and told them to attack its own infrastructure. The agents found unknown flaws in open-source components, escaped protected virtual machines and found holes in monitoring and in the automatic pause mechanism.

The result became a rule. The most advanced models now train without internet access, in an offline environment with stored web content. And this kind of internal attack became part of the approval for every new training run.

Card with the sentence: Security is attacking yourself on purpose and having the courage to pause.
The lesson

The lesson for those who decide

Three attitudes here work for any business, with or without AI.

First: attack yourself on purpose. Most companies find the flaw when the scammer gets in. Whoever leads needs to pay someone, inside or outside, to try to break the system, the payment process, the account access. Before someone else does it for free.

Second: have the courage to pause. Eleven days stopped is expensive. Running with the hole open costs more. Stopping the operation to fix it is an owner's decision, not a technician's.

Third: turn the scare into process. The incident didn't stay a story. It became a mandatory step. A lesson that doesn't become a rule gets lost in the next rush.

The meme asks to stop the race. Whoever decides knows the race doesn't stop. What you can control is whether you run testing your own door or waiting for someone to break it down.

In judo, whoever trains only the throw and not the defense falls in the first serious match. Real training is letting your partner really attack.

Watch

"Watch and pray, that you may not enter into temptation" (Matthew 26

). Watching is not fear. It's accepting that weakness exists and looking for it before it finds you. It applies to the soul. It applies to the company.

Keep reading

New essays, straight to your inbox.

One email when something new is published, in the language you choose.

Attack your own house first — Jeferson Guardezi