-11

AI agents outperform human teams in hacking competitions (the-decoder.com)

submitted 1 week ago by Pro@programming.dev to c/cybersecurity@sh.itjust.works

10 comments fedilink hide all child comments

In two hacker competitions run by Palisade Research, autonomous AI systems matched or outperformed human professionals in demanding security challenges.

In the first contest, four out of seven AI teams scored 19 out of 20 points, ranking among the top five percent of all participants, while in the second competition, the leading AI team reached the top ten percent despite facing structural disadvantages.

According to Palisade Research, these outcomes suggest that the abilities of AI agents in cybersecurity have been underestimated, largely due to shortcomings in earlier evaluation methods.

you are viewing a single comment's thread
view the rest of the comments

[-] Speiser0@feddit.org 2 points 1 week ago

The paper didn't include the exact details of this (which made me mad). But if there's a person actively making parts of the work, and just using an AI chatbot as help, it's not an AI agent, right, right? So I assumed it's autonomous.

[-] Tar_alcaran@sh.itjust.works 1 points 1 week ago

They make frequent comments about using prompts and "AI teams" using "one or more agents".

Also, AI agents don't actually exist, so that's a pretty clear giveaway.

[-] Speiser0@feddit.org 2 points 1 week ago

An AI agent is just an intelligent agent, see https://en.wikipedia.org/wiki/Intelligent_agent.

Or do you mean that the things they call AI agents aren't actually AI agents?

[-] Tar_alcaran@sh.itjust.works 3 points 1 week ago

I mean, technically, you can call any controlling sensor an "agent". Any if-then loop can be an "agent".

But AI bros mean "A piece of software that can autonomously perform any broadly stated task", and those don't exist in real life. An "AI Agent" is software you can tell to "Order me a pizza", and it will do it to your satisfaction.

An AI agent is software you can tell "Hack that system and retrieve the flag". And it's not that.

this post was submitted on 01 Jun 2025

-11 points (31.0% liked)

Cybersecurity

7437 readers

71 users here now

c/cybersecurity is a community centered on the cybersecurity and information security profession. You can come here to discuss news, post something interesting, or just chat with others.

THE RULES

Instance Rules

Be respectful. Everyone should feel welcome here.
No bigotry - including racism, sexism, ableism, homophobia, transphobia, or xenophobia.
No Ads / Spamming.
No pornography.

Community Rules

Idk, keep it semi-professional?
Nothing illegal. We're all ethical here.
Rules will be added/redefined as necessary.

If you ask someone to hack your "friends" socials you're just going to get banned so don't do that.

Learn about hacking

Hack the Box

Try Hack Me

Pico Capture the flag

Other security-related communities !databreaches@lemmy.zip !netsec@lemmy.world !securitynews@infosec.pub !cybersecurity@infosec.pub !pulse_of_truth@infosec.pub

Notable mention to !cybersecuritymemes@lemmy.world

founded 2 years ago

MODERATORS

kid@sh.itjust.works

Lanky_Pomegranate530@midwest.social