FRESH

Hacker News

Home

Agents of Chaos

137 points by luu

by cyanydeez

1 subcomments

This is begging to turned into a youtube style "Real World", where you pit 12 humans with 12 AIs and they're only allowed to interact through CLIs.
Then you slowly reveal they're all humans.

by aledevv

1 subcomments

For agents, any direct access to execution tools (code, shell, file system, browser, and external services, etc.) exponentially increases vulnerabilities and error surfaces, especially when multiple agents interact with each other.
This makes it even more crucial to have the most seamless ability possible to implement reverse and restore previous States.
The risk of the Agents actions becoming irreversible at the system level must be minimized.
I wonder how much all this can impact (and certainly will impact) the Real World, which will be increasingly robotized and automated: public services, finance, hospitals, schools, public administrations, military sectors (!), etc.

by whatever1

1 subcomments

I don't understand why LLMs get a free pass when all of the existing businesses have to play by the rules.
Businesses have to comply with IP, privacy, HIPAA, security and safety laws to name just a few.
NONE of these apply to the LLMs.
Of course I can now build and deploy an app to hospitals in a weekend since I can circumvent all of the difficult parts using the magic LLMs. If asked why, the response is "It's AI!"

by manmal

0 subcomment

The TLDR is that current agents are as problematic as many of us already know they are:
> unauthorized compliance with non-owners, disclosure of sensitive information, execution of destructive system-level actions, denial-of-service conditions, uncontrolled resource consumption, identity spoofing vulnerabilities, cross-agent propagation of unsafe practices, and partial system takeover

by iqihs

0 subcomment

as someone who is working in the cybersecurity space and recently obtained my CISSP designation, i am left wondering when the pedagogy of my field will expand and include a separate domain dedicated to AI agent safety and security best practices
it really does feel like we are way behind in the way we train people in cyber compared to the pace of the development of agentic AI, robotics etc

by heyethan

0 subcomment

The failure mode here seems less about capability and more about interaction. Language turns coordination into a moving target.

by e7h4nz

0 subcomment

In this problem domain, I believe humanity is still in a very early stage. What we can do is treat the agent and its operating environment as a "black box" and audit all incoming and outgoing network request traffic.
This approach is similar to DLP (Data leak prevention) strategies in enterprise-level security. Although we cannot guarantee that every single network request is secure, we can probabilistically improve safety by adjust network defense rules and conducting post-event audits on traffic flow

by AIorNot

0 subcomment

All this to say: OpenClaw is hella insecure and unreliable?
I mean all of in the space already know this but I suppose its important to be showcasing the problems of systems of agents

by paidev

0 subcomment

Looks more like a vibe coded paper for me. Has very low substance. Blog like stuffs. I can’t see the amount of slop in the papers soon.

by Sim-In-Silico

0 subcomment

[dead]

by charlotte12345

0 subcomment

[dead]

by noritaka88

0 subcomment

[dead]

by P-MATRIX

0 subcomment

[dead]

by kevinbaiv

1 subcomments

[flagged]

by dnaranjo

0 subcomment

[dead]

by hackermeows

0 subcomment

your IQ > Model IQ- you will have good results as you have the ability to detect when model is wrong.
your IQ < Model IQ - god bless you.

by EGreg

1 subcomments

This is exactly why I built Safebots to prevent problems with agents. This article shows how it can address every security issue with agents that came up in the study:
https://community.safebots.ai/t/researchers-gave-ai-agents-e...