FRESH

Hacker News

Provably unmasking malicious behavior through execution traces

46 points by PaulHoule

by thethirdone

0 subcomment

Based on Table 1: This method is actually worse than generating a random number (0-100% independent of the program) and testing if it is less than 98.8%. That would achieve a better detection rate without increasing the false positive rate.
It doesn't seem worth it to try to follow the math to see if there is something interesting.

by causalmodels

2 subcomments

Interesting direction but the 98.8% FPR in Table 1 seems like a dealbreaker. Anyone understand what's going on with the contradictory results between the text and tables?

by Joel_Mckay

0 subcomment

"'Forbidden' AI Technique" (Computerphile)
https://www.youtube.com/watch?v=Xx4Tpsk_fnM
"The Hard Problem of Controlling Powerful AI Systems" (Computerphile)
https://www.youtube.com/watch?v=JAcwtV_bFp4
Attempting to guide statistical salience of LLM reasoning model procedures, usually just created an evasive interface facade in the output. =3