FRESH

Hacker News

Ask HN: How do you audit LLM code in programming languages you don't know?

6 points by syx

by throwup238

0 subcomment

I prefer the ancient Chinese science of Oracle Bone divination. You take the scapulae of an ox and copy the PR diff onto the bone using jiǎgǔwén encoding, then throw it in a fire until thermal expansion causes the bone to crack.
You then take a photo of the cracked bone and feed it back to your coding agent, which has been properly trained in interpreting Oracle Bones to extract PR review comments.
If the PR is too big too fit on the bone, you reject it for being too big. If after three rounds of review the bones keep cracking in the same spot, reject the PR. You accept the PR once the bone starts to seep bone marrow before cracking (it will crack first if there are any PR comments left)

by foxmoss

0 subcomment

You don’t. A JS dev isn’t going to catch an uninitialized variable in C and probably doesn’t even know the damage nasal demons can cause. You either throw more LLMs at it or learn the language.

by Davidbrcz

0 subcomment

You do a cross analysis.
- Compile it with the maximum number of warnings enabled
- Run linters/analyzers/fuzzers on it
- Ask another LLM to review it

by segmondy

0 subcomment

by vrighter

0 subcomment

by burying your head in the sand and convincing yourself that the llm doesn't generate any slop.

by al2o3cr

0 subcomment

by ath3nd

0 subcomment