FRESH

Hacker News

LLMs learn what programmers create, not how programmers work

37 points by noemit

by shomp

1 subcomments

Great observation. The brain of a programmer is still a "black box" to the feed-forward network of nodes . But in theory, if you pumped a lot of the live-coding videos from something like youtube into the process, you could get a bit of that "what's your approach"-erism to bleed into the model. There might not be enough material there to truly "train it to think" but it would be interesting to try and "fill the gaps" of black-box-ed-ness in the LLM with supplemental "here was the process that got us there" video feeds. The next natural move might actually be recording thousands of hours of footage of developers working with the LLMs directly like in Cursor or another IDE that has LLM live-pair-programming , maybe calling it "pair programming" is generous , but it might be a reasonable foray into teaching the next generation of LLMs the "thought process" behind things. In reality you'd be teaching it which files to inspect, which windows to open/close, which tools to switch to and focus on. And while it might be imperfect, it might just be enough.

by infosecphoenix

0 subcomment

not just for coding, for any profession, LLMs only learned what people created but not how professionals work.

by Areena_28

2 subcomments

I know even we hit the same thing building internal security tooling. our model kept formatting output like documentation, not like how we would or any person in place of us would read in a terminal at 2am during an incident.
I am a bit curious, did you find this behavior consistent across models or is it more pronounced with certain ones?

by acters

1 subcomments

Instead of telling the LLM that "run"works like a cli, maybe just tell the LLM that "run" will execute sh/bash/zsh/etc scripts?

by seertaak

3 subcomments

Is that really true? I would have expected by now that AI companies nowadays are doing RL on git histories, not just on the HEAD.

by mpalmer

1 subcomments

The novice came to the master. "I have figured it out, the rules for how LLMs understand CLIs. It gives the right commands, but adds colons. It was trained on the visual shape of terminals, not keystrokes."
"Clear the session," the master said. "Run the same prompt again."
The novice pressed return. The model output: `ls -R /tmp`
"The colons are gone," the novice said. "But my theory explained them perfectly."
"You built a cage for a cloud," the master said. "Do not mistake a single roll of the dice for the rulebook."

by productinventor

0 subcomment

by allinonetools_

0 subcomment

by moyet75472

0 subcomment

by freelancedata

0 subcomment

by Art9681

0 subcomment

Is "how programmers work" a useful and provable metric? No? Then it belongs in philosophy discussions. How you work and how I work is different. Your work may have ended up in the LLM training and my work did not. Or vice versa.
Can you objectively analyze how VSCode adapts to your way of working without our interference?
Did you test your theory with the actual frontier LLMs (which Kimi K2.5 is not BTW?)