Maybe the LLMs will get there. I do suspect it’s less of a capabilities problem and more of a harness problem.
If the software is just for yourself: Just add some more code for handling the previously overlooked edge case and rerun the program. Else: Deal with the communication overhead and all of the misunderstandings and potentially fix the wrong problem. Also: XKCD 1172