This has always been true of all systems. Not that it isn’t an insight though since I don’t think enough people seem to get it. To build a system, with an LLM or without, you must know what the system needs to do. If you define it in C or in a markdown file it must still be defined. The advantage with LLMs is they bridge the gap between system definition and being able to simulate that system on a processor. The definition of the system is still required and it still must be precise. Even with “AGI” that’s still going to be true just as it’s true today with humans who do the translation between those who deeply understand a system and software.

We need both! Hurrah