Show HN: Frugon – Find which LLM calls a cheaper model could handle (local, MIT)
41 points by jarodrh
by isadubois
1 subcomments
This looks super clean. I'm curious about the --judge command. How does it evaluate if the cheaper model's response is a "tie" or acceptable? Is it using a specific LLM-as-a-judge prompt template?
by XUEYANZ
1 subcomments
Haha. somehow i just love the naming. it just makes sense :D
by ipanditshashi
1 subcomments
Useful but how it compares with other providers model
by cyanydeez
1 subcomments
this would be more interesting as a local LLM anlysis; throw out all the costs, and figure out primary-subagent model architecture, and maximize token generation and prefill.
I don't see how anyone can operationalize this information.
Hacker News