But the idea from OP is much better! I love that he used basic tools, this comma remind me a little bit of old irc bot, it was exactly the same flow, ", <query>".
Love it! <3
Thanks for sharing!
BTW, no one need $7k device to run eg. gemma4 e2b, even your phone can act as llm provider, it was a joke from op ;)
(The $7k was sarcasm)
Unclear to me whether this means $7k was the cost of the hardware that can run it, or if that was the token cost of implementation. The latter is surprisingly high; but the former is (to me?) a weird thing to share (if the whole point of this is that it can run locally, isn't that value undermined if it requires purchasing updated hardware to run?)