Unifi released the UCG-Fiber around a year ago that can also apparently finally handle it, but plenty of threads about slow performance with their UDMs since it's entirely done on the CPU [0].
I'm not the biggest fan of OpenWRT and would prefer something like OPNSense, but it's x86 only and good PPPoE performance isn't guaranteed either - need a CPU with good single core performance that costs more than the BPI-R4, or apparently virtualizing OPNSense allows it to process PPPoE with multiple threads.
0: https://community.ui.com/questions/What-is-the-max-performan...
Then the results aren't comparable across different boards across RAM sizes. It'd be better to test a set of different model sizes on all and report -- if it didn't fit. But could you report the full ollama model name and version size slug for each?
> I pull Jeff's fork of the ollama-benchmark software
A link would be nice.