FRESH

Hacker News

FunctionGemma 270M Model

218 points by mariobm

by canyon289

14 subcomments

Hi all, I'm a research lead on this model. Same as every model release post, I enjoy working at Google for a multitude of reasons, and opinions here are my own.
Happy to answer whatever technical questions I can!

by xnx

1 subcomments

Unbelievable shipping velocity from Google in December, and it sounds like they're not done for the week: https://x.com/osanseviero/status/2001723652635541566

by Someone

1 subcomments

FTA: In our "Mobile Actions" evaluation, fine-tuning transformed the model’s reliability, boosting accuracy from a 58% baseline to 85%. This confirms that for edge agents, a dedicated, trained specialist is an efficient path to production-grade performance.
I would be wary of having a LLM with 85% accuracy call tools on my system. Isn’t that fairly far away from production-grade performance?
I also don’t see that the fact that accuracy can be boosted from 50% to 85% is any indication that it can be boosted further.

by eachro

1 subcomments

Do you think this would be appropriate for a command line tool that hits various apis as the function calls? Ex: "what's the weather in SF tomorrow?" Or "daily price change of apple, Tesla stock for past week"? (Let's assume I have documented the apis thoroughly somewhere that the model has access to or fine tuned it on this data)

0 subcomment

by nateb2022

1 subcomments

by syntaxing

2 subcomments

I’ve been wanting to fine tune models for home assistant but unsure how to get some synthetic data, any recommendations?

by andai

1 subcomments

Hot take: Dodgy small/fast/cheap LLM in a While True approx. equals AGI for most real world tasks.

by gessha

0 subcomment

My brain didn’t realize that the parameters were megabytes and not gigabytes and my reaction went from “meh” to “holy bananas!”
Great work from the Google ML teams, I’ll be trying this model out.

by mentalgear

0 subcomment

by SpaceManNabs

1 subcomments

0 subcomment

by orliesaurus

1 subcomments