FRESH

Hacker News

Show HN: Gemma Gem – AI model embedded in a browser – no API keys, no cloud

155 points by ikessler

by avaer

4 subcomments

by veunes

4 subcomments

It’s a neat idea, but giving a 2B model full JS execution privileges on a live page is a bit sketchy from a security standpoint. Plus, why tie inference to the browser lifecycle at all? If Chrome crashes or the tab gets discarded, your agent's state is just gone. A local background daemon with a "dumb" extension client seems way more predictable and robust fwiw

by siddbudd

0 subcomment

even Anthropic messed up LLM in a Chrome extension, not sure I would want this in my browser.

by emregucerr

3 subcomments

I would love to see someone build it as some kind of an SDK. App builders could use it as a local LLM plugin when dealing with data involving sensitive information.
It's usually too much when an app asks someone to setup a local LLM but this I believe could solve that problem?

by montroser

0 subcomment

Not sure if I actually want this (pretty sure I don't) -- but very cool that such a thing is now possible...

by dabrez

0 subcomment

I have this written a a project I will attempt to do in the future, I also call it "weapons grade unemployment" in the notes I was proposing to use granite but the principle still stands. You beat me to it.

by eric_khun

2 subcomments

it would be awesome if a local model would be directly embeded to chrome and developer could query them.
Anyone know if this is somehow possible without going through an extension?

by kabir_daki

0 subcomment

by Morpheus_Matrix

0 subcomment

by agdexai

0 subcomment

by aimadetools

0 subcomment