FRESH
Hacker News
Home
Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context
18 points by GreenGames
by niles
0 subcomment
Any 3090? Or does the Ryzen AI MAX+ 395 and 128GB LPDDR5X unified memory on the Lucebox matter?
Anyone compare with the club-3090 dual setup?
Hacker News Hacker News Hacker News