- > Technical: I started this project when the first LLMs came out. I've built extensive internal evals to understand how LLMs are performing. The hallucinations at the time were simply too frequent to passthrough this data to visitors. However, I recently re-ran my evals with Opus 4.5 and was very impressed. I am running out of scenarios that I can think/find where LLMs are bad at interpreting data.
It's nice to see an AI-centric Show HN product that uses proper evals and cares about data quality.
How did you build your initial data set that you're using for the evals? Bootstrapping a high quality data set is one of the hardest parts of really knowing how an AI product is performing.
- Unfortunately, none of these data are usable because (in the US, at least) there is no oversight on labeling accuracy for nutritional supplements.
That means I can dump woodchips into capsules and sell them as Multivitamins with 12 vitamins & minerals, and nobody would be the wiser.
There is more rigorous testing being done in underground steroid + peptide communities than in legal nutritional supplements.
Crazy world where you can trust vialed peptides from China more than something you bought on Amazon...
- This seems more like cataloguing than analyzing
I'd love to see a project that actually analyzes every supplement on the market to make sure it actually contains what it claims to, contains it at the listed dosage, and to show anything else found (heavy metals for example). That's not something AI can do for us though since it'd involve physically collecting and testing samples.
- Monetize it with Amazon or other affiliate links, and provide dollar per effective dose for a given set of desired supplements.
- I just searched the most popular/researched supplement of all time: creatine. There is a mistake in the data there: the Wellnesss Code Whey Protein indeed contains creatine, but not 2g per container, but 2g per serving (that is correctly reflected). Error is easily spotted due to the price per gram being an extreme outlier. That is perhaps something you can look for when evaluating the data gotten from the LLM.
by bionhoward
1 subcomments
- found a bug searching for "collagen":
Failed to execute 'removeChild' on 'Node': The node to be removed is not a child of this node.
Something broke. We're working on it, but in the meantime, try reloading the page. If that doesn't work, come back later.
Error ID: b846e2e2ba3b483ab93f10e72ef76820
NotFoundError: Failed to execute 'removeChild' on 'Node': The node to be removed is not a child of this node.
at ds (https://pillser.com/assets/entry.client-DWgmqxdv.js:1:112074)
at gs (https://pillser.com/assets/entry.client-DWgmqxdv.js:1:113602)
at ys (https://pillser.com/assets/entry.client-DWgmqxdv.js:1:113850)
at gs (https://pillser.com/assets/entry.client-DWgmqxdv.js:1:113728)
by stevofolife
0 subcomment
- I’d love to hear your domain expertise—specifically which supplements you’d recommend avoiding, which ones are generally worth taking, and whether there are any brands or products you trust. I imagine you’ve picked up a lot of insights beyond the technical side as well.
I think it will be nice if there is a summary of that somewhere on the website. It was the first thing I was looking for.
- Great resource for categories and research on supplements. Because supplements in U.S. are in the "wild west" of regulatory oversite, its important to know ingredient efficacy and ingredient purity. Consumer Labs (pay for subscription) offers some testing on selected products. Need to tweek "purchase from other market" -not all markets are "Out" as indicated.
- Please seriously consider *not* using ads to generate revenue. We need to return to other models rather than just slapping ads on everything. Be the change you want to see in the world. Do you really want to see more ads?
Have a look at https://examine.com as the closest site I can think of in this space, and check out their revenue models.
- I picked Vitamin D as it was an option on the main page. The cheapest offered was $1.1/mg.
Costco (https://www.costco.com/p/-/kirkland-signature-extra-strength...) sells Vitamin D at less than half that price. On Amazon, the two pack of those is even cheaper.
Just an observation.
by wordglyph
1 subcomments
- This is fantastic! I've been doing this manually for years. My main focus is always what does the research show about xyz supplement on gut bacteria.
- There is big money in supplements, so I don't think it will be difficult to monetize.
U GOT A WAYK00L BB0ARD D00DZ!
I borowed my brothers vic-2O to read ur bboard!!1!
Suplements r important 2 me after mom fed us nothing but enfamil
It looks like my doc says i got "Irritable Biff Syndrome"
So I gonna order some of these (do they accept Minecraft or RuneScape money??
UGOT WAYK00L BB0ARDZ, D00DZ!!
B1FF B1FF B1FF B1FF
B1FF ... B1FF
!!! B1FF ‽ B1FF
by bigwheels
1 subcomments
- Please don't take any products down due to shady legal threats! Won't this compromise nearly the entirety of the value proposition?
Cripes.
- How did you get around the legal issues?
by KellyCriterion
0 subcomment
- Do you include the EU market as well?
- > Shady companies are sending C&Ds letters demanding their products are taken down from the website.
That's surprising because it seems like you just have a review site? What's the issue? Or is it just bs threats?
by midnitewarrior
1 subcomments
- idk if you invented this but "add a ? to the end to get an AI response" seems like a convention that should catch on.
Well done!
by syngrog66
1 subcomments
- 1. dangerously unwise area to apply "AI" given all its known problems, and whats at stake
2. I tried using that site and immediately saw problems and broken behavior. The "Ask AI" feature (sounds pretty key?) literally did nothing. and doing a search for say aspirin yielded results that... had no aspirin! no brainer to bail out fast
by zingababba
1 subcomments
- I've fucked myself up so much over the years with supplements. Wish I could go back 30 years and tell myself to just eat real food. B6 toxicity for instance is crippling. That being said these days I just take two things: vit K2 and magnesium.
Hacker News