FRESH

Hacker News

CS336: Language Modeling from Scratch

130 points by kristianpaul

by skerit

1 subcomments

> GPU compute for self-study
Those suggestions they make for a B200 start at $4.99 an hour.
Is that really required, for starting out? I've been tinkering with my own from-scratch LLM, but in the early phases I don't need anything more than a 4090 on Vast.ai

by meken

1 subcomments

I have fond memories of cs224d [1] taught by richardsocher. It’s a bit dated now as it was created in the pre-transformer era, but it was very cool introduction to applying deep learning to nlp at the time.
[1] https://cs224d.stanford.edu

by airstrike

0 subcomment

I wonder if people prefer to learn this on their own or if building a community around open learning is something that others are interested in

by storus

0 subcomment

Thanks for releasing this again! What are this year's changes to prior offerings?

by tmule

4 subcomments

Are video lectures available online?