Build a Large Language Model from Scratch

Join us for another session of our study group as we dive into the fascinating world of Large Language Models (LLMs) using the book Build a Large Language Model from Scratch from Manning. In this session, we will finish Chapter 5: Pre-training on Unlabeled Data and study the training loop that performs the pre-training phase of the LLM.

This isn't just a lecture! Come ready to ask questions, share insights, and code along. Whether you're a beginner or have some experience, this is the perfect opportunity to build a strong foundation together. If you plan to work with the code on your own laptop during the session, try and set-up the environment ahead of time (https://github.com/rasbt/LLMs-from-scratch/tree/main/setup).

We will be meeting at the North County Governmental Center this time that is across from the Reston public library.