[WTI-trainee] Building LLMs from Scratch

[Ping Luo]

The *Full-Stack AI Researcher Working G**roup* is running a workshop series
this semester on "*Building LLMs from Scratch*", using mainly materials
from this textbook
<https://www.manning.com/books/build-a-large-language-model-from-scratch> and
code from this repository <https://github.com/rasbt/LLMs-from-scratch>. The
digital version of the textbook is available from Yale Library
<https://search.library.yale.edu/catalog/991010655998708651?block=Books>.

This is a biweekly workshop that takes place *every other Tuesday at 7:00pm*,
and we will provide *dinner* 30 minutes before the workshop. The location
is *Room 1167, 100 College St*. Below is the tentative schedule:

*Feb 3:* Workshop Overview and Environment Setup
*Feb 17:* Working with Text Data
*Mar 3:* Coding Attention Mechanisms
--- Spring Break ---
*Mar 24:* Implementing a GPT Model from Scratch
*Apr 7:* Pretraining on Unlabeled Data
*Apr 21:* Fine-tuning for Text Classification
*May 5:* Fine-tuning to Follow Instructions

Please fill out the questionnaire
<https://docs.google.com/forms/d/1zYVuHQ_UcOpkT-EXgRvlOiAkw6Ugvbp3Xke1ZoXiqvA/viewform?edit_requested=true>
to indicate your interest in joining the workshop as a *participant* and
potentially as a *speaker* for any of the 7 weeks above.

We are excited to see this happening!🎉

For any questions, please contact the organizers: Dongyu Gong (
dongyu.gong at yale.edu) or Xiaowei Ou (xiaowei.ou at yale.edu).

--
Ping Luo
Director of Computing Resources
Center for Neurocomputation and Machine Intelligence
Wu Tsai Institute
Yale University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.yale.edu/pipermail/wti-trainee/attachments/20260126/ee1e4b3a/attachment.html>