facebook pixel
Hello Folks! After a relaxing weekend it’s time to get into action for building the LLM ⚡️ For Day 17 of Building LLM from scratch, I implemented the full GPT architecture by stacking transformer blocks (12 layers for GPT-2 small). Token + positional embeddings → dropout → multi-head attention + MLP blocks → LayerNorm → linear vocab projection. Model outputs logits of shape (batch, seq_len, vocab_size) and supports autoregressive generation. Untrained for now-training begins next. #deeplearning #generativeai #womenwhocode #largelanguagemodels #womenintech
https://www.instagram.com/p/DTuO92NE0gC
Posted on Instagram ·

 23k

 461

 15

 23k

    Suggested Credits

    Credits on Gondola describe each credited role and may be incomplete. A brand or featured person is not necessarily the creator.

    Tags, Events, and Projects