facebook pixel
Hello Folks! After a relaxing weekend it’s time to get into action for building the LLM ⚡️ For Day 17 of Building LLM from scratch, I implemented the full GPT architecture by stacking transformer blocks (12 layers for GPT-2 small). Token + positional embeddings → dropout → multi-head attention + MLP blocks → LayerNorm → linear vocab projection. Model outputs logits of shape (batch, seq_len, vocab_size) and supports autoregressive generation. Untrained for now-training begins next. #deeplearning #generativeai #womenwhocode #largelanguagemodels #womenintech

 23k

 463

 15

 23k

    Suggested Credits
    Tags, Events, and Projects