Hello Folks! After a relaxing weekend it’s time to get into action for building the LLM ⚡️
For Day 17 of Building LLM from scratch, I implemented the full GPT architecture by stacking transformer blocks (12 layers for GPT-2 small).
Token + positional embeddings → dropout → multi-head attention + MLP blocks → LayerNorm → linear vocab projection.
Model outputs logits of shape (batch, seq_len, vocab_size) and supports autoregressive generation.
Untrained for now-training begins next.
#deeplearning #generativeai #womenwhocode #largelanguagemodels #womenintech