facebook pixel
Happy Friday! Finally got some 🌞 in Seattle! For today’s Day 16 of Building an LLM from scratch, I Implemented#deeplearning #generativeai #womenwhocode #largelanguagemodels #womenintech a full Transformer block: causal multi-head self-attention → feed-forward network, wrapped with LayerNorm, residual connections, and dropout. Input and output shapes stay the same, but representations become context-enriched at every layer. This is the core unit that scales depth in transformers.
https://www.instagram.com/p/DTmZMGtk_SJ
Posted on Instagram ·

 158

 7

Not seeing views yet? Check back later!
    Suggested Credits

    Credits on Gondola describe each credited role and may be incomplete. A brand or featured person is not necessarily the creator.

    Tags, Events, and Projects