facebook pixel
Hello folks!! Its Day 15 of Building an LLM from scratch✨ Today, I implemented Layer Normalization with per-token, feature-wise normalization to stabilize activations and improve training convergence, using learnable scale and shift parameters and biased variance for GPT-style compatibility. I also integrated the transformer feed-forward network with a 4× hidden dimension expansion and GELU activations, enabling smoother gradient flow and stronger non-linear representations within each transformer block. #deeplearning #generativeai #womenwhocode #largelanguagemodels #
https://www.instagram.com/p/DTj6-5tk0Ja
Posted on Instagram ·

 55.3k

 1.2k

 17

 55.3k

    Suggested Credits

    Credits on Gondola describe each credited role and may be incomplete. A brand or featured person is not necessarily the creator.

    Tags, Events, and Projects