# @awomanindatascience on Instagram

- **Type:** Video
- **Original URL:** https://www.instagram.com/p/DTj6-5tk0Ja
- **Gondola URL:** https://gondola.cc/posts/61229633-awomanindatascience-instagram
- **Thumbnail:** https://img.gondola.cc/tr:w-,h-,fo-auto/postThumbnails/9a29f68697.jpg
- **Posted:** 2026-01-16T06:23:01.000+00:00
- **Account Owner:** Chinar Arora (@awomanindatascience) — https://gondola.cc/awomanindatascience

## Caption

Hello folks!! Its Day 15 of Building an LLM from scratch✨
Today, I implemented Layer Normalization with per-token, feature-wise normalization to stabilize activations and improve training convergence, using learnable scale and shift parameters and biased variance for GPT-style compatibility.
I also integrated the transformer feed-forward network with a 4× hidden dimension expansion and GELU activations, enabling smoother gradient flow and stronger non-linear representations within each transformer block.

#deeplearning #generativeai #womenwhocode #largelanguagemodels #

## Stats

- **Views:** 22,700
- **Likes:** 1,240
- **Shares:** 0
- **Comments:** 18

## Tags

largelanguagemodels, deeplearning, womenwhocode, generativeai

---
Copyright (c) Gondola