Happy Friday! Finally got some 🌞 in Seattle!
For today’s Day 16 of Building an LLM from scratch, I
Implemented#deeplearning #generativeai#womenwhocode#largelanguagemodels#womenintech a full Transformer block:
causal multi-head self-attention → feed-forward network, wrapped with LayerNorm, residual connections, and dropout.
Input and output shapes stay the same, but representations become context-enriched at every layer.
This is the core unit that scales depth in transformers.