Happy Friday! Finally got some 🌞 in Seattle!
For today’s Day 16 of Building an LLM from scratch, I
Implemented#deeplearning
#generativeai #womenwhocode #largelanguagemodels #womenintech a full Transformer block:
causal multi-head self-attention → feed-forward network, wrapped with LayerNorm, residual connections, and dropout.
Input and output shapes stay the same, but representations become context-enriched at every layer.
This is the core unit that scales depth in transformers.