It’s Day 2/30 Days of Building a Large Language Model from Scratch! 👋 🤖The transformer architecture consists of two submodules: an encoder and a decoder. The encoder module processes the input text and encodes it into a series of numerical representations or vectors that capture the contextual information of the input. 🤖Then, the decoder module takes these encoded vectors and generates the output text. 🤖 A key component of transformers is the self attention mechanism which allows the model to weigh the importance of different words or tokens in a sequence relative to each other. Tomorrow I’ll set up my environment and start working with real data. #deeplearning #generativeai #30dayschallenge #womenwhocode #datascience #largelanguagemodels