# @awomanindatascience on Instagram

- **Type:** Video
- **Original URL:** https://www.instagram.com/p/DIAxFH8umGd
- **Gondola URL:** https://gondola.cc/posts/61230124-awomanindatascience-instagram
- **Thumbnail:** https://img.gondola.cc/tr:w-,h-,fo-auto/postThumbnails/62d6fb37dd.jpg
- **Posted:** 2025-04-04T05:01:09.000+00:00
- **Account Owner:** Chinar Arora (@awomanindatascience) — https://gondola.cc/awomanindatascience

## Caption

It’s Day 2/30 Days of Building a Large Language Model from Scratch! 👋
🤖The transformer architecture consists of two submodules: an encoder and a decoder. The encoder module processes the input text and encodes it into a series of numerical representations or vectors that capture the contextual information of the input. 
🤖Then, the decoder module takes these encoded vectors and generates the output text.
🤖 A key component of transformers is the self attention mechanism which allows the model to weigh the importance of different words or tokens in a sequence relative to each other. 

Tomorrow I’ll set up my environment and start working with real data. 

#deeplearning #generativeai #30dayschallenge #womenwhocode #datascience #largelanguagemodels

## Stats

- **Views:** 2,313
- **Likes:** 49
- **Shares:** 0
- **Comments:** 0

## Tags

largelanguagemodels, deeplearning, 30dayschallenge, womenwhocode, generativeai, datascience

---
Copyright (c) Gondola