Explore
Creators
Teams
Jobs
Loading post...
Instagram
@dataengineeringtamil
Share
š Ever wondered how LLMs like ChatGPT understand text? In this reel, I break down how vocab.json and merges.txt work behind the scenes using Byte Pair Encoding (BPE)! š Bonus: I also show you how to train your own vocab. A must-watch for AI and NLP enthusiasts! š šØāš» Watch now & upgrade your AI game! Follow me
@dataengineeringtamil
Hashtags (all in one line):
#LLM
#AI
#Tokenizer
#vocabjson
#mergestxt
#BytePairEncoding
#ArtificialIntelligence
#MachineLearning
#DataEngineering
#NLP
#DeepLearning
#AIExplained
#GowthamSB
#SBGowtham
#TheDataTech
#aiintamil
#genaitamil
Posted on Instagram at
8/18/2025, 2:38:14 PM
Ā 18.7k
Ā 432
Ā 28
Ā 18.7k
Ā 18.7k
Ā 432
Ā 28
Ā 18.7k
Add
Suggested Credits
Credit Another Account
Tags, Events, and Projects
bytepairencoding
llm
dataengineering
tokenizer
machinelearning
sbgowtham
nlp
genaitamil
thedatatech
aiexplained
gowthamsb
deeplearning
vocabjson
aiintamil
ai
artificialintelligence
mergestxt
Add tag
Add event / campaign