Explore
Creators
Teams
Jobs
Loading post...
Instagram
@dataengineeringtamil
Share
š Ever wondered how LLMs like ChatGPT understand text? In this reel, I break down how vocab.json and merges.txt work behind the scenes using Byte Pair Encoding (BPE)! š Bonus: I also show you how to train your own vocab. A must-watch for AI and NLP enthusiasts! š šØāš» Watch now & upgrade your AI game! Follow me
@dataengineeringtamil
Hashtags (all in one line):
#LLM
#AI
#Tokenizer
#vocabjson
#mergestxt
#BytePairEncoding
#ArtificialIntelligence
#MachineLearning
#DataEngineering
#NLP
#DeepLearning
#AIExplained
#GowthamSB
#SBGowtham
#TheDataTech
#aiintamil
#genaitamil
Posted on Instagram at
8/18/2025, 2:38:14 PM
Ā 18.7k
Ā 432
Ā 28
Ā 18.7k
Ā 18.7k
Ā 432
Ā 28
Ā 18.7k
Suggested Credits
Add A Credit
Tags, Events, and Projects
bytepairencoding
llm
dataengineering
tokenizer
machinelearning
sbgowtham
nlp
genaitamil
thedatatech
aiexplained
gowthamsb
deeplearning
vocabjson
aiintamil
ai
artificialintelligence
mergestxt
Add tag
Add event / campaign