facebook pixel
๐Ÿ“ฃ Blackwell sets a new inference speed world record โ€” A single NVIDIA DGX B200 server with eight #NVIDIABlackwell GPUs can generate over 1,000 tokens per second (TPS) per user on the Llama 4 Maverick model. โšกโฑ๏ธ Additionally, a system with eight Blackwell GPUs can also deliver up to 72,000 tokens/second in a maximum throughput scenario. ๐Ÿ† Blackwell is the first platform to achieve this model performance, demonstrating how it delivers the best combination of throughput, output speed and accuracy for LLM token generation. ๐ŸŽ๏ธ๐Ÿ Check the link in our bio for details

ย 104

ย 2

    Suggested Credits
    Tags, Events, and Projects