facebook pixel
๐Ÿ“ฃ Blackwell sets a new inference speed world record โ€” A single NVIDIA DGX B200 server with eight #NVIDIABlackwell GPUs can generate over 1,000 tokens per second (TPS) per user on the Llama 4 Maverick model. โšกโฑ๏ธ Additionally, a system with eight Blackwell GPUs can also deliver up to 72,000 tokens/second in a maximum throughput scenario. ๐Ÿ† Blackwell is the first platform to achieve this model performance, demonstrating how it delivers the best combination of throughput, output speed and accuracy for LLM token generation. ๐ŸŽ๏ธ๐Ÿ Check the link in our bio for details
https://www.instagram.com/p/DKK9Jwquq_F
Posted on Instagram ยท

ย 104

ย 2

    Suggested Credits

    Credits on Gondola describe each credited role and may be incomplete. A brand or featured person is not necessarily the creator.

    Tags, Events, and Projects