facebook pixel
Four generations of NVIDIA inference cards on the bench: the L4, the new RTX PRO 4500 Blackwell Server Edition, the L40S, and the RTX PRO 6000 behind them. We ran all four through vLLM serving in a Dell PowerEdge R770 to see how close a 165W single-slot card gets to the 350W L40S. At short context it matched it, 1,107 vs 995 tokens/s. Full review at the link in bio. #NVIDIA #RTXPRO4500 #Blackwell nvidiaai delltech

 168

 4

    Suggested Credits
    Tags, Events, and Projects