facebook pixel
Comment "Watch" for the full episode 👇️⁠ ⁠ Are AI labs chasing better models or better benchmark scores?⁠ ⁠ Alex Mashrabov, Co-Founder & CEO of Higgsfield, argues that tying rewards to benchmarks creates the wrong incentives. He says some researchers use test data in training to improve scores and secure quarterly bonuses.⁠ ⁠ Higher scores can look like progress. But what are they actually measuring?

 107

 11

Not seeing views yet? Check back later!
Credits
Suggested Credits
Tags, Events, and Projects