Zero-Shot Learning

Chris Fowler

1 episode

• 

  Evals are agent infrastructure | Adarsh Hiremath from Mercor

  14 Jul · 52 min

  • Adarsh Hiremath, co-CEO of Mercor, says enterprise agents need tribal knowledge that is often not stored in a form agents can use, so evals must capture what good looks like.
  • Hiremath says output metrics can mislead, so evals should grade the whole trajectory from inputs to reasoning to output, not just the final answer.… more