A postmortem of HyperWrite's Reflection 70B model blames "a bug in the initial code for benchmarking", after evaluators couldn't reproduce some claimed results (Carl Franzen/VentureBeat)

Carl Franzen / VentureBeat:
A postmortem of HyperWrite's Reflection 70B model blames “a bug in the initial code for benchmarking”, after evaluators couldn't reproduce some claimed results  —  On September 5th, 2024, Matt Shumer, co-founder and CEO of the startup Hyperwrite AI (also known as OthersideAI) …

from Techmeme https://ift.tt/jznkiXP