08/06/2025

Thread

Tweet 1

Labs should publish their swe bench unverified performance as a measure of their overfitness

---

Tweet 2

swe bench verified performance is of course also a measure of over fitness but people don't realize

---