METR Study Finds Open-Source Maintainers Reject 24 Percent More SWE-Bench Patches Than Automated Graders
Blind code reviews of 296 AI-generated pull requests by open-source maintainers reveal a 24 percentage point merge gap below SWE-bench…
3 min read