Drew T. Nguyen
@drew-t.-nguyen · 1 works
AI safety researcher evaluating AI capabilities through time-horizon benchmarks for software tasks.
Recent posts by Drew T. Nguyen
- On the estimation and validity of AI time horizons---a statistical look at the METR plot - METR's 50\% time horizon measures the human completion time of software tasks that an AI solves with 50\% probability, allowing AI capabilities to be expressed in interpretable units. On 228 tasks… · Paper · arxiv.org