“Improving capability evaluations for AI governance: Open Philanthropy’s new request for proposals” by cb

Summary Open Philanthropy is launching a request for proposals to improve AI capability evaluations. We're looking to fund work on more demanding GCR-relevant benchmarks, better evaluation science, and improving third-party model access and infrastructure. Click here to apply More details: Grant range: $200K to $5M per grant Timeline: Open until April 1, 2025 Eligibility: Anyone can apply, including those in academia, nonprofits, industry, or working independently. Full RFP and application form: https://www.openphilanthropy.org/request-for-proposals-improving-capability-evaluations  Below, we explain what we’re looking for, and why we think this work matters. Why capability evaluations matter The ability to accurately evaluate AI capabilities is becoming increasingly important, for three main reasons: 1. Evaluations are key inputs to AI governance Many current governance proposals rely heavily on knowing what AI systems can and cannot do. “If-then commitments” are one prominent example — companies agree to take specific actions (like pausing training) if their systems display [...] ---Outline:(00:08) Summary(01:02) Why capability evaluations matter(02:36) Three current problems with capability evaluations(03:43) What were looking to fund(03:52) GCR-relevant capability evaluations for AI agents(04:26) Improving the science of capabilities development and evaluations(05:04) Improving third-party model access and evals infrastructure(05:53) How to engage--- First published: February 7th, 2025 Source: https://forum.effectivealtruism.org/posts/bpBANcQwSmfQL3yPg/improving-capability-evaluations-for-ai-governance-open --- Narrated by TYPE III AUDIO.