“We’re Not Ready: thoughts on ‘pausing’ and responsible scaling policies” by Holden Karnofsky

Views are my own, not Open Philanthropy's. I am married to the President of Anthropic and have a financial interest in both Anthropic and OpenAI via my spouse. Over the last few months, I’ve spent a lot of my time trying to help out with efforts to get responsible scaling policies adopted. In that context, a number of people have said it would be helpful for me to be publicly explicit about whether I’m in favor of an AI pause. This post will give some thoughts on these topics. I think transformative AI could be soon, and we’re not ready I have a strong default to thinking that scientific and technological progress is good and that worries will tend to be overblown. However, I think AI is a big exception here because of its potential for unprecedentedly rapid and radical transformation.1 I think [...] ---Outline:(00:36) I think transformative AI could be soon, and we’re not ready(02:11) If it were all up to me, the world would pause now - but it isn’t, and I’m more uncertain about whether a “partial pause” is good(07:46) Responsible scaling policies (RSPs) seem like a robustly good compromise with people who have different views from mine (with some risks that I think can be managed)The original text contained 5 footnotes which were omitted from this narration. --- First published: October 27th, 2023 Source: https://forum.effectivealtruism.org/posts/ntWikwczfSi8AJMg3/we-re-not-ready-thoughts-on-pausing-and-responsible-scaling --- Narrated by TYPE III AUDIO.