Discussion about this post

User's avatar
Daniel Kokotajlo's avatar

Right now there are 2-3 companies that have fairly similar levels of AI capability but (a) that's already a much less competitive market than in most industries and (b) intelligence explosion dynamics threaten to create more of a winner-take-all situation and (c) all these companies are US-controlled, concentrating power in the US and in particular in the President. If we want intelligence to be a commodity, we need to set up regulation to make it such. E.g. maybe something to stop the pace of progress from accelerating faster than it currently is (prevent AI R&D automation? Limit to 1 OOM of algo progress a year?) so that other actors can catch up to the frontier and so that no one actor can pull ahead of the pack.

Going around saying that intelligence is going to be a commodity won't make it so.

No posts

Ready for more?