The AI Countdown Clock

Why did you use the weak AGI question? Feels like a motte-and-Bailey to say “x time until AGI” but then link to the weak AGI question.

I think this is a great project! I'd love to see a version of this with both strong and weak AI, I'd also like to see a section listing a caveats so that it is less likely to be dismissed as alarmism.

Well, there it is.

AI risk has gone from underhyped to overhyped.

I like the idea and the rationale. I'll admit I rarely put much stock in quantifications of the future (let alone quantifications crowdsourced by an audience whose qualifications cannot be ascertained). But, I think it would be fascinating to reflect back to this clock come 2028 and if AGI has not been agreeably achieved by then to ask ourselves "Well, how far have we come and how much longer do we suppose it will take?".

What I don't understand is why you're convinced that the introduction of AGI will result in you personally becoming transhuman.

Fun (for some version of "fun").

There's obvious connections to other countdown clocks, like the nuclear doomsday one. But here's a fun connection to think about. The World Transhumanist Association used to have a "death clock" on their website that counted up deaths so you could see how many people died while you were busy browsing their site. Given that AGI maybe could lead to technological breakthroughs that end death (or could kill everyone), maybe there's something in the space of how many more people have to die before we get the tech that can save them?

IDK, just spitballing here.

I like this a lot! I am also the kind of person to use a new tab death clock, though your post inspired me to update it to my own AI timeline (~10 years).

I briefly experimented with using New Tab Redirect to set your site as my new tab page, but I think it takes a smidgen longer to load haha (it needs to fetch the Metaculus API or something?)

This is a very weak definition even for weak AGI on the Metaculus question. This seems quite easy to game in the same way all the previous AI questions were gamed. I wouldn't be too impressed if this happened tomorrow. This does not seem like a sufficient amount of generality to be an AGI. 

The Loebner silver prize is the only even vaguely interesting requirement, but I have deep doubts as to the validity of the Turing test (and this particular variant test apparently isn't even running anymore). I'd have to trust the judges for this to mean anything, and Metaculus would have to trust completely unknown judges for this question to be when it should happen, not when they think there will be such hype. Fooling what are likely to be cooperative judges just isn't impressive. (People have been intentionally fooling themselves with chatbots since at least Eliza.) People fooling themselves about AI has been in the news a lot ever since GPT-2. (Whose capabilities as stated by even the more reasonable commentariat have only finally been matched this year by when Chinchilla came out in my opinion.)

I know I already extend a great deal of charity when interpreting things through text, and will give the benefit of the doubt to anyone who can string words together (which is what AIs are currently best at) and never look for proof that the other side isn't thinking. They will likely be fooled many years before the chatbot has significant reasoning ability (which is highly correlated with ability to string words together in humans, but not machines.). Unless the judges are very careful, and no one knows who would be judging, and we have no reason to trust that they would be selected for the right reasons.

Separately, there has been little evidence that using Metaculus leads to correct results about even vaguely unknowable things. It may or may not reflect current knowledge well depending on the individual market, but the results have never seemed to work much above chance. I don't engage with it much personally, but everything I've seen from it has been very wrong.

Third note, even if this was accurate timing for weak AGI, the true indications are that a human level AGI would not suddenly become a god level AI. There is no reason to believe that recursive self-improvement is even a thing that could happen at a software level at a high rate of speed in something that wasn't already a superintelligence, so it would rely on very slow physical processes out in the real world if it took an even vaguely significant level of resources to make said AI in the first place. We are near many physical limits, and new kinds of technology will have to be developed to get even vaguely quick increases to how big the models can be, which will be very slow for a human level being that has to wait on physical experiments.

Fourth, the design of the currently successful paradigm does not allow the really interesting capabilities anyway. (Lack of memory, lack of grounding by design, etc.) The RL agents I think are used for things like Go and videogame capabilities are more interesting, but there doesn't seem to be any near future path where those are the basis of a unified model that performs writing successfully rather than just a thing to manipulate a language model with. (We could probably make a non-unified model today that would do these things if we just spent a lot of money, but it wouldn't be useful.)

Because of this, you will likely die of the same things as would be expected in a world where we didn't pursue AI, and at similar times. It might affect things in the margin, but only moderately.

Note: I only realized this was a couple months old after writing a large portion of this.

I like the idea of visualizing progress towards a future milestone. However, the presentation as a countdown seems problematic. A countdown implicitly promises that something interesting will happen when the countdown reaches 0, as seen with New Year's countdowns, launch countdowns, countdowns to scheduled events, etc. But, here, because of the uncertainty, it's vanishingly unlikely that anything interesting will happen at the moment the countdown completes. (Not only might it not have happened yet, but it might have happened already!)

I can't think a way to fix this issue. Representing the current uncertainty represented by Metaculus's probability distribution is already hard enough, and the harder thing is to respond to changes in the Metaculus prediction over time. It might be that countdowns inherently only work with numbers known to high levels of precision.

Thanks for putting this together.

Hey! Thanks, i found myself checking your website almost every day, and it was awesome, but now is not working.

So i made my own based on your design: https://countdowntoai.com i hope it's ok with you

Reading the comments i'm going to add the option to choose between Metaculus week and strong AGI predictions.

Thanks again!

Downvoted for being misleading, and I've got to agree with Roko that the question is based upon isn't really what is being claimed here. It matters, but please at least try not to be misleading.

It shows 5 years 12 months (instead of 6 years 0 months), which seems to be the same kind of a bug I pointed out 23 days ago.

Great countdown, I check it every few days.

Currently, it shows

6YEARS,
12MONTHS,
3DAYS,
6HOURS,
23MINUTES,
49SECONDS

I'm thinking it should be 7 years instead of 6 years 12 months?

Looks awesome!  Maybe there could be extended UI that tracks the recent research papers (sorta like I did here) or SOTA achievements. But maybe that would ruin the smooth minimalism of the page. 

So, it pattern matches to the infamous doomsday clock, and the precision down to 1 second with no error bars implies the author skipped the basics in high school math. Instant loss of credibility.