AI timelines don't account for base rate of tech progress

post by rvzlxax409 · 2024-11-04T19:31:39.732Z · LW · GW · 1 comments

Contents

1 comment

Papers about LLM scaling law projections don't make an attempt to estimate base rate of technological progress.

In particular, they don't make an attempt to estimate the base rate of false alarms when inventing new science and technology. If you study any hard science (not computer science) you realise how high this rate is. False alarms are the norm and older scientists grow cynical partly because of how many false alarms by newer scientists they need to debunk. By false alarm I mean someone claiming a new technology will be world-changing, only to later find out the result was faked, or had experimental error, or won't work outside of lab conditions, or won't scale, or will be too expensive, or any other reason.

Anyone remember LK99? That is the norm for people inside the space, it's just not the norm for normies on twitter hence it blew up.

1 comments

Comments sorted by top scores.

comment by Oxidize · 2024-11-04T19:51:33.095Z · LW(p) · GW(p)

AI isn't really new technology though, right? Do you have evidence of alarmists around AI in the past?

And do you have anecdotes of intelligent/rational people being alarmist about a technology that turned out to be false?

I think these pieces of evidence/anecdotes would strengthen your argument.

What is your estimated timeline for humanity's extinction if it continues on its current path?

What information are you using for the foundation of your beliefs around the progress of science & technology?