How often are new ideas discovered in old papers?
post by TurnTrout
score: 24 (9 votes) ·
This is a question post.
Suppose someone wrote a paper about X two decades ago. A modern reader realizes the X paper sheds light on an unrelated idea Y. Do we have any information on how often this happens? How often is this just "I figured out Y for a different reason, and while doing my lit review I realized that the X paper is also relevant for Y"?
answer by ryan_b
· score: 6 (3 votes) · LW
) · GW
I expect this information is reasonably well documented in histories of particular currents of thought. I have no idea how often it happens in absolute terms, but I feel it must be relatively common because I have encountered it as an amateur reader of papers.
A good example is ET Jaynes' work on maximum caliber, which is a variational principle for dynamical systems. It might be cheating because it is well-understood to be a controversial concept, but the insights concerned entropy. Jaynes' specialty was Statistical Mechanics, for which he had employed information-theoretic notions of entropy in order to account for the lack of knowledge of the microstates. When Jaynes' was writing, physics used the Clausius formulation of 2nd Law of Thermodynamics, which he found unsatisfactory for the problem of prediction because it says nothing about intermediate states before reaching equilibrium. In Physical Chemistry they used a different one, which came from work by G.N. Lewis, who used the Gibbs formulation of the 2nd Law. It is insights drawn from the subtleties of Gibbs' work concerning entropy that gave Jaynes the predictive power he was interested in. Lastly, Jaynes had the work of Clifford Truesdell who was writing around the same time in the field of Continuum Mechanics, and working to expand that approach to fully cover thermodynamics. Truesdell's work persuaded Jaynes that the other approaches were in fact wrong.
So here was a case where one physics researcher (Jaynes) borrowed math ideas from communication (Shannon), then read older work from chemistry (Lewis), leading to much older work in early thermodynamics that had new insights (Gibbs), and confirmed by more recent work in a different field of math (Truesdell). All of these insights went into his work on maximum caliber.
In a similar vein, a lot of Truesdell's writing consists of going back to the early days of thermodynamics and finely sifting the insights therein. He writes well and carefully, but is animated and polemical; I recommend reading him to anyone interested in thermodynamics.
Comments sorted by top scores.
comment by romeostevensit
· score: 3 (2 votes) · LW
) · GW
Since most papers don't include much metadata this will be really hard to figure out (also, which citations count as central to the insight?). I agree knowing the answer to this would be very interesting. My impression has been that Kuhnian style shifts do generally involve someone going back to the assumptions of the current paradigm and realizing that a different direction is now plausible given what has been discovered in the interim. E.g. the modern era is built on set theory and point estimates. In order to make progress rebasing on distributions natively might have to happen.
comment by Slider
· score: 1 (1 votes) · LW
) · GW
I would not count such a thing as an "old paper" but a "primary reading" of a "new" paper. But this might be because I am pessimistic about academic speed and the reach of papers.