post by [deleted] · · ? · GW · 0 comments

This is a link post for

0 comments

Comments sorted by top scores.

comment by [deleted] · 2024-03-27T17:53:54.093Z · LW(p) · GW(p)

I think it's important to remember your fate as it is right now.

If you manage to survive car accidents, violence, early cancer, genetic disease, or spontaneous cardiac death, your best case scenario is you go to be drugged until death in a hospice, or receive an amateur attempt at medical care by cryonics.  (what makes it amateur is that as no one has revived a human brain sample and validated the cells function again, this missing feedback likely means each cryonics process makes dozens of fatal mistakes and the best that can be done is a computer emulation of the deceased individual).

If you're this lucky, your children will be noticeably decayed by aging from their peak when they visit you on your deathbed.  They will be uglier, dumber, weaker, and have nothing to look forward to but your fate.  And the same for your grandchildren, if any are alive at this point, and so on.  

If AI fails or is paused, you can think that "well at least humanity will continue" but you won't at all know that, all you know is you didn't live to see the Doom.  

So a wildcard like AI makes new things possible.  While we humans don't know precisely how to solve aging, it's possible and experimentally seems to be viable.  Rats still die, so at age 130+ there are probably thousands of possible ways a rejuvenated body would begin to fail, and so you need some way to know what the treatment is for almost all cases.  Human minds are likely not capable of managing this amount of complexity.  But it's possible, nature makes new bodies 385,000 times a day via an unintelligent automated process.  

Some machine could review all of the papers on medicine, and all of the patients records available on earth, and then design and run likely billions of individual experiments at varying scales to resolve ambiguities, and then model human biology precisely enough to intervene and keep a patient alive across almost all cases.

Interesting times bring opportunity.  You were definitely going to lose the game before recent breakthroughs, now you might lose.  

comment by localdeity · 2024-03-27T15:42:31.565Z · LW(p) · GW(p)

I don’t trust that the replacements will be actually good

If ∑(people who agree with you on this * how much they agree with you) is high enough, that constitutes market demand for making an actually good replacement, or remaking the original.  Then the cost-benefit calculation determines whether the market will incentivize someone (or an AI) to solve the problem.

If you, personally, have preferences that are truly unusual, then that could be a problem.  Though I do expect the technology to make individually customized solutions cheaper and more feasible (in the vein of 3D printing).  Perhaps, among all the truly unusual preferences you have, the net move will be towards more satisfaction of them.

comment by Ponder Stibbons · 2024-03-27T12:28:04.441Z · LW(p) · GW(p)

I’m not going to say I don’t share deep disquiet about where AI is taking us, setting aside existential risk. One thing that gives me hope, however, is seeing what has happened in chess. The doom mongers might have predicted, with the advent of StockFish and AlphaZero, that human interest in chess would greatly diminish, because, after all, what is the point when the machines are so much better than the world champion ( world champion ELO ~2800, StockFish ELO ~4000) . But this hasn’t happened, chess is thriving and the games of the best human players are widely streamed and analysed and their brilliancies greatly admired. The machines have actually been of great benefit. They have, for instance demonstrated that the classical swashbuckling 19th century style of chess, replete with strategic sacrifices that lead to beautiful attacks, is a valid way to play, because they often play that way themselves. This style of play was for a long period overshadowed by a preference for the more stifling positional chess, the gaining of small advantages.  The machines also provide instant feedback in analysis on what is ground truth, whether a particular move is good, bad or neutral. This too has augmented the chess players enjoyment of the game rather than reduced It.

  Maybe we can hope that the same situation will apply in other fields of human endeavour.

Replies from: gwern
comment by gwern · 2024-03-27T14:10:22.189Z · LW(p) · GW(p)

The doom mongers might have predicted

They might have, because everyone did. I am not aware of any predictions before Deep Blue that computer chess would make it far more popular, I don't recall chess skyrocketing in popularity monotonically ever since Deep Blue's victory over Kasparov (as opposed to the initial surge of interest & hype - no such thing as bad publicity - followed by poking along for a decade and only rising relatively recently due to totally exogenous shocks from the rise of streaming and flukes like The Queen's Gambit); and indeed, this is not what has happened with most games once agents became superhuman. Did Arimaa enjoy a spike? Did backgammon after TD-Gammon? How about checkers since 1994? How much do FPSes enjoy spikes in popularity after the first superhuman aimbots are deployed? How much do MMORPGs benefit from botting? Is SC2 or DotA2 enjoying a renaissance now, or is their continued plummet in popularity simply because they haven't been botted hard enough? You point to chess, but what about shogi, which also was beaten by AlphaZero? How about Stratego? I notice that hobbyists are approaching superhuman in Rocket League, but somehow none of the Rocket League people seem happy about the progress... How are any of them doing? Just how many different games are you cherrypicking chess out of...?

It is also not a great idea to appeal to games persisting when the basic problem is one of economics, technology, and power. Games are untethered from the real world; if an AI is superhuman at chess, that ultimately is meaningless outside chess. (People like to dismiss such things as 'just games' or 'just closed worlds'; which is a fair criticism, but then you need to also apply it to the arguments for why you should expect things like the economy to go the same way: why is, say, lawyering going to go the same way as chess streaming? Are we going to suddenly see millions of people flocking to Twitch to watch Nakamura spin in his chair cracking wise as he plays 'bullet briefs' with a superhuman law-agent? How many existing lawyers, or total lawyers, does streaming law support?)