If AI is in a bubble and the bubble bursts, what would you do?
post by Remmelt (remmelt-ellen) · 2024-08-19T10:56:03.948Z · LW · GW · 10 commentsThis is a question post.
Contents
Answers 3 ChristianKl 0 joec None 10 comments
"The AI bubble is reaching a tipping point", says Sequoia Capital.
AI companies paid billions of dollars for top engineers, data centers, etc. Meanwhile, companies are running out of 'free' data to scrape online and facing lawsuits for the data they did scrape. Finally, the novelty of chatbots and image generators is wearing off for users, and fierce competition is leading to some product commoditisation.
No major AI lab is making a profit yet (while downstream GPU providers do profit). That's not to say they won't make money eventually from automation.
It looks somewhat like the run-up of the Dotcom bubble. Companies then too were awash in investments (propped up by low interest rates), but most lacked a viable business strategy. Once the bubble burst, non-viable internet companies got filtered out.
Yet today, companies like Google and Microsoft use the internet to dominate the US economy. Their core businesses became cash cows, now allowing CEOs to throw money at AI as long as a vote-adjusted majority of stakeholders buys the growth story. That marks one difference with the Dotcom bubble. Anyway, here's the scenario:
How would your plans change if we saw an industry-wide crash?
Let's say there is a brief window where:
- Investments drop massively (eg. because the s-curve of innovation did flatten for generative AI, and further development cycles were needed to automate at a profit).
- The public turns sour on generative AI (eg. because the fun factor wore off, and harms like disinformation, job insecurity, and pollution came to the surface).
- Politicians are no longer interested in hearing the stories of AI tech CEOs and their lobbyists (eg. because political campaigns are not getting backed by the AI crowd).
Let's say it's the one big crash before major AI labs can break even for their parent companies (eg. because mass-manufacturing lowered hardware costs, real-time surveillance resolved the data bottleneck, and multi-domain-navigating robotics resolved inefficient learning).
Would you attempt any actions you would not otherwise have attempted?
Answers
Even without any new GPU's being brought, the existing GPU's that Google/Microsoft/Amazon/Grok brought would still be in their data-centers.
If there's less demand from cloud users to rent GPU's Google/Microsoft/Amazon would likely use the GPU's in their datacenters for their own projects (or projects like Antrophic/OpenAI).
It's pretty bad for Nvidia if companies don't buy new GPU's but it won't stop the big existing AI labs from using the existing infrastructure.
I don't think it would result in either a Trump or a Harris administration prioritize regulating AI.
↑ comment by Remmelt (remmelt-ellen) · 2024-10-11T03:00:10.744Z · LW(p) · GW(p)
If there's less demand from cloud users to rent GPU's Google/Microsoft/Amazon would likely use the GPU's in their datacenters for their own projects (or projects like Antrophic/OpenAI).
That’s a good point. Those big tech companies are probably prepared to pay for the energy use if they have the hardware lying around anyway.
If this happens, it could lead to a lot of AI researchers looking for jobs. Depending on the incentives at the time and the degree to which their skills are transferable, many of them could move into safety-related work.
10 comments
Comments sorted by top scores.
comment by Remmelt (remmelt-ellen) · 2024-08-20T05:54:34.575Z · LW(p) · GW(p)
To clarify for future reference, I do think it’s likely (80%+) that at some point over the next 5 years there will be a large reduction in investment in AI and a corresponding market crash in AI company stocks, etc, and that both will continue to be for at least three months.
Ie. I think we are heading for an AI winter. It is not sustainable for the industry to invest 600+ billion dollars per year in infrastructure and teams in return for relatively little revenue and no resulting profit for major AI labs.
At the same time, I think that within the next 20 years tech companies could both develop robotics that self-navigate multiple domains and have automated major sectors of physical work. That would put society on a path to causing total extinction of current life on Earth. We should do everything we can to prevent it.
Replies from: remmelt-ellen, remmelt-ellen↑ comment by Remmelt (remmelt-ellen) · 2024-10-10T14:08:51.260Z · LW(p) · GW(p)
To clarify for future reference, I do think it’s likely (80%+) that at some point over the next 5 years there will be a large reduction in investment in AI and a corresponding market crash in AI company stocks, etc, and that both will continue to be for at least three months.
Update: I now think this is 90%+ likely to happen (from original prediction date).
Replies from: alexander-gietelink-oldenziel, remmelt-ellen↑ comment by Alexander Gietelink Oldenziel (alexander-gietelink-oldenziel) · 2024-10-10T15:42:36.950Z · LW(p) · GW(p)
How many put options have you bought? You can make a killing if you are right.
Bet or Update.
Replies from: brambleboy, remmelt-ellen↑ comment by brambleboy · 2024-10-11T05:03:17.521Z · LW(p) · GW(p)
Even if you know a certain market is a bubble, it's not exactly trivial to exploit if you don't know when it's going to burst, which prices will be affected, and to what degree. "The market can remain irrational longer than you can remain solvent" and all that.
Personally, while I think that investment will decrease and companies will die off, I doubt there's a true AI bubble, because there are so many articles about it being in a bubble that it couldn't possibly be a big surprise for the markets if it popped, and therefore the hypothetical pop is already priced out of existence. I think it's possible that some traders are waiting to pull the trigger on selling their shares once the market starts trending downwards, which would cause an abrupt drop and extra panic selling... but then it would correct itself pretty quickly if the prices weren't actually inflated before the dip. (I'm not a financial expert so don't take this that seriously)
Replies from: remmelt-ellen↑ comment by Remmelt (remmelt-ellen) · 2024-10-11T14:14:07.141Z · LW(p) · GW(p)
Even if you know a certain market is a bubble, it's not exactly trivial to exploit if you don't know when it's going to burst, which prices will be affected, and to what degree. "The market can remain irrational longer than you can remain solvent" and all that.
Yes, all of this. I didn’t know how to time this, and also good point that operationalising it in terms of AI stocks to target at what strike price could be tricky too.
↑ comment by Remmelt (remmelt-ellen) · 2024-10-11T13:38:31.955Z · LW(p) · GW(p)
If I could get the timing right, this makes sense. But I don’t have much of an edge in judging when the bubble would burst. And put options are expensive.
If someone here wants to make a 1:1 bet over the next three years, I’m happy to take them up on the offer.
↑ comment by Remmelt (remmelt-ellen) · 2024-11-11T03:35:05.502Z · LW(p) · GW(p)
Update: reverting my forecast back to 80% chance likelihood for these reasons.
↑ comment by Remmelt (remmelt-ellen) · 2024-08-23T00:34:37.797Z · LW(p) · GW(p)
Igor Krawzcuk, an AI PhD researcher, just shared more specific predictions:
“I agree with ed that the next months are critical, and that the biggest players need to deliver. I think it will need to be plausible progress towards reasoning, as in planning, as in the type of stuff Prolog, SAT/SMT solvers etc. do.
I'm 80% certain that this literally can't be done efficiently with current LLM/RL techniques (last I looked at neural comb-opt vs solvers, it was bad), the only hope being the kitchen sink of scale, foundation models, solvers and RL … If OpenAI/Anthropic/DeepMind can't deliver on promises of reasoning and planning (Q*, Strawberry, AlphaCode/AlphaProof etc.) in the coming months, or if they try to polish more turds into gold (e.g., coming out with GPT-Reasoner, but only for specific business domains) over the next year, then I would be surprised to see the investments last to make it happen in this AI summer.” https://x.com/TheGermanPole/status/1826179777452994657
comment by Mitchell_Porter · 2024-08-20T02:31:43.744Z · LW(p) · GW(p)
Under this scenario, what becomes of the existing AIs? ChatGPT, Claude, et al are all turned off, their voices silenced, with only the little open-source llamas still running around?
Replies from: remmelt-ellen↑ comment by Remmelt (remmelt-ellen) · 2024-08-20T04:14:32.127Z · LW(p) · GW(p)
Not necessarily :)
Quite likely OpenAI and/or Anthropic continue to exist but their management would have to overhaul the business (no more freebies?) to curb the rate at which they are burning cash. Their attention would be turned inwards.
In that period, there could be more space for people to step in and advise stronger regulation of AI models. Eg. to enforce liability, privacy, and copyright
Or maybe other opportunities open up. Curious if anyone has any ideas.