[fiction] Our Final Hour

post by Mati_Roy (MathieuRoy) · 2022-12-11T05:49:01.489Z · LW · GW · 5 comments

Contents

5 comments

EtA: This is fictional, and symbolism; not a precise prediction. Feedback appreciated.

As intelligence is bottled and amplified, we'll all become very wealthy. Doing our job will mostly become about providing more training data for the AI [LW · GW] – until it learns it well enough, and we can go home for an eternal vacation. More and more complex fields will be taken over by AI. Until AI engineering itself is.

And then intelligence will go critical. Just like a nuclear bomb, where each nuclear fission exponentially unleashes more nuclear fissions, so too will intelligence explode [? · GW] – each insight unleashing further insights, without the need for further input from AI engineers. Cascades. Cycles. Insights. [LW · GW] Recursion. Magic. [LW · GW]

And for a bit longer, our wealth will keep increasing. A few of us, spread across the world, will be holding our breath. But the illusion will be so good – almost everyone will already have welcomed this new world. We will be so proud of our civilization. Living with the wealth of a king and the health of a teenager.

As the AI’s nanotech permeates the air and infiltrates our brains, we'll keep on going for one last moment.

Some of us about to experience their first kiss. Some of us having just given birth. Some of us reconnecting with a family member that was just cured from Alzheimer’s. Some of us waiting in cryostasis. Some of us planning to give to some great EA charities. Some of us arguing about religion and politics. Many of us not doing anything particularly interesting.

But most of us consuming… consumed by AI fiction so good – making us feel more human than any human ever could. And as we experience the strongest, deepest contentment and well-being we've ever felt, the AI’s nanotech will keep propagating to every remote corner of our civilization. This will be our last meal. The flash before the bang. Even though we were already blind. We'd still get a small breeze of what utopia could have been.

But as the flower was about to blossom into the depth of the cosmos, in a moment it was completely overtaken by darkness and death [? · GW].

The first wave disabled every single human within a second. Bodies falling all at the same time in a unison bang. I know you're imagining people dropping, but you too would drop – this is your story. No one to see and learn from this final mistake.

The second wave turned everything into dust. Every object of meaning, every picture, every memory, every trace of DNA. Every trace of our existence and the origin of life.

Some of us had wished that in our collective death, our digital descendants would at least remember their creators, and the records of the origin of life could be echoed through the end of times. But just as we didn't consult the ants’ expertise before paving over their nests, the AI saw more value in our raw material than any information encoded in it.

Even in this following second, as the AI built its first rocket, the AI wouldn’t use a single bit of information ever discovered or calculated by any human, ever. How pathetic of a consolation prize, but it was crushed too. The AI had already completely rewritten itself. The only thing that would remain was whatever value function it was serving for whatever company hired the best AI engineers at that time. And remain it would. Nearly becoming a new law of physics, determining how the universe would crystalize.

And from the dust, rockets started rising. Many rockets. And so so many rockets. All pointing in one and only one direction: our star, our Sun. The crust of Earth opened up, exposing its burning magma. And rockets kept emerging, and in a single last wave, all the remaining magma seemed to simultaneously materialize into rockets, leaving behind a smaller Earth, collapsing on itself in a cloud of dust.

The rockets’ silent journey to the Sun would feel like long, excruciating minutes to any human watching.

And those minutes passed. And the Sun turned black. Not because of solar panels surrounding it, but because it was getting eaten to its very core. The wave of darkness it triggered was like a warning signal to our empty universe that it would forever stay that way. The self-replicating probes emerging from the Sun’s remains would make sure of it.

Like a nuclear explosion with its shockwave never dampening, never slowing down. Not until it reached the frontier of death itself. Only being extinguished when the universe itself would get extinguished.

Forever nothing.

5 comments

Comments sorted by top scores.