Glenn Beck discusses the Singularity, cites SI researchers

post by Brihaspati · 2012-06-12T16:45:50.380Z · LW · GW · Legacy · 181 comments

Contents

  Turf Wars
  A Battle for the Future
None
181 comments

From the final chapter of his new book Cowards, titled "Adapt or Die: The Coming Intelligence Explosion."

The year is 1678 and you’ve just arrived in England via a time machine. You take out your new iPhone in front of a group of scientists who have gathered to marvel at your arrival.

“Siri,” you say, addressing the phone’s voice-activated artificial intelligence system, “play me some Beethoven.”

Dunh-Dunh-Dunh-Duuunnnhhh! The famous opening notes of Beethoven’s Fifth Symphony, stored in your music library, play loudly.

“Siri, call my mother.”

Your mother’s face appears on the screen, a Hawaiian beach behind her. “Hi, Mom!” you say. “How many fingers am I holding up?”

“Three,” she correctly answers. “Why haven’t you called more—”

“Thanks, Mom! Gotta run!” you interrupt, hanging up.

“Now,” you say. “Watch this.”

Your new friends look at the iPhone expectantly.

“Siri, I need to hide a body.”

Without hesitation, Siri asks: “What kind of place are you looking for? Mines, reservoirs, metal foundries, dumps, or swamps?” (I’m not kidding. If you have an iPhone 4S, try it.)

You respond “Swamps,” and Siri pulls up a satellite map showing you nearby swamps.

The scientists are shocked into silence. What is this thing that plays music, instantly teleports video of someone across the globe, helps you get away with murder, and is small enough to fit into a pocket?

At best, your seventeenth-century friends would worship you as a messenger of God. At worst, you’d be burned at the stake for witchcraft. After all, as science fiction author Arthur C. Clarke once said, “Any sufficiently advanced technology is indistinguishable from magic.”

Now, imagine telling this group that capitalism and representative democracy will take the world by storm, lifting hundreds of millions of people out of poverty. Imagine telling them their descendants will eradicate smallpox and regularly live seventy-five or more years. Imagine telling them that men will walk on the moon, that planes, flying hundreds of miles an hour, will transport people around the world, or that cities will be filled with buildings reaching thousands of feet into the air.

They’d probably escort you to the madhouse.

Unless, that is, one of the people in that group had been a man named Ray Kurzweil.

Kurzweil is an inventor and futurist who has done a better job than most at predicting the future. Dozens of the predictions from his 1990 book The Age of Intelligent Machines came true during the 1990s and 2000s. His follow-up book, The Age of Spiritual Machines, published in 1999, fared even better. Of the 147 predictions that Kurzweil made for 2009, 78 percent turned out to be entirely correct, and another 8 percent were roughly correct. For example, even though every portable computer had a keyboard in 1999, Kurzweil predicted that most portable computers would lack a keyboard by 2009. It turns out he was right: by 2009, most portable computers were MP3 players, smartphones, tablets, portable game machines, and other devices that lacked keyboards.

Kurzweil is most famous for his “law of accelerating returns,” the idea that technological progress is generally “exponential” (like a hockey stick, curving up sharply) rather than “linear” (like a straight line, rising slowly). In nongeek-speak that means that our knowledge is like the compound interest you get on your bank account: it increases exponentially as time goes on because it keeps building on itself. We won’t experience one hundred years of progress in the twenty-first century, but rather twenty thousand years of progress (measured at today’s rate).

Many experts have criticized Kurzweil’s forecasting methods, but a careful and extensive review of technological trends by researchers at the Santa Fe Institute came to the same basic conclusion: technological progress generally tends to be exponential (or even faster than exponential), not linear.

So, what does this mean? In his 2005 book The Singularity Is Near, Kurzweil shares his predictions for the next few decades:

  • In our current decade, Kurzweil expects real-time translation tools and automatic house-cleaning robots to become common.
  • In the 2020s he expects to see the invention of tiny robots that can be injected into our bodies to intelligently find and repair damage and cure infections.
  • By the 2030s he expects “mind uploading” to be possible, meaning that your memories and personality and consciousness could be copied to a machine. You could then make backup copies of yourself, and achieve a kind of technological immortality.

 

[sidebar]

Age of the Machines?

“We became the dominant species on this planet by being the most intelligent species around. This century we are going to cede that crown to machines. After we do that, it will be them steering history rather than us.”

—Jaan Tallinn, co-creator of Skype and Kazaa

[/sidebar]

 

If any of that sounds absurd, remember again how absurd the eradication of smallpox or the iPhone 4S would have seemed to those seventeenth-century scientists. That’s because the human brain is conditioned to believe that the past is a great predictor of the future. While that might work fine in some areas, technology is not one of them. Just because it took decades to put two hundred transistors onto a computer chip doesn’t mean that it will take decades to get to four hundred. In fact, Moore’s Law, which states (roughly) that computing power doubles every two years, shows how technological progress must be thought of in terms of “hockey stick” progress, not “straight line” progress. Moore’s Law has held for more than half a century already (we can currently fit 2.6 billion transistors onto a single chip) and there’s little reason to expect that it won’t continue to.

But the aspect of his book that has the most far-ranging ramifications for us is Kurzweil’s prediction that we will achieve a “technological singularity” in 2045. He defines this term rather vaguely as “a future period during which the pace of technological change will be so rapid, its impact so deep, that human life will be irreversibly transformed.”

Part of what Kurzweil is talking about is based on an older, more precise notion of “technological singularity” called an intelligence explosion. An intelligence explosion is what happens when we create artificial intelligence (AI) that is better than we are at the task of designing artificial intelligences. If the AI we create can improve its own intelligence without waiting for humans to make the next innovation, this will make it even more capable of improving its intelligence, which will . . . well, you get the point. The AI can, with enough improvements, make itself smarter than all of us mere humans put together.

The really exciting part (or the scary part, if your vision of the future is more like the movie The Terminator) is that, once the intelligence explosion happens, we’ll get an AI that is as superior to us at science, politics, invention, and social skills as your computer’s calculator is to you at arithmetic. The problems that have occupied mankind for decades— curing diseases, finding better energy sources, etc.— could, in many cases, be solved in a matter of weeks or months.

Again, this might sound far-fetched, but Ray Kurzweil isn’t the only one who thinks an intelligence explosion could occur sometime this century. Justin Rattner, the chief technology officer at Intel, predicts some kind of Singularity by 2048. Michael Nielsen, co-author of the leading textbook on quantum computation, thinks there’s a decent chance of an intelligence explosion by 2100. Richard Sutton, one of the biggest names in AI, predicts an intelligence explosion near the middle of the century. Leading philosopher David Chalmers is 50 percent confident an intelligence explosion will occur by 2100. Participants at a 2009 conference on AI tended to be 50 percent confident that an intelligence explosion would occur by 2045.

If we can properly prepare for the intelligence explosion and ensure that it goes well for humanity, it could be the best thing that has ever happened on this fragile planet. Consider the difference between humans and chimpanzees, which share 95 percent of their genetic code. A relatively small difference in intelligence gave humans the ability to invent farming, writing, science, democracy, capitalism, birth control, vaccines, space travel, and iPhones— all while chimpanzees kept flinging poo at each other.

 

[sidebar]

Intelligent Design?

The thought that machines could one day have superhuman abilities should make us nervous. Once the machines are smarter and more capable than we are, we won’t be able to negotiate with them any more than chimpanzees can negotiate with us. What if the machines don’t want the same things we do?

The truth, unfortunately, is that every kind of AI we know how to build today definitely would not want the same things we do. To build an AI that does, we would need a more flexible “decision theory” for AI design and new techniques for making sense of human preferences. I know that sounds kind of nerdy, but AIs are made of math and so math is really important for choosing which results you get from building an AI.

These are the kinds of research problems being tackled by the Singularity Institute in America and the Future of Humanity Institute in Great Britain. Unfortunately, our silly species still spends more money each year on lipstick research than we do on figuring out how to make sure that the most important event of this century (maybe of all human history)— the intelligence explosion— actually goes well for us.

[/sidebar]

 

Likewise, self-improving machines could perform scientific experiments and build new technologies much faster and more intelligently than humans can. Curing cancer, finding clean energy, and extending life expectancies would be child’s play for them. Imagine living out your own personal fantasy in a different virtual world every day. Imagine exploring the galaxy at near light speed, with a few backup copies of your mind safe at home on earth in case you run into an exploding supernova. Imagine a world where resources are harvested so efficiently that everyone’s basic needs are taken care of, and political and economic incentives are so intelligently fine-tuned that “world peace” becomes, for the first time ever, more than a Super Bowl halftime show slogan.

With self-improving AI we may be able to eradicate suffering and death just as we once eradicated smallpox. It is not the limits of nature that prevent us from doing this, but only the limits of our current understanding. It may sound like a paradox, but it’s our brains that prevent us from fully understanding our brains.

 

Turf Wars

At this point you might be asking yourself: “Why is this topic in this book? What does any of this have to do with the economy or national security or politics?”

In fact, it has everything to do with all of those issues, plus a whole lot more. The intelligence explosion will bring about change on a scale and scope not seen in the history of the world. If we don’t prepare for it, things could get very bad, very fast. But if we do prepare for it, the intelligence explosion could be the best thing that has happened since . . . literally ever.

But before we get to the kind of life-altering progress that would come after the Singularity, we will first have to deal with a lot of smaller changes, many of which will throw entire industries and ways of life into turmoil. Take the music business, for example. It was not long ago that stores like Tower Records and Sam Goody were doing billions of dollars a year in compact disc sales; now people buy music from home via the Internet. Publishing is currently facing a similar upheaval. Newspapers and magazines have struggled to keep subscribers, booksellers like Borders have been forced into bankruptcy, and customers are forcing publishers to switch to ebooks faster than the publishers might like.

All of this is to say that some people are already witnessing the early stages of upheaval firsthand. But for everyone else, there is still a feeling that something is different this time; that all of those years of education and experience might be turned upside down in an instant. They might not be able to identify it exactly but they realize that the world they’ve known for forty, fifty, or sixty years is no longer the same.

There’s a good reason for that. We feel it and sense it because it’s true. It’s happening. There’s absolutely no question that the world in 2030 will be a very different place than the one we live in today. But there is a question, a large one, about whether that place will be better or worse.

It’s human nature to resist change. We worry about our families, our careers, and our bank accounts. The executives in industries that are already experiencing cataclysmic shifts would much prefer to go back to the way things were ten years ago, when people still bought music, magazines, and books in stores. The future was predictable. Humans like that; it’s part of our nature.

But predictability is no longer an option. The intelligence explosion, when it comes in earnest, is going to change everything— we can either be prepared for it and take advantage of it, or we can resist it and get run over.

Unfortunately, there are a good number of people who are going to resist it. Not only those in affected industries, but those who hold power at all levels. They see how technology is cutting out the middlemen, how people are becoming empowered, how bloggers can break national news and YouTube videos can create superstars.

And they don’t like it.

 

A Battle for the Future

Power bases in business and politics that have been forged over decades, if not centuries, are being threatened with extinction, and they know it. So the owners of that power are trying to hold on. They think they can do that by dragging us backward. They think that, by growing the public’s dependency on government, by taking away the entrepreneurial spirit and rewards and by limiting personal freedoms, they can slow down progress.

But they’re wrong. The intelligence explosion is coming so long as science itself continues. Trying to put the genie back in the bottle by dragging us toward serfdom won’t stop it and will, in fact, only leave the world with an economy and society that are completely unprepared for the amazing things that it could bring.

Robin Hanson, author of “The Economics of the Singularity” and an associate professor of economics at George Mason University, wrote that after the Singularity, “The world economy, which now doubles in 15 years or so, would soon double in somewhere from a week to a month.”

That is unfathomable. But even if the rate were much slower, say a doubling of the world economy in two years, the shock-waves from that kind of growth would still change everything we’ve come to know and rely on. A machine could offer the ideal farming methods to double or triple crop production, but it can’t force a farmer or an industry to implement them. A machine could find the cure for cancer, but it would be meaningless if the pharmaceutical industry or Food and Drug Administration refused to allow it. The machines won’t be the problem; humans will be.

And that’s why I wanted to write about this topic. We are at the forefront of something great, something that will make the Industrial Revolution look in comparison like a child discovering his hands. But we have to be prepared. We must be open to the changes that will come, because they will come. Only when we accept that will we be in a position to thrive. We can’t allow politicians to blame progress for our problems. We can’t allow entrenched bureaucrats and power-hungry executives to influence a future that they may have no place in.

Many people are afraid of these changes— of course they are: it’s part of being human to fear the unknown— but we can’t be so entrenched in the way the world works now that we are unable to handle change out of fear for what those changes might bring.

Change is going to be as much a part of our future as it has been of our past. Yes, it will happen faster and the changes themselves will be far more dramatic, but if we prepare for it, the change will mostly be positive. But that preparation is the key: we need to become more well-rounded as individuals so that we’re able to constantly adapt to new ways of doing things. In the future, the way you do your job may change four to five or fifty times over the course of your life. Those who cannot, or will not, adapt will be left behind.

At the same time, the Singularity will give many more people the opportunity to be successful. Because things will change so rapidly there is a much greater likelihood that people will find something they excel at. But it could also mean that people’s successes are much shorter-lived. The days of someone becoming a legend in any one business (think Clive Davis in music, Steven Spielberg in movies, or the Hearst family in publishing) are likely over. But those who embrace and adapt to the coming changes, and surround themselves with others who have done the same, will flourish.

When major companies, set in their ways, try to convince us that change is bad and that we must stick to the status quo, no matter how much human inquisitiveness and ingenuity try to propel us forward, we must look past them. We must know in our hearts that these changes will come, and that if we welcome them into our world, we’ll become more successful, more free, and more full of light than we could have ever possibly imagined.

Ray Kurzweil once wrote, “The Singularity is near.” The only question will be whether we are ready for it.

The citations for the chapter include:

181 comments

Comments sorted by top scores.

comment by Jack · 2012-06-12T18:50:43.128Z · LW(p) · GW(p)

Does anyone remember when that one commenter freaked out and declared he would be attempting to marginally increase existential risk by sending right-wingers information about the singularity?

...

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T05:13:48.547Z · LW(p) · GW(p)

Clearly Waitingforgodel was talking about, y'know conservative people - with a conservative general mindset that extends into politics - and not progress-loving, ultra-capitalist right-wingers that get lumped in as "Conservatives". The distinction looks obvious enough to me.

And I'm not at all convinced that we should prefer the latter's enthusiasm to the former's anger.

Replies from: Eugine_Nier, MatthewB
comment by Eugine_Nier · 2012-06-13T06:40:18.219Z · LW(p) · GW(p)

Clearly Waitingforgodel was talking about, y'know conservative people - with a conservative general mindset that extends into politics - and not progress-loving, ultra-capitalist right-wingers that get lumped in as "Conservatives". The distinction looks obvious enough to me.

That's because you're a Burkean socialist. That distinction is not obvious to a large part of the population.

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T06:43:53.469Z · LW(p) · GW(p)

We ought to be more savvy than the general public in most regards, though, shouldn't we?

Replies from: Eugine_Nier
comment by Eugine_Nier · 2012-06-13T07:00:56.428Z · LW(p) · GW(p)

My point is that the distinction might not have been obvious to Waitingforgodel.

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T07:03:39.352Z · LW(p) · GW(p)

Yeah, well, in that case it's more evidence that he wasn't acting very sensibly :)

comment by MatthewB · 2012-08-09T05:35:32.821Z · LW(p) · GW(p)

Glenn Beck is hardly someone whose enthusiasm you should welcome.

He has a creationist agenda that he has found a way to support with the ideas surrounding the topic of the Singularity.

Replies from: Multiheaded
comment by Multiheaded · 2012-08-09T09:01:36.050Z · LW(p) · GW(p)

Yeah, well, I view a compartmentalized belief in something like Creationism as practically harmless - unless its holder is directly involved with the relevant fields of science, ofc. No, I was expressing concern about his ideological stance and his apparent view of society, which I find much less wise and much more harmful than, say, traditional European-style conservatism. You can tell that a commie like me is deeply alarmed when I start praising the latter! (But hush, this is veering off.)

comment by [deleted] · 2012-06-12T23:11:51.151Z · LW(p) · GW(p)

Glenn Beck also openly states that his books are ghost written. So maybe he's heard of Kurzweil and wants to talk about the singularity, but I'm guessing he's not the one reading SI publications.

Replies from: Snowyowl
comment by Snowyowl · 2012-06-15T09:21:16.345Z · LW(p) · GW(p)

Does it matter? People read Glenn Beck's books; this both raises awareness about the Singularity and makes it a more "mainstream" and popular thing to talk about.

comment by Tuxedage · 2012-06-12T20:18:27.103Z · LW(p) · GW(p)

This is a surprising amount of information relevant to the Singularity that Glenn Beck is familiar with, including people like Luke, Anna, Eliezer, and Michael.

Could Glenn be part of Lesswrong? Is there a possibility that Glenn Beck has read the LW sequences?

"...smiling down from their huge piles of utility..." Oh my God.

Replies from: GLaDOS, RobertLumley
comment by GLaDOS · 2012-06-12T20:40:05.291Z · LW(p) · GW(p)

"...smiling down from their huge piles of utility..."

I thought of that too. O.o

Glenn Beck being Eliezer's Finest Apprentice .... God must be a fanfic writer.

Replies from: Nornagest, Will_Newsome
comment by Nornagest · 2012-06-13T08:36:37.881Z · LW(p) · GW(p)

Yes, but fanfic of what? I'd hate to learn I was living in a Lovecraft pastiche... or worse, a Lifetime Original Movie.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T20:17:15.182Z · LW(p) · GW(p)

Three relevant TV tropes.

(Also keep in mind that by hypothesis the author is superintelligent. You shouldn't really expect to understand anything better than a caveman would grasp the subtleties of Dostoyevsky.)

comment by Will_Newsome · 2012-06-12T22:08:11.106Z · LW(p) · GW(p)

God must be a fanfic writer.

Here are some relevant TV Tropes.

comment by RobertLumley · 2012-06-12T21:03:21.165Z · LW(p) · GW(p)

Say what you will about Glenn Beck, he is a fairly well read person. It doesn't surprise me so much that he knows of these people, from what I know of him.

Replies from: Karmakaiser
comment by Karmakaiser · 2012-06-13T05:23:42.953Z · LW(p) · GW(p)

I have been impressed on his understanding of Hayek. He knows his Road to Serfdom.

comment by Miller · 2012-06-13T07:59:04.225Z · LW(p) · GW(p)

That's on my list of things I didn't expect to see today.

comment by CaveJohnson · 2012-06-12T20:10:09.017Z · LW(p) · GW(p)

The question now becomes what is Glenn Beck's username on LessWrong?

Replies from: Karmakaiser, None
comment by Karmakaiser · 2012-06-13T05:24:30.988Z · LW(p) · GW(p)

Every Right Wing Neo Reactionary Lesswrongian is now under suspicion.

Replies from: Multiheaded, negamuhia
comment by Multiheaded · 2012-06-13T10:29:34.092Z · LW(p) · GW(p)

Damn straight, comrade! We'd better uphold our political vigilance!

comment by negamuhia · 2012-08-28T16:16:42.956Z · LW(p) · GW(p)

You seem to be suggesting a Not-Glenn-Beck Turing-like Test.

comment by [deleted] · 2012-06-12T20:49:16.133Z · LW(p) · GW(p)

I bet US$1000 that Glenn Beck is one of User:Will_Newsome's sock-puppets.

comment by badger · 2012-06-12T17:49:06.289Z · LW(p) · GW(p)

Hmm, wow. This poses all sorts of interesting questions. How should this make me update on

  • Beck's overall rationality?
  • Beck's overall sincerity and what his agenda actually is?
  • Whether the Singularity/existential risk is being taken more seriously by a mainstream audience?
  • Whether this is good or bad press for SI?
Replies from: JenniferRM, JoshuaZ
comment by JenniferRM · 2012-06-12T18:43:10.459Z · LW(p) · GW(p)

Too provincial. The Singularity isn't important because thinking about it clearly and doing something to make it come out well were things SI/LW were involved in early on and this is a feather in our cap that speaks well for our "rationality" and may speak well for others if "they" agree with "us"... because the really interesting things aren't the particular current players, but where the game is headed.

SI/LW were and are important to the degree that they are an educated and good faith source of optimization pressure on the outcome of the singularity. Think of a sort of consequentialist litany... If it brings about better aggregate time-integrated outcomes for mainstream audiences to take the singularity seriously then I want mainstream audiences to take the singularity seriously. If it brings about worse aggregate time-integrated outcomes for mainstream audiences to take the singularity seriously then I do not want mainstream audiences to take the singularity seriously.

The real question is how and when contact with "real politics" will affect the trajectory and outcome of the singularity. If "serious" attention is predicted by sound methods to have bad consequences, the people involved could start wearing clown noses and talking about geek rapture (or whatever). If "serious" attention were good the people involved could do otherwise.

I suspect (but am not sure) that part of why Eliezer has been doing the Harry Potter schtick is to hold off seriousness for as long as possible. In the creation of this community he's shown himself to have interesting levels of socio-political foresight. You don't need to be face-to-face with someone to "aumann update" on their apparent conclusions.

comment by JoshuaZ · 2012-06-12T18:03:11.618Z · LW(p) · GW(p)

Not much to almost any of these except possibly the last. Singularity related ideas are getting a lot more press than they did a few years ago especially through a Kurzweillian lens. Kurzweil's book was a best seller.

comment by JoshuaFox · 2012-06-12T18:17:40.185Z · LW(p) · GW(p)

Wow! the author has read a lot of SI material, including some not meant for a popular audience, and seems to understand it. That is the best mainstream write-up of SI I have seen so far.

I realize that Beck's job is political pontification (I had to look up whether he was 'right' or 'left', not that it matters), but this is a very good sign.

Bringing FAI into mass discussion is not valuable in itself, and may be harmful, but social acceptability for the ideas is important in 'allowing' the smart and rich people to get involved -- not every smart or rich person is willing to swim against the current.

Replies from: Jack
comment by Jack · 2012-06-12T18:43:26.321Z · LW(p) · GW(p)

I struggle to think of an idea that Beck's endorsement would improve the social acceptability of. He is a fringe political figure (to the point where he lost his Fox News show). Associating AGI with Beck makes the idea less socially acceptable in the communities most smart and rich people are found.

Edit: So this comment is getting downvotes. Which is interesting because I intended to be making the exact same argument that I made in this part of the thread in comments that are heavily upvoted. I'm guessing the rhetoric in this comment somehow comes off as politically mind-dead in a way those other comments don't. That's either accidental or leaking from cached thoughts I developed when I was heavily political. I don't care about the downvotes but I am really curious to know what word choices resulted in that overly-political impression since I don't think the point in this comment is denotationally different from those in the other two.

Replies from: MileyCyrus, GLaDOS, JoshuaFox
comment by MileyCyrus · 2012-06-12T23:24:57.866Z · LW(p) · GW(p)

I think your post was entirely reasonable. At first I was like, "Why would Glen Beck haters care if Glen Beck endorses the SIAI? But then I remembered that I wasn't a Glen Beck hater. For me, the equivilant of Glen Beck would be someone like Roissy in DC. If Roissy endorsed the SIAI... well I'd probably keep giving but it would take away some of the joy.

Donors affiliate.

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T05:05:53.413Z · LW(p) · GW(p)

For me, the equivilant of Glen Beck would be someone like Roissy in DC. If Roissy endorsed the SIAI... well I'd probably keep giving but it would take away some of the joy.

I don't have anything against Beck personally (although I think his specific views are hilariously silly & short-sighted & ethically blind), but I too would understand if many people about as left of center as me ideologically would be repelled by such a connection. We must tread carefully; LWers suck at politics.

Replies from: Jack
comment by Jack · 2012-06-13T15:09:52.510Z · LW(p) · GW(p)

LWers suck at politics.

LWers are great at politics. It's just that politics suck for LWers.

Edit: Since my meaning wasn't clear: Mind-killing is a feature not a bug of politics. It is not a truth-seeking activity and getting caught up in the signaling, the motivated thinking and the tribalism is not "being bad at politics". It's the opposite.

Replies from: MatthewB
comment by MatthewB · 2012-08-09T05:49:22.210Z · LW(p) · GW(p)

I think the comment that LWer suck at Politics is the more apt description.

Politics is the art of the possible, and that it deals with WHAT IS, regardless of whether that is "rational."

And attempting to demand that it conform to rationality standards dictated by this community guarantees that this community will lack political clout.

Especially if it becomes known that the main beneficiaries and promoters of the Singularity have a particularly pathological politics.

Peter Thiel may well be a Libertarian Hero, but his name is instant death in even mainstream GOP circles, and he is seen as a fascist by the progressives.

Glenn Beck is seen as a dangerous and irrationally delusional ideologue by mainstream politicians.

That sort of endorsement isn't going to help the cause if it becomes well known.

It will tar the Singularity as an ideological enclave of techno-supremists.

NO ONE at Less Wrong seems to be aware of the stigma attached to the Singularity after the performance of David Rose at the "Human Being in an Inhuman World" conference at Bard College in 2010. I was there, and got to witness the reactions of academics and political analysts from New York and Washington DC (some very powerful people in policy circles) who sat, mouths hanging aghast, at what David Rose was saying.

When these people discover that Glenn Beck is promoting the Singularity (and Glenn Beck has some very specific agendas in promoting it, that are very selfish and probably pretty offensive to the ideals of Less Wrong) these people will be even more convinced that the Singularity is a techno-cult composed of some very dangerous individuals.

comment by GLaDOS · 2012-06-12T20:44:33.198Z · LW(p) · GW(p)

Peter Theil the current main donor probably dosen't mind at all. I think potential very rich donors are more like Thiel and less like say Buffet or Gates.

comment by JoshuaFox · 2012-06-13T18:53:44.706Z · LW(p) · GW(p)

Jack, I get your point and agree with you. I have seen reasonable positions get hijacked by the sincere endorsement of people whose politics is distasteful to others. Without reference to what we personally think about Beck, it is possible that his endorsement will polarize people as they decide to be for or against SI according to their politics.

comment by Jack · 2012-06-12T17:19:55.418Z · LW(p) · GW(p)

Not sure this constitutes good publicity.

Replies from: shminux, wedrifid, magfrump, CarlShulman, bramflakes
comment by shminux · 2012-06-12T17:38:58.125Z · LW(p) · GW(p)

Why? The guy is far from stupid and he preaches to the segment of the US population not generally interested in browsing this forum.

Replies from: Jack
comment by Jack · 2012-06-12T18:01:18.880Z · LW(p) · GW(p)

He has a extremely poor reputation among a large pool of potential donors, employers, policy-makers, academics and 'serious' people. If you want your ideas taken seriously he is not the figure to have introduce them to the general public. This is true regardless of what his reputation ought to be.

Replies from: RobertLumley
comment by RobertLumley · 2012-06-12T18:19:51.681Z · LW(p) · GW(p)

But the vast majority of people reading his book will have a positive opinion of him.

Replies from: Jack
comment by Jack · 2012-06-12T18:36:12.369Z · LW(p) · GW(p)

Yes, but most people reading his book are considerably less important (at least, for my purposes) than people watching Laurence O'Donnell when he spends five minutes next week making fun of Glen Beck's book. Or Maureen Dowd's column when she does the same. Obviously if this is just a few pages in a little noticed book there is no problem with it at all (it's basically neutral). If Beck decides to spend a lot of time talking about it, to the point that it becomes identifiable as "one of Beck's ideas", that would be bad. I don't have a well-calibrated idea of how much publicity Beck gets these days or how often he puts out books which is why I'm unsure of the effect.

Replies from: EternalArchon, RobertLumley
comment by EternalArchon · 2012-06-12T20:41:17.165Z · LW(p) · GW(p)

These seem like low probability concerns

  • Beck is on the air hours a day, and he has put out about 20 books, with no end in sight. He was a wild-morning radio disc jokey and still uses that bombastic style, and never scrips out what he is going to say. His opponents just cut out tiny samples- the least politically correct stuff, to slam him with. Its very unlikely that Blue team commentators would ever get around to something this serious, when there are far more juicy bits.

  • This section mentions Kurzweil enough times (over 10 times), with other names, to make it very clear to anyone that this isn't 'beck's' idea.

  • Beck's main 'sciencey' project he constantly promotes, funds, and fundraisers for is a cancer treatment where the patient is injected with metal nano particles that bond to the malignant tissue. The particles heat up under radio waves, bursting theses cells, leaving the rest of the body untouched. I've seen no evidence of other media outlets connecting this project with him, or any mention of this association at all.

It is my prediction that this will be ignored, as his critics have more to gain by ignoring any pro-sciencey Beck association.

Replies from: Jack
comment by Jack · 2012-06-12T20:50:05.376Z · LW(p) · GW(p)

This evidence is sufficient for me to update to your level of concern.

comment by RobertLumley · 2012-06-12T18:37:28.642Z · LW(p) · GW(p)

He puts out books fairly frequently, I believe. I can't attest to anything else. It's been years since I paid attention to him.

comment by wedrifid · 2012-06-13T03:59:39.692Z · LW(p) · GW(p)

Not sure this constitutes good publicity.

It does, however, constitute good evidence of the success of other publicity.

comment by magfrump · 2012-06-13T17:30:51.486Z · LW(p) · GW(p)

I really enjoyed the debate following this comment; both in that I felt it was necessary, and also in that it was resolved very quickly and elegantly.

comment by CarlShulman · 2012-06-12T18:23:18.459Z · LW(p) · GW(p)

Oy.

Replies from: JoshuaFox, lukeprog, JoshuaFox
comment by JoshuaFox · 2012-06-13T18:55:24.265Z · LW(p) · GW(p)

Is this "Oy, we're in trouble, just like Jack says," or "Oy, Jack just said something stupid"?

comment by lukeprog · 2012-06-12T22:24:32.657Z · LW(p) · GW(p)

I don't know what "Oy" means. Can you clarify?

Replies from: Dr_Manhattan, Will_Newsome, Jack
comment by Dr_Manhattan · 2012-06-13T01:26:03.841Z · LW(p) · GW(p)

"Oy"-ignorance is what identifies you as a non-NY LessWrongian :-p

comment by Will_Newsome · 2012-06-12T22:47:12.196Z · LW(p) · GW(p)

Traditionally, "an exclamation typically expressing mild frustration or expressing feelings of uncertainty or concern."

Replies from: wedrifid
comment by wedrifid · 2012-06-13T01:35:05.119Z · LW(p) · GW(p)

I had thought that exclamation was spelled "Oi!"

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T03:16:08.852Z · LW(p) · GW(p)

Nah, that means like "hey!", I think. You might've reversed the two.

comment by JoshuaFox · 2012-06-12T18:38:40.864Z · LW(p) · GW(p)

I follow American politics pretty closely, but am tone-deaf to some of the responses to this post.

Jack apparently is saying "Beck has a particular ideology and a mass audience and so this will embroil us in politics."

Is Carl is saying "Leave off the politics already, it's good to have the write-up," or "Yes, you're right"?

comment by bramflakes · 2012-06-12T17:50:36.298Z · LW(p) · GW(p)

Understatement of the century.

Replies from: Will_Newsome, Karmakaiser
comment by Will_Newsome · 2012-06-13T03:57:06.214Z · LW(p) · GW(p)

Overstatement of the... thread.

comment by Karmakaiser · 2012-06-13T05:26:56.987Z · LW(p) · GW(p)

Disregard me: This is an inaccurate statement, not an understatement. I still maintain the understatement of the century probably happened sometime around WWII.

Better candidate:

This morning I had another talk with the German Chancellor, Herr Hitler, and here is the paper which bears his name upon it as well as mine.... We regard the agreement signed last night and the Anglo-German Naval Agreement, as symbolic of the desire of our two peoples never to go to war with one another again. - Neville Chamberlain

Replies from: ciphergoth
comment by Paul Crowley (ciphergoth) · 2012-06-13T06:43:20.940Z · LW(p) · GW(p)

Your overall point is well taken, but you're interpreting "century" to mean "last hundred years". The way I'd interpret the word, this is a candidate for understatement of the last century. And the winner was probably somewhere near the Trinity test...

Replies from: Karmakaiser
comment by Karmakaiser · 2012-06-13T06:45:49.923Z · LW(p) · GW(p)

"Now I am become Death, the destroyer of worlds." Strikes me as just statement statement not over or under (I'm assuming this is your reference?)

Replies from: ciphergoth, NancyLebovitz
comment by Paul Crowley (ciphergoth) · 2012-06-13T06:49:05.621Z · LW(p) · GW(p)

No, I'm referring to the fact that before the Trinity test lots of people greatly underestimated what the yield would be. Someone must surely have said "it will be a little bigger than our conventional bombs".

Replies from: Multiheaded, Karmakaiser
comment by Multiheaded · 2012-06-15T07:19:16.370Z · LW(p) · GW(p)

There's a famous story about Trinity where the scientists all bet on the blast magnitude, and a visiting general made a ridiculously huge prediction, way above what they hoped for, in order to flatter his hosts. He won; the blast was still far more powerful than his seemingly fanciful, signaling-motivated guess but he came the closest.

comment by Karmakaiser · 2012-06-13T06:59:28.784Z · LW(p) · GW(p)

It will go boom and look bright. I dunno what else, I just clear the floors.

comment by NancyLebovitz · 2012-06-14T15:29:11.358Z · LW(p) · GW(p)

Atomic bombs aren't much good for destroying one world, let alone worlds in general.

Replies from: faul_sname
comment by faul_sname · 2012-08-06T00:57:01.116Z · LW(p) · GW(p)

Sure they are. You're not being creative enough if you can't figure out how (hint: they can affect the orbital trajectories of some pretty large objects, which can themselves affect the orbital trajectories of some really big objects).

comment by GLaDOS · 2012-06-12T20:35:51.807Z · LW(p) · GW(p)

This breaks my model. I mean Beck is a libertarian and libertarians are more friendly than average to transhumanist ideas. Also he is a Mormon, another group memetically compatible with transhumanism.

Still.

I would like confirmation of this text, it may be a hoax.

Replies from: billswift
comment by billswift · 2012-06-13T00:54:51.770Z · LW(p) · GW(p)

I would have thought a LessWrongian would at least not provide a clear and obvious case of confirmation bias.

Replies from: orthonormal
comment by orthonormal · 2012-06-13T15:08:18.736Z · LW(p) · GW(p)

No, confirmation bias would be if the comment thread were full of people saying "of course Glenn Beck signs off on Singularitarian ideas, this makes perfect sense according to my model of politics" rather than "what the fuck, this breaks my model, I think I'm being trolled somehow".

Replies from: Will_Newsome, Quinn
comment by Will_Newsome · 2012-06-13T18:57:07.357Z · LW(p) · GW(p)

(It might be worth reiterating that Glenn Beck is Mormon and into eschatology, so his singularitarianism is almost expected. I think the only big surprise is that SingInst's publication strategy has apparently been rather successful.)

Replies from: None
comment by [deleted] · 2012-06-13T19:03:29.020Z · LW(p) · GW(p)

Yes, this.

It's also worth noting that because Glenn Beck is a Mormon, we have ample evidence that his belief in the singularity (if he believes in it at all -- this could still very well be a ghostwriter talking) is not a carefully considered belief. If he can convince himself of Mormonism, he is very well capable of convincing himself of just about anything.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T19:15:58.989Z · LW(p) · GW(p)

If he can convince himself of Mormonism, he is very well capable of convincing himself of just about anything.

Eh. Few "beliefs" and "belief-systems"—or more accurately, decision-policy-systems and social-signaling-systems—are as attractive as Mormonism. I don't think being Mormon is a sign of low epistemic standards so much as a sign of high instrumental rationality.

Furthermore I think Glenn Beck or his ghostwriter understands the Singularity's political situation better than most LWers. That said I've never heard or read anything by Glenn Beck except the above excerpt.

Replies from: stcredzero, None, Blueberry, Multiheaded
comment by stcredzero · 2012-06-13T19:32:31.852Z · LW(p) · GW(p)

Eh. Few "beliefs" and "belief-systems"—or more accurately, decision-policy-systems and social-signaling-systems—are as attractive as Mormonism. I don't think being Mormon is a sign of low epistemic standards so much as a sign of high instrumental rationality.

Without a single exception, every convert to Mormonism I've met (and this includes several colleagues) professes to have converted because they find Mormons to be kind, conscientious, and positively directed people.

I suspect this is how most people evaluate membership in a community. The "beliefs" and "belief-systems" are somewhat arbitrary to most, like the colors on the jerseys of sports teams.

In fact, in a population where most professed "beliefs" and "belief-systems" are mainly signals of group affiliation and less subjects for serious thought, this is arguably a more rational way of evaluating the desirability of group membership.

Replies from: bradleyt
comment by bradleyt · 2012-06-13T20:20:17.037Z · LW(p) · GW(p)

I grew up Mormon and attended BYU for a few years, and a lot of descriptions of Mormons I read on here are completely foreign to me. Knowing that the LDS Church was literally true was always an extremely important aspect of the religion when I grew up--it wasn't just about the community.

I suspect that the types of Mormons that people on LessWrong tend to come in contact with are very much outside the mainstream. While I can see that Mormon theology can be twisted to support a sort of trans-humanism, in my experience the typical Utah Mormon would find this very bizzarre.

Replies from: stcredzero
comment by stcredzero · 2012-06-13T21:08:57.369Z · LW(p) · GW(p)

I grew up Mormon and attended BYU for a few years, and a lot of descriptions of Mormons I read on here are completely foreign to me. Knowing that the LDS Church was literally true was always an extremely important aspect of the religion when I grew up--it wasn't just about the community.

I think this is rather typical and also age and personal development related. As a child, I was a staunch believer of my Catholic Sunday school teachings, to the point where I found my parents to be alarmingly lax and contrary. This changes for lots of people as they get older. In my 30's I had a girlfriend who described herself as a "cultural Catholic" and basically went to church because it's what most of the people she knew did.

In any case, at the local Hackerspace, I found that most everyone professed beliefs in the importance of science and rationality, but much of this is indistinguishable from professing a preference for a genre of music or a type of gaming. As far as people rigorously applying rationally grounded beliefs to their own lives, I don't think much was done which couldn't be comfortably explained as people generally doing what their peers do.

I suspect that the types of Mormons that people on LessWrong tend to come in contact with are very much outside the mainstream.

My Mormon colleagues were all working for software companies.

While I can see that Mormon theology can be twisted to support a sort of trans-humanism, in my experience the typical Utah Mormon would find this very bizarre.

The typical human being finds trans-humanism bizarre. Most people are just doing what those around them are doing, saying what those around them are saying, and generally just getting on with their day to day lives.

Perhaps we should hold our leaders to a higher standard.

comment by [deleted] · 2012-06-13T19:50:24.833Z · LW(p) · GW(p)

Few "beliefs" and "belief-systems"—or more accurately, decision-policy-systems and social-signaling-systems—are as attractive as Mormonism.

You're claiming all religious beliefs reduce to decision policies and social signals? That's pretty cynical, even for you.

I don't think being Mormon is a sign of low epistemic standards so much as a sign of high instrumental rationality.

It can't be both? (Not that I see its "high instrumental rationality" either.)

Furthermore I think Glenn Beck or his ghostwriter understands the political situation better than most LWers. That said I've never heard or read anything by Glenn Beck except the above excerpt.

Bleh. If I wanted to argue the merit of X's thought to people who hadn't read X, I'd go harass XiXiDu on G+. Consider me tapped out.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T19:57:18.348Z · LW(p) · GW(p)

You're claiming all religious beliefs reduce to decision policies and social signals? That's pretty cynical, even for you.

Not all, just a pretty big chunk, especially among Mormons. I guess I didn't think of it as "cynical". That's a weird word.

It can't be both? (Not that I see its "high instrumental rationality" either.)

'Course it can. But the existence of two causal factors makes it hard to determine which of the two causal factors contributed most of the causal juices to our observation, such that "low epistemic standards" isn't quite as obviously a big factor.

I edited my comment to "Singularity's political situation". I didn't mean to imply Beck has a good political model more generally. Priors say he doesn't.

comment by Blueberry · 2012-10-23T07:56:25.582Z · LW(p) · GW(p)

How is Mormonism attractive? You don't even get multiple wives anymore. And most people think you're crazy.

comment by Multiheaded · 2012-06-13T20:22:46.934Z · LW(p) · GW(p)

Eh. Few "beliefs" and "belief-systems"—or more accurately, decision-policy-systems and social-signaling-systems—are as attractive as Mormonism.

Well, about the only thing I know about most Mormons - besides the now-incorrect notion of polygamy - is that they'd hate on my entirely consensual, loving union with my boyfriend - so kindly forgive me for pattern-matching their beliefs to awful Unfriendly shit and dropping them somewhere around Maoism and Wahabbism in priority of thorough, "in-algorithm" assessment!

There are also many gay Mormons who wish to overcome their same-sex attraction in order to have a successful eternal marriage and gain all the blessings promised by the Lord. It is a long and difficult struggle to change one's sexual orientation, but despite the denial of many pro-gay groups and psychologists, there are many formerly gay Mormons that have done it.

Cool torture bro! No, seriously, how is this deceitful manipulation of followers and unwilling dependents not evil, awful and sick?

Replies from: Alicorn, Eugine_Nier, Will_Newsome
comment by Alicorn · 2012-06-13T20:40:40.216Z · LW(p) · GW(p)

besides the trademark polygamy

This is no longer a feature of the mainstream Mormon church (and has not been for a rather long time) except as regards sealing to a second wife after the first one has died. Spreading misinformation about groups you personally dislike is a bad mindkilling behavior.

Replies from: bradleyt, Multiheaded
comment by bradleyt · 2012-06-13T20:51:06.806Z · LW(p) · GW(p)

This is completely true, although it's probably worth pointing out that Mormons believe marriage is eternal, so in the afterlife polygamy still exists.

Replies from: Alicorn
comment by Alicorn · 2012-06-13T21:04:12.549Z · LW(p) · GW(p)

Yes, thence my remark about sealing.

comment by Multiheaded · 2012-06-13T20:47:50.883Z · LW(p) · GW(p)

Cached thought! Cached thought! Aborted.

comment by Eugine_Nier · 2012-06-14T01:15:05.684Z · LW(p) · GW(p)

Cool torture bro!

Would you mind explaining why helping people who want to change their sexual orientation is "torture"?

No, seriously, how is this deceitful manipulation of followers

I advise,

you manipulate.

Seriously, I don't see what the word "manipulate" is doing in that sentence besides sneaking in connotations.

Replies from: Multiheaded
comment by Multiheaded · 2012-06-14T02:20:02.306Z · LW(p) · GW(p)

To both points: this thing is done to victims (in this case gay Mormons & family) by people with great emotional leverage over them - friends, family, clerics - and not just random disapproving strangers. Have your family ever guilt-tripped you? If it did, you'd surely agree that it's emotional torture, when people you care about are pulling at your heartstrings until you "change".

comment by Will_Newsome · 2012-06-13T20:29:33.038Z · LW(p) · GW(p)

Seems like a sweeping generalization. I know many Mormons who would merely quietly disapprove of such a union at most. Let he who is without sin cast the first stone, and what not.

Heh, you know, it'd be funny if that passage went like, "Let he who is without sin cast the first stone. ...Wait, that's me, isn't it? ...Shit. /thusbeginsthestoningofthewhore"

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T20:38:02.156Z · LW(p) · GW(p)

Then what the fuck is so good about official Mormon dogma, if people are forced to filter and compartmentalize a significant teaching of their God's own prophets just not to behave and think like bigoted scumbags?

I think that e.g. liberal secular humanism doesn't have any such glaring flaw - at least not for the average person (thorough/neurotic thinkers who obsess over the meaning of life not included - perhaps you indeed need something others would call fundamentalism, and perhaps, in a lesser way, do I).

A choice between "Wouldn't it be nice if everyone was nice, just because" and "Omega will give you heaps of utility, but it hates normal, socially affordable behaviors X, Y, Z" is very obvious for me.

Replies from: Will_Newsome, Will_Newsome
comment by Will_Newsome · 2012-06-13T20:43:07.949Z · LW(p) · GW(p)

Then what the fuck is so good about official Mormon dogma, if people are forced to filter and compartmentalize a significant teaching of their God's own prophets just not to behave and think like bigoted scumbags?

Provides Schelling points for socio-political coordination. You think the suffering of a few gays outweighs all the benefits of cooperation provided by Mormon institutions? Puh-lease.

/trolololol

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T20:46:18.868Z · LW(p) · GW(p)

Even if it does, this is a freakish, unacceptable cost for me, along with slut shaming and other such cruelly restrictive shit. And your socio-political coordination simply wouldn't take off as long as a proportion of the elites are on my side of these issues - you first need at least a pretense of consensus.

(I realize, of course, that you're saying all this in a spirit of curiosity and wouldn't actually work against today's mainstream ethics in their more solid aspect. This is a purely friendly conversation.)

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T20:50:00.706Z · LW(p) · GW(p)

Hm? I'm talking about already-existent benefits. Mormons are like the happiest, most fulfilled, most transhumanist-friendly people on the planet, and they're rapidly spreading those memes throughout the world. Maybe you have a deontological soft-spot for gays, or you have an egoistic preference for the wellbeing of gays. But from a right and proper utilitarian standpoint, Mormonism is a huge win.

/trolololol

Replies from: bradleyt, Multiheaded
comment by bradleyt · 2012-06-13T20:52:48.901Z · LW(p) · GW(p)

I am an ex-Mormon who attended BYU. Your description of Mormons is completely foreign to me.

Replies from: Jayson_Virissimo, Will_Newsome
comment by Jayson_Virissimo · 2012-06-14T12:28:50.141Z · LW(p) · GW(p)

Your mutually contradictory anecdotes cancel each other out, but even a casual glance at the statistics seems to confirm Will's view that Mormon's are particularly functional members of society. Compared to non-Mormons, Mormon's are more likely to graduate from college, less likely to be diagnosed with alchoholism, less likely to commit a felony, less likely to get divorced, less likely to smoke, less likely to suffer from depression, etc...

comment by Will_Newsome · 2012-06-13T20:55:54.311Z · LW(p) · GW(p)

Well, you would know. Personally I've met maybe a hundred Mormons and noticed a distinct tendency towards apparent overall happiness, social wellbeing, et cetera. FWIW most of the Mormons I know are from Tucson, and some of them look on the Utahans as being a somewhat separate tribe.

It's probably like zero information, but the only Mormon who I know went to BYU, also happened to be the surliest one.

(And obviously this is all modulo huge selection effects on who I've met. I don't exactly live a normal life.)

Replies from: bradleyt
comment by bradleyt · 2012-06-13T21:21:51.357Z · LW(p) · GW(p)

Yeah, I'm most familiar with Utah/Idaho Mormons who tend to be on the more extreme spectrum. The problem is that these are the guys who hold the power in the Church.

Something that hasn't been mentioned is that Mormons give 10% of their income to the church. AFAIK, the vast majority goes into building and maintaining churches and large, extravagant temples, and a very small portion actually goes to real charitable work. If you could convince a Mormon to leave the church but still donate 10% of his income to a more effective charity, I think you'd end up doing a lot more good from a utilitarian perspective.

It's also pretty well-known that the state of Utah has an abnormally high rate of mental illness, and a lot of people suggest that Mormons often claim that they're a lot happier than they really are. I tend to agree: as a Mormon, you're taught all the time about how the Church is so great and how it's the best path to happiness, so you're naturally going to want to appear happy to other people.

My hunch is that Mormonism tends to make certain people a lot happier and other people more depressed. I definitely fell into the latter group--when I was Mormon I was constantly wracked with guilt because I--gasp--masturbated. At the same time, because I held the Mormon priesthood, I was essentially told that I had magical powers, and that I had more authority to act in God's name than the Pope. So I think for some people Mormonism is a big guilt trip, and for others it's a big power trip. Both are unhealthy.

Replies from: NancyLebovitz
comment by NancyLebovitz · 2012-06-14T16:28:15.476Z · LW(p) · GW(p)

From a relatively outside view (my upbringing was semi-secular Jewish), belief in heaven and hell is really strong stuff for some proportion of people-- I'm not sure how high the proportion is, but people can make themselves acutely miserable from fear of hell and/or fear of not getting into heaven.

Replies from: bradleyt, TheOtherDave
comment by bradleyt · 2012-06-14T19:00:30.293Z · LW(p) · GW(p)

To be fair to Mormons, they don't have the concept of an eternal hell like most Christian fundamentalists. There is something called "outer darkness", but you'd have to work really, really hard to get there--like, harder than Hitler.

comment by TheOtherDave · 2012-06-14T16:42:37.540Z · LW(p) · GW(p)

To be fair, some people can also make themselves acutely miserable from fear of not being asked to the prom. It's hard to overestimate people's ability to make ourselves acutely miserable; it's not entirely clear to me that the causes we attribute that misery to are at all causal to it.

comment by Multiheaded · 2012-06-13T20:56:10.302Z · LW(p) · GW(p)

Maybe you have a deontological soft-spot for gays, or you have an egoistic preference for the wellbeing of gays.

Not for gays specifically, of course, just for all minorities who share the "born that way but can be broken into a different mold by torture+brainwashing" pattern. If Mormons tried those "shaming" tactics, etc on, say, opponents of transhumanism or borderline-autistic geeks, I'd speak out for those. Because I feel that, socially, manipulating people like that is a line that should not be crossed.

Well, of course I take it personally being bisexual myself, but still - I spoke out for gay rights even before I realized my own sexuality, just because it always looked like a glaring injustice to me.

Replies from: Will_Newsome, Emile, Eugine_Nier
comment by Will_Newsome · 2012-06-13T20:58:56.037Z · LW(p) · GW(p)

Aren't you currently shaming Mormonism? Not tolerating intolerance isn't exactly self-defeating, but if you look at the antifa guys, you really start to wonder whether that's a path you want to go down.

Replies from: Multiheaded
comment by Multiheaded · 2012-06-13T21:10:00.052Z · LW(p) · GW(p)

I might be, but that's basically throwing rocks at a mob to protect/avenge the "whore" they're stoning. This said, I'd defend their right to be bigoted or Nazi or pedophiles or whatever in their own minds and in conversations between ideologically similar folks - just as long as the problematic meme doesn't harm a real person or spread its poison.

comment by Emile · 2012-06-13T21:24:24.324Z · LW(p) · GW(p)

Not for gays specifically, of course, just for all minorities who share the "born that way but can be broken into a different mold by torture+brainwashing" pattern.

That description would cover psychopaths, alcoholics, people with anger management problems, etc. - and in their case, the brainwashing seems much more justified if it works. It might even justify the occasional "fixing" of someone that doesn't need to be fixed (though I don't know if that's the case for Mormonism).

Replies from: Multiheaded
comment by Multiheaded · 2012-06-14T02:27:10.648Z · LW(p) · GW(p)

Obvious caveat: the above is for "socially affordable" minority behavior. "Socially affordable" means basically "the kind that doesn't in its essense hurt other people too badly". Gays don't, (many) Muslims don't, weed smokers don't, psychopaths do. There are borderline cases, but the harm principle is pretty easy to use here overall.

comment by Eugine_Nier · 2012-06-14T01:27:00.154Z · LW(p) · GW(p)

Could you taboo what you mean by "torture+brainwashing".

Replies from: Multiheaded
comment by Multiheaded · 2012-06-14T02:23:48.169Z · LW(p) · GW(p)

See my other reply; it's aggressive influence by people in a position of emotional power - influence that has no justifiable social goal.

Replies from: Jayson_Virissimo
comment by Jayson_Virissimo · 2012-06-14T12:02:56.625Z · LW(p) · GW(p)

See my other reply; it's aggressive influence by people in a position of emotional power - influence that has no justifiable social goal.

So, by "torture+brainwashing", you mean persuasion? Your terminology is slightly confusing, to say the least.

comment by Will_Newsome · 2012-06-13T20:52:15.158Z · LW(p) · GW(p)

(Oh yeah, maybe I should disclose that I just met a very pretty, very sexist, very Confederate Mormon girl who happens to play a lot of Diablo 3. So uh, I'm feeling a little bit pro-Mormon as of a few days ago. :P )

Replies from: khafra
comment by khafra · 2012-06-14T13:58:07.877Z · LW(p) · GW(p)

Should we also expect you to be

  1. more pro-sexism and pro-confederacy because she's pretty

  2. more pro-confederacy and pro-beauty because she's sexist

  3. more pro-beauty and pro-sexism because she's confederate

  4. more pro-sexism because she's confederate and pretty

  5. more pro-confederacy because she's sexist and pretty, or

  6. more pro-beauty because she's sexist and confederate?

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-16T02:26:09.851Z · LW(p) · GW(p)

That's hard to think about. You'd think the answer would be "yes" to all of them, modulo errors of double-counting, but I don't actually know.

comment by Quinn · 2012-06-14T02:45:40.029Z · LW(p) · GW(p)

But orthonormal, your example displays hindsight bias rather than confirmation bias!

I interpret billswift's comment to mean:

GlaDOS, you should not just seek confirmation of the legitimacy of the text; you should also seek refutation.

(Or possibly it was meant the other way around?)

In any case, I agree that billswift's comment is off-base, because GLaDOS' comment does not actually show confirmation bias.

comment by RobertLumley · 2012-06-12T18:18:30.151Z · LW(p) · GW(p)

Hm. This is very interesting to me. I think I am more surprised by Beck coming out for this than I should be. I used to listen to him, when he was far less popular and before he started predicting the end times and being generally insane. I don't necessarily think that Beck believes all of the things that he says, but that he knows that being outlandish brings him more success. And, accurate or not, the singularity is considered outlandish to the average person right now.

But I'm glad for the publicity. It's not like he said anything in that excerpt that I particularly disagree with - which surprised me, given the topic and his religious proclivities. And the vast majority of people reading his book will have a positive opinion of him, as opposed to a negative one, which will lead to more respect and interest in SI, not less.

Let's just make sure if anyone comes to LW referred by Glenn Beck we point to to Politics is the Mindkiller ASAP.

Edited to add: It would have been really interesting to see people's opinions of this if you had withheld the author and not told us until later.

Replies from: orthonormal, Tuxedage
comment by orthonormal · 2012-06-13T14:58:44.277Z · LW(p) · GW(p)

It would have been really interesting to see people's opinions of this if you had withheld the author and not told us until later.

Somehow, I read the excerpt without noting the author. I got about halfway through it and thought it must be a piece that some relatively new Less Wronger had gotten published in a local paper somewhere (i.e. half-decent but not really high-quality, and obviously edited for mainstream publication). Then I looked back at the top and thought,

what.

comment by Tuxedage · 2012-06-12T18:38:45.707Z · LW(p) · GW(p)

Similarly. My previous beliefs about Glen Beck points towards a devout Christian fundamentalist. I would not have considered the fact that he would support the singularity, much less take it seriously. It seems I have to update my beliefs quite a bit.

Replies from: albeola, MatthewB
comment by albeola · 2012-06-12T20:26:17.978Z · LW(p) · GW(p)

Beck is a Mormon, and Mormons generally seem a lot friendlier to transhumanist-type ideas than standard Christians.

Replies from: Grognor
comment by MatthewB · 2012-08-09T05:52:02.016Z · LW(p) · GW(p)

He believes that the Singularity is proof that the Universe was created by an Intelligent Creator (who happens to be the Christian God), and that it is further evidence of YEC.

comment by buybuydandavis · 2012-06-13T00:08:01.586Z · LW(p) · GW(p)

With self-improving AI we may be able to eradicate suffering and death just as we once eradicated smallpox.

It's one thing to be for technological progress - quite another to be for eradicating Death. Sign that man up for the Bayesian Conspiracy.

comment by CaveJohnson · 2012-06-12T20:24:24.818Z · LW(p) · GW(p)

People talking about how low status Glenn Beck is need to realize that numerically far more people take Glenn Beck seriously than Kurzweil. Just because the Brahmin (Moldbug's terminology) hate him, dosen't mean he isn't influential and popular in among the class of people who find themselves vulnerable to be mislead to react badly to the Singularity.

Replies from: Jack, MatthewB
comment by Jack · 2012-06-12T21:34:08.027Z · LW(p) · GW(p)

We realize that. We just care a lot more about the the views of the Brahmin than your second class of people. Which class of people has the larger microphone? Which class has the money? Which class produces mathematicians? Etc.

Replies from: Manfred, CaveJohnson, Eugine_Nier
comment by Manfred · 2012-06-13T02:39:40.060Z · LW(p) · GW(p)

the Brahmin

I believe you mean "the Broheim."

comment by CaveJohnson · 2012-06-13T05:40:40.440Z · LW(p) · GW(p)

We just care a lot more about the the views of the Brahmin than your second class of people.

Than you for catching the typo. Also I find it refreshingly honest that you acknowledge reality of this.

Which class of people has the larger microphone? Which class has the money?

Yes they by definition don't control the media or academia, their material resources aren't trivial but it is impossible for them to coordinate, since any organization they create to defend their interests will be subverted or marginalized.

Which class produces mathematicians?

The class produces its fair share of mathematicians. In absolute numbers I'd say more than the upper classes.

Replies from: Jack
comment by Jack · 2012-06-13T14:00:59.441Z · LW(p) · GW(p)

Than you for catching the typo. Also I find it refreshingly honest that you acknowledge reality of this.

I'm not sure the Moldbuggian taxonomy carves reality at the joints but I have no problem employing it as needed.

The class produces its fair share of mathematicians. In absolute numbers I'd say more than the upper classes.

I doubt it (IQ, heredity), unless you're including Asian immigrant populations. But in any case mathematicians usually spend a good amount of time in university which means, wherever they grew up, by the time they're looking for jobs they're usually firmly entrenched in a brahmin social circle.

Replies from: CaveJohnson
comment by CaveJohnson · 2012-06-13T15:02:43.202Z · LW(p) · GW(p)

Ah I fear I misunderstood you and took "produces" rather too literally. Don't forget that STEM fields are attractive to those who want to climb socially but lack the graces because of their upbringing.

Obviously they retain few of those who go to become mathematicians.

comment by Eugine_Nier · 2012-06-14T00:56:42.116Z · LW(p) · GW(p)

Which class of people has the larger microphone? Which class has the money?

Which class has any incentive to change the status quo? When planning what amounts to a massive reorganization of society, a.k.a., a revolution, you what the support of "the people" since the current upper class likes things the way they are.

Replies from: Jack
comment by Jack · 2012-06-14T01:26:45.953Z · LW(p) · GW(p)

There may or may not be something here but Brahmin are mostly progressives trying to continue ongoing work reorganizing society while the second group (someone remind of what Moldbug calls white people who don't hate Glen Beck?), in so far as they are political, are reactionary and would prefer to return to how society used to be organized.

comment by MatthewB · 2012-08-09T05:38:08.213Z · LW(p) · GW(p)

Being influential is not necessarily a good thing.

Especially when Glenn Beck's influence is in delusional conspiracy theories, and evangelical christianity, and Young Earth Creationism.

comment by grouchymusicologist · 2012-06-12T17:55:13.949Z · LW(p) · GW(p)

The chapter begins with a pretty delightful infelicity, since in 1678 Beethoven's Fifth Symphony was still 130 years away from its premiere. Granted, this is very specialized knowledge available only to professional musicologists like myself and I doubt Beck's publisher can afford my consulting fees.

(I can just imagine the English scientists standing around wondering why this lunatic is inflicting this cacophony on them and looking at them so expectantly.)

Replies from: lukeprog, drethelin, albeola, JoshuaZ, knb
comment by lukeprog · 2012-06-12T18:28:46.057Z · LW(p) · GW(p)

The chapter begins with a pretty delightful infelicity, since in 1678 Beethoven's Fifth Symphony was still 130 years away from its premiere.

If Siri made the journey back in time, why are you surprised that an mp3 of Beethoven's 5th made the journey? Siri was created slightly later than Beethoven's 5th.

Somewhat more amazing is that this iPhone has cellular service in the 17th century, and can make video calls to future people. It must be on Verizon.

Replies from: grouchymusicologist, stcredzero
comment by grouchymusicologist · 2012-06-12T18:44:37.445Z · LW(p) · GW(p)

Well, at the risk of explaining my joke, I only meant to suggest that the opening of the chapter makes it sound like Beck thinks Beethoven's Fifth would have been "famous" and instantly recognizable to Englishmen in 1678. Maybe I should charitably assume that Beck originally had it as "the latest church anthem by Purcell" but his editors made him change it.

Replies from: lukeprog
comment by lukeprog · 2012-06-12T18:58:36.363Z · LW(p) · GW(p)

The wording seems to be ambiguous as to whether it's saying Beethoven's Fifth is "famous" to the readers or "famous" to people in 1678.

comment by stcredzero · 2012-06-13T19:36:03.455Z · LW(p) · GW(p)

Somewhat more amazing is that this iPhone has cellular service in the 17th century, and can make video calls to future people. It must be on Verizon.

This wouldn't violate Einstein's relativity with a wormhole with openings appropriately located in space-time. Ao Apple and Verizon have wormholes in this scenario.

comment by drethelin · 2012-06-12T21:12:06.634Z · LW(p) · GW(p)

pretty sure beethoven's fifth would be impressive coming out of a phone whether or not you knew what it was.

comment by albeola · 2012-06-12T20:38:32.617Z · LW(p) · GW(p)

I see it as being like the Chuck Berry scene in Back to the Future.

comment by JoshuaZ · 2012-06-12T18:01:55.571Z · LW(p) · GW(p)

Or where the "scientists" would come from since that term wouldn't exist for another 150 years or so.

Replies from: grouchymusicologist
comment by grouchymusicologist · 2012-06-12T18:09:47.599Z · LW(p) · GW(p)

He should have brought Archimedes's Chronophone with him instead!

(ugh, I'm sorry for that.)

comment by knb · 2012-06-12T20:24:56.250Z · LW(p) · GW(p)

Umm, actually he doesn't say that they recognized it, just that they would be amazed that it makes music. That seems pretty plausible to me.

Seems like you got mind-killed pretty hard here.

Replies from: thomblake
comment by thomblake · 2012-06-14T20:08:03.687Z · LW(p) · GW(p)

Seems like you got mind-killed pretty hard here.

I think we need something like Wikipedia:Assume_the_assumption_of_good_faith.

comment by A1987dM (army1987) · 2012-06-12T18:46:51.418Z · LW(p) · GW(p)

your seventeenth-century friends would worship you

“Your seventeenth-century friends”? My last-year self didn't fully realize how awesome it would be to have a high-res camera, a satellite navigator, a flashlight with a strobe effect, and an Internet connection always with me. I was so proud to hold onto my Nokia 3330. How silly of me.

Replies from: army1987
comment by A1987dM (army1987) · 2012-06-15T15:09:02.332Z · LW(p) · GW(p)

(Wasn't this comment at -3 shortly after I published it? Or did I hallucinate that?)

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-16T02:10:55.923Z · LW(p) · GW(p)

It was. Many of my comments on this thread underwent a similar reversal.

comment by Kawoomba · 2012-06-13T17:53:26.655Z · LW(p) · GW(p)

Finally, a palpable sign of success! I'm so happy that you guys are finally getting your message across :o)

Replies from: MatthewB
comment by MatthewB · 2012-08-09T05:33:57.929Z · LW(p) · GW(p)

This is not exactly "success."

There are some populations that will pervert the things they get in their hands.

comment by jacob_cannell · 2012-06-12T23:18:05.215Z · LW(p) · GW(p)

This is interesting in what it suggests for the future.

Romney is a conservative mormon, for example.

Beck's rant proposing that the political left is aligned with a nebulous big-government/big-business anti-technological movement may be mostly rhetorical hot air, but it did make me wonder . ..

Well before AGI is super-intelligent, weaker AGI and stronger narrow AI will likely lead to a hugely disruptive socio-economic disruption. This isn't being discussed much (outside of perhaps a lone blog and book or two).

Actually, this transition is already under way. The current slow-burn economic crisis is likely just the beginning. Crisis has a way of sparking political change. What will the masses do when most people have real economic value that is well below subsistence?

Replies from: Karmakaiser, Will_Newsome, stcredzero
comment by Karmakaiser · 2012-06-13T12:59:47.463Z · LW(p) · GW(p)

Beck's rant proposing that the political left is aligned with a nebulous big-government/big-business anti-technological movement may be mostly rhetorical hot air, but it did make me wonder . ..

I get the same feeling with Thiel noticing our lack of techno-optimism in our culture compared with our optimism at 1950. Doesn't he largely blame entrenched interests putting up regulation to stop new start ups?

comment by Will_Newsome · 2012-06-13T19:53:04.212Z · LW(p) · GW(p)

I failed to spark good discussion of that subject with this post on "semi-general" AIs.

Replies from: athingtoconsider
comment by athingtoconsider · 2012-06-15T05:03:09.505Z · LW(p) · GW(p)

Meandering from that post, came across this graph of productivity versus employment. I'm fairly convinced technology is the leading factor in the divergence, even though others mention the financial sector and probably politically-motivated concerns about different presidents.

Not sure if we will experience another industrial revolution scenario of labor devaluation or whether this change will be qualitatively different.

I wonder who will benefit fiscally from booms in non-human productivity, and whether monetary gain will still mean the same thing it recently has.

comment by stcredzero · 2012-06-13T19:21:00.057Z · LW(p) · GW(p)

Well before AGI is super-intelligent, weaker AGI and stronger narrow AI will likely lead to a hugely disruptive socio-economic disruption. This isn't being discussed much...

I have noticed it too: http://lesswrong.com/lw/cxi/peter_thiels_agi_discussion_in_his_startups_class/6s1k

Right at the cusp of change, humans will have tremendous ability to exercise choices about where this all ends up.

What will the masses do when most people have real economic value that is well below subsistence?

Often the choices of the masses in a crisis result in more crisis. I think it's wisest to completely avoid situations where the masses are making choices in crisis.

comment by yli · 2012-06-12T20:54:56.049Z · LW(p) · GW(p)

Beck probably has ghostwriters. That excerpt was probably written by one of them, and could just be something that Beck signed off on because he's vaguely singularity-positive from having interviewed Kurzweil; it might be that Beck never read any of the references, and if that excerpt is is suprisingly high quality, we shouldn't automatically attribute that to him.

Replies from: mwengler
comment by mwengler · 2012-06-12T22:11:01.873Z · LW(p) · GW(p)

OMG you poor fellow! you've got to share your status-marking 'belief' in singularity with Glenn Beck!!!!

Beck may (or may not) be a whackadoodle, but I can't imagine how anybody watching him could doubt the raw firepower. What are the chances a guy like that lets some ding dong research assistant slip views like this past his editorial control? I say they are SUPER LOW.

I'm not even a little a fan of Glenn Beck, learning most of what I know about him by watching Jon Stewart. But I am smart enough to be rejiggering my view of him even as we type. I've already googled Beck+Singularity and seen some of the stuff he has done in the past and it is all consistent with him falling in to the singularity institute stuff.

OMG, what if none of is any saner than Glenn Beck?

Replies from: pragmatist
comment by pragmatist · 2012-06-13T01:01:10.595Z · LW(p) · GW(p)

This is unnecessarily hostile. None of what you say is inconsistent with anything in yli's comment. He/she was not saying that Beck let "some ding dong research assistant slip views like this past his editorial control". The claim was that while Beck in all probability agrees with the broad conclusions of the excerpt, it is unlikely that he personally researched or wrote it. In so far as people are impressed by the specific content of the excerpt (as opposed to the broad conclusions) or by the fact that it quotes SI people, the credit is probably not due to Beck.

In any case, it's not all that surprising to me that Beck is interested in and convinced by Singularity stuff. He has demonstrated a particular penchant for big ideas that are outside the mainstream, counter-intuitive, vaguely apocalyptic, and that posit that one can attain significant analytic and predictive purchase by paying close attention to patterns in global history. Most such ideas are sheer crackpottery. The singularity happens not to be. However, the fact that he believes in it is not an indication of his sanity, it is an indication of his particular brand of insanity.

Replies from: mwengler
comment by mwengler · 2012-06-13T04:06:19.072Z · LW(p) · GW(p)

The concept of the correct amount of hostility is an interesting one to me. My post doesn't seem all that hostile to me, but I don't have many friends, maybe this is why.

Irregardless of hostility, necessary or unnecessary, in the original post I could see no indication of any reason to question Beck's editorial control over the chapter as quoted other than a distaste for being on the same team as Beck. It could just be me (which of course doesn't read on whether I'm correct or not) but I can't imagine such a comment questioning the authorship of a chapter like this if it had come from someone that isn't on the side of the "culture wars" that Beck is on.

I suppose I knew I was going to get negative karma from this post and considered not posting it for that reason, but you know, fuck it. I think its funny that essentially irrational motivations to form hypotheses about authorship are not more karma-objectionable than, more or less, laughing at the irrationality, the self-serving status self-justification of such plausibly (but not) rational objections.

Replies from: Luke_A_Somers, pragmatist
comment by Luke_A_Somers · 2012-06-13T16:23:19.242Z · LW(p) · GW(p)

My post doesn't seem all that hostile to me, but I don't have many friends, maybe this is why.

Hint:

OMG you poor fellow! you've got to share your status-marking 'belief' in singularity with Glenn Beck!!!!

is freaking hostile.

comment by pragmatist · 2012-06-13T06:39:47.248Z · LW(p) · GW(p)

Again, yli didn't (as far as I can tell) question Beck's editorial control over the chapter. He/she questioned Beck's authorship of the chapter, and it is entirely reasonable to do this. It's hardly unheard of for popular media figures to hire ghostwriters; in fact, I suspect it is the norm. I saw an interview of Rachel Maddow promoting her new book where she made a point of stressing that she had written it herself, an odd thing to bring up unless there is an expectation otherwise. Beck is a very busy man. It's implausible that he would have the time to sit down and write the 14 books that have come out under his name over the last 10 years.

Replies from: electricfistula
comment by electricfistula · 2012-08-09T19:29:22.271Z · LW(p) · GW(p)

I think speculation as to the actual author of the above is entirely vacuous. There is a person out there named Glenn Beck who has a job in radio. There is also a personality out there named Glenn Beck who says extreme things and writes lots of books and cries on TV a lot. The Glenn Beck person and the Glenn Beck personality might be the same, or they might not be. I've seen no evidence toward either conclusion, more importantly there doesn't seem to be any functional difference.

So, when someone says that the above is attributed to Glenn Beck they mean the Glenn Beck persona. Whether or not the human being who pressed the keys that caused that quote to exist had "Glenn Beck" printed on his license is unknown, but also entirely irrelevant. The one reasonable concern is that the Glenn Beck person didn't write it, so he will be more likely to shift the mind of the Glenn Beck persona. But, if this is your concern then you should just express it simply and completely "This is atypical of the Glenn Beck persona. I hope it doesn't change its mind about this" and leave it at that.

comment by MichaelAnissimov · 2012-08-09T02:08:15.783Z · LW(p) · GW(p)

These are the kinds of research problems being tackled by the Singularity Institute in America and the Future of Humanity Institute in Great Britain. Unfortunately, our silly species still spends more money each year on lipstick research than we do on figuring out how to make sure that the most important event of this century (maybe of all human history)— the intelligence explosion— actually goes well for us.

Woo woo!

comment by mwengler · 2012-06-12T22:12:58.911Z · LW(p) · GW(p)

I wonder if this content of Glenn Beck's book with so much SI stuff in it is what sent Will Newsome into the deep end without a paddle recently?

Replies from: orthonormal, Will_Newsome
comment by orthonormal · 2012-06-13T15:05:01.953Z · LW(p) · GW(p)

Despite the obviously low base rate, I intuitively felt it was more plausible that Will Newsome is Glenn Beck's ghostwriter than that Beck wrote that excerpt himself.

Replies from: TheOtherDave
comment by TheOtherDave · 2012-06-13T15:45:06.816Z · LW(p) · GW(p)

Many years ago, a friend shared with me the putative fact that the Vatican was, at the time, the largest single stockholder in Johnson and Johnson, which was at the time the world's largest manufacturer of prophylactics. (I have no idea if either of these putative facts were ever actually true.) He went on to explain that, when he learned this, everything else began to make sense: whenever he encountered some X that might otherwise seem senseless, he could assure himself that in a world where the Vatican was the world's largest supplier of prophylactics, X made perfect sense.

I feel similarly about the world where Will Newsome is Glenn Beck's ghostwriter.

comment by Will_Newsome · 2012-06-12T22:51:23.559Z · LW(p) · GW(p)

No causal connection as such, but you never know, there might be a latent node.

comment by RobertLumley · 2012-06-12T22:48:01.274Z · LW(p) · GW(p)

A (dated) montage on AI from Beck's Radio show. Much less Singularity-friendly, but perhaps he's changed since then.

comment by Cognosium · 2012-06-18T20:25:50.866Z · LW(p) · GW(p)

Unfortunately Kurtweil’s vision, as with that of other adherents of the transhumanist cult, is grossly distorted.

His efforts to underline the very clear exponential pattern of technological development (which has been apparent to many of us for more than half a century and even quantified by Gordon Moore 40 years back) are certainly to be commended.

Nevertheless, Kurtzweil remains completely oblivious to the clear and inevitable extension of biological evolution which, by a process of self-assembly rather than direct human design, which will, within decades, transition to a new inorganic phase of the observed life process. This can already be seen as a work-in progress in the form of what we at present call the Internet.

Kurtzweils great naivety in this respect no doubt stems from two factors. Firstly, a too close focus on his own specialist discipline of IT. Secondly, from anthropocentrism. This colored the beliefs of the religionists of yesteryear and, in modern times, has spurred the transhumanist mindsets of Kurtzweil and most others of his ilk.

The realities of the situation are better expressed by the quoted comment of Jaan Tallinn:

“We became the dominant species on this planet by being the most intelligent species around. This century we are going to cede that crown to machines. After we do that, it will be them steering history rather than us.”

This can already be observed as a a work-in-progress. And effectively evolving by a process of self-assembly. You may have noticed that we are increasingly, in a sense, "enslaved" by our PCs, mobile phones, their apps and many other trappings of the net. We are already largely dependent upon it for our commerce and industry and there is no turning back. What we perceive as a tool is well on its way to becoming an agent.

Consider this:

There are at present an estimated 2 Billion internet users. There are an estimated 13 Billion neurons in the human brain.

On this basis for approximation the internet is only one order of magnitude below the brain.

That is a simplification, of course. For example:

Not all users have their own computer. So perhaps we could reduce that, say, tenfold. The number of switching units, transistors, if you wish, contained by all the computers connecting to the internet and which are more analogous to individual neurons is many orders of magnitude greater than 2 Billion. Then again, this is compensated for to some extent by the fact that neurons do not appear to be binary switching devices but can adopt multiple states.

Without even crunching the numbers, we see that we must take seriously the possibility that the internet may well be comparable to a human brain in processing power. And, of course, the degree of interconnection and cross-linking is also growing rapidly.

From a quite different evolutionary perspective we can also see that there is a very good case to be made for this entity to become a new, and predominant, phase of the on-going evolutionary “life” process that is traceable back to the formation of the chemical elements in stars and supernovae.

comment by MatthewB · 2012-08-09T05:33:06.967Z · LW(p) · GW(p)

Glenn Beck was one of the first TV personalities to interview Ray.

The Interview is on YouTube, and is very informative as to Glenn's objectives and Agenda.

Primarily, he wishes to use the ideology behind the Singularity as support for "Intelligent Design." In the inteview, he makes an explicit statement to that effect.

Glenn Beck is hardly "rational" as per the definition of "Less Wrong."

comment by stcredzero · 2012-06-13T20:27:31.899Z · LW(p) · GW(p)

Intelligent Design?

The thought that machines could one day have superhuman abilities should make us nervous. Once the machines are smarter and more capable than we are, we won’t be able to negotiate with them any more than chimpanzees can negotiate with us.

Not the best formulated example. From what I've read in accounts of chimpanzee owners and minders, chimpanzees do negotiate with people. From what I've read and heard about dog owners, it seems to me that dogs also negotiate with their owners.

I suspect that the ability to negotiate requires less intelligence than the average human and overlapping interests.

What if the machines don’t want the same things we do?

If we have completely non-overlapping interests, then there is no hope. I find this to be highly unlikely at first, however, though more likely after AGI. (Remember, however, that the interests of "human beings" are certain to rapidly change as well.)

I think it would be inconceivable for a medieval peasant to meet someone completely uninterested in a year's supply of wheat. Most of us reading this wouldn't ever ask for that and wouldn't know what to do with it, without some Google searching. But we'd still have interests in common as human beings and fellow vertebrates. We even have interests in common with our dogs.

I think we'd have at least a common interest in not being in the vicinity of a supernova, for example. (At least at first.)

Of course we can't have interests in common with an ant. I don't think an ant is even aware of its own interests in the way humans or even dogs are. I wonder if the magical seeming things people sometimes seem to ascribe to future AGI are not really different degrees of intelligence, but more along the lines of a "different order of awareness." What does that mean? Is the existence of such even falsifiable?

Superhuman intelligence is not magic. It will only seem that way to other insufficiently advanced intelligences.

Likewise, self-improving machines could perform scientific experiments and build new technologies much faster and more intelligently than humans can. Curing cancer, finding clean energy, and extending life expectancies would be child’s play for them.

I find this to be somewhat along the lines of magical thinking. Cancer is not one disease, and is in fact just one general aspect of extending life expectancies. I don't think something on that level is ever going to be "child's play." At the point an individual has the many times research bandwidth of all the world's PhDs, "child's play" might well have become a meaningless and archaic metaphor.

Replies from: MatthewB
comment by MatthewB · 2012-08-09T05:58:46.538Z · LW(p) · GW(p)

Also, don't forget that humans will be improving just as rapidly as the machines.

My own studies (Cognitive Science and Cybernetics at UCLA) tend to support the conclusion that machine intelligence will never be a threat to humanity. Humanity will have become something else by the time that machines could become an existential threat to current humans.

Replies from: stcredzero
comment by stcredzero · 2012-08-13T01:39:08.432Z · LW(p) · GW(p)

So the real threat to humanity are the machines that humanity will become. (Is in the process of becoming.)

comment by Alicorn · 2012-06-12T17:49:36.600Z · LW(p) · GW(p)

This is a long quote. Excerpt moar.

Replies from: RobertLumley
comment by RobertLumley · 2012-06-12T18:04:55.064Z · LW(p) · GW(p)

I'd prefer he write a summary of it - I am quite glad that I was able to read the whole thing.

comment by [deleted] · 2012-06-12T18:17:07.627Z · LW(p) · GW(p)

I'm impressed that he managed to uncover the secret socialist conspiracy to stop the singularity. I would have thought that was better hidden.

Replies from: CaveJohnson
comment by CaveJohnson · 2012-06-12T20:22:37.388Z · LW(p) · GW(p)

You do realize he is speaking in favour of the singularity and SIAI? Also if you haven't noticed there are plenty of right wing people on LW.

I've heard a top poster here mention that 1950s America was Communist. :)

Replies from: None, None
comment by [deleted] · 2012-06-14T15:09:53.008Z · LW(p) · GW(p)

Quote from a major LWer at minicamp:

Look at the tax code records. Then read marx and notice what he actually reccommends. America tried socialism in the 50s and 60s, and it worked!

comment by [deleted] · 2012-06-12T20:34:24.045Z · LW(p) · GW(p)

Regardless of the composition of LW posters, this is not a probable hypothesis:

Power bases in business and politics that have been forged over decades, if not centuries, are being threatened with extinction, and they know it. So the owners of that power are trying to hold on. They think they can do that by dragging us backward. They think that, by growing the public’s dependency on government, by taking away the entrepreneurial spirit and rewards and by limiting personal freedoms, they can slow down progress.

A big, scary "they" is, in general, a silly concept. A big, scary 'they" focused on impeding technological progress is silly on enough fronts that it bears expressly pointing out the silliness, lest it quietly adjust one's priors without one noticing.

Edit: An explanation of downvotes would me understand where I went wrong.

Replies from: buybuydandavis
comment by buybuydandavis · 2012-06-12T23:53:41.253Z · LW(p) · GW(p)

Since at least Adam Smith, we've known that you don't need a big collaborating cabal conspiring toward a common end to have the net effect of their actions be quite like a big invisible fist with a malevolent purpose.

Replies from: None, Will_Newsome
comment by [deleted] · 2012-06-13T02:51:40.462Z · LW(p) · GW(p)

Are there evidence of major cabal-like-net-effects impeding the progress of technology that I'm not aware of?

Replies from: Nornagest
comment by Nornagest · 2012-06-13T03:21:02.311Z · LW(p) · GW(p)

The first thing that comes to mind is the decline of China's scientific and technological output starting around the 14th century. Up until that point, Chinese civilization had been well ahead of the West by most technological measures; for example, Chinese blast furnaces are known from the 1st century BC, while the technology didn't make it to the West until the mid-12th century AD. Sometime during the Ming Dynasty, however, social changes reversed this trend; I couldn't point to any one dominant cause, and as best I know scientific research was never officially discouraged during this period, but the effect is fairly well established.

One plausible theory that I've heard is that changes to the governmental structure around that time underweighted the incentives for studying math and natural philosophy among the educated classes, in favor of law, classics, administrative topics, and other subjects covered on the civil service exams of the time. Intuitively that seems a little too tidy to me, but I wouldn't be surprised if it was a major contributing factor.

Replies from: gwern
comment by gwern · 2012-06-13T03:38:00.669Z · LW(p) · GW(p)

One of the books I read on the topic argued that a proto-Industrial Revolution was getting started with the iron and coal deposits in, IIRC, the Sung, but then the emperor/empire took them over as a state monopoly, which ended that.

Replies from: stcredzero
comment by stcredzero · 2012-06-13T19:41:03.949Z · LW(p) · GW(p)

There is the potential for governments to interfere with research leading to AGI. There are not that many researchers directly involved, and there are generally known widespread consequences which could result. Most likely, this could only delay the appearance of AGI and not prevent it.

What if all the history of the universe, life, and human history were just the unlikely precursor to the appearance of an AGI? What if we're just part one of the many mechanisms for the generation of a "Boltzmann Brain?"

comment by Will_Newsome · 2012-06-13T01:15:33.330Z · LW(p) · GW(p)

Not to mention, ya know, crazy stuff.

(By the way, I was able to predict that the military had developed technology to beam thoughts into people's heads using just a priori reasoning about the brain, microwaves, and the probable goals and capabilities of the military and intelligence agencies. Then a quick Google search led me to that article. Pretty sure I deserve like 5,000 rationality points. WHO'S THE CRAZY ONE NOW, LESSWRONG?!!!!!??!!!!!? AHAHAHA. AHAHAHAHA. AHAHAHA.)

Replies from: wedrifid, Mitchell_Porter
comment by wedrifid · 2012-06-13T01:33:49.010Z · LW(p) · GW(p)

You know, I had been just about to observe that your recent contributions had been gaining you a dangerous amount of credibility. It seems you spotted the problem before I did and promptly rectified it!

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T01:40:32.755Z · LW(p) · GW(p)

You don't know what you're talking about, do you?

Replies from: wedrifid
comment by wedrifid · 2012-06-13T01:46:35.262Z · LW(p) · GW(p)

This:

Pretty sure I deserve like 5,000 rationality points. WHO'S THE CRAZY ONE NOW, LESSWRONG?!!!!!??!!!!!? AHAHAHA. AHAHAHAHA. AHAHAHA.

You're talking like a loony again. For a while you weren't. Now you are being disingenuous.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T01:55:07.281Z · LW(p) · GW(p)

Nuh-uh.

comment by Mitchell_Porter · 2012-06-13T01:37:36.371Z · LW(p) · GW(p)

Microwave auditory effect is the mechanism.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T03:15:07.346Z · LW(p) · GW(p)

Any comments on the post, Mitchell_Porter? I expect you have something to say.

Replies from: Mitchell_Porter
comment by Mitchell_Porter · 2012-06-13T04:10:09.365Z · LW(p) · GW(p)

Someone should think about failure modes for an AI programmed with these axioms.

Replies from: Will_Newsome
comment by Will_Newsome · 2012-06-13T05:41:51.437Z · LW(p) · GW(p)

The second should really come before the first. America before God? WTF?