Questions on SI Research

post by MichaelAnissimov · 2012-06-01T15:00:29.005Z · LW · GW · Legacy · 14 comments

Contents

14 comments

Hello LessWrong,

As one of my assignments at the Singularity Institute (SI), I am writing a research FAQ answering the most frequently asked questions regarding the Singularity Institute's research program. 

For a short summary of what SI is about, see our concise summary

Here are some examples of questions I'm currently planning to include:

1) who conducts research at SI?

2) what are the specific research topics being investigated?

3) what is the history of SI's research program?

4) where does SI see its research program in 5, 10, and 20 years?

5) what other organizations conduct research similar to SI?

Please submit other questions that come to mind below. Unfortunately, due to limited time, we cannot answer every question posed to us. However, I hope to answer some of the questions that receive the most upvotes. Thank you for your participation!

14 comments

Comments sorted by top scores.

comment by [deleted] · 2012-06-01T19:43:08.730Z · LW(p) · GW(p)

What is the role of research in SI's mission?

How are resources being split between direct AI research and other topics?

Why research anything other than AI itself?

Where will research be published or made available?

Will anything be kept confidential, and how and why? What security measures are in place?

How do we know SI is doing good research if much of it is confidential?

Replies from: beoShaffer
comment by beoShaffer · 2012-06-02T07:16:45.997Z · LW(p) · GW(p)

It might be advisable to spilt this so the questions can be voted on separately.

comment by VNKKET · 2012-06-02T04:36:55.255Z · LW(p) · GW(p)

How easily could the SI lose important data (like unpublished research) in, say, a fire or computer malfunction?

comment by Shmi (shminux) · 2012-06-01T16:28:35.752Z · LW(p) · GW(p)

I would expect the FAQ to explicitly address the standard pattern-matching questions, such as 'Is Singularity "the Rapture for nerds"'? Or you can pretend that people don't pattern-match as their first reaction.

Replies from: None, MichaelAnissimov
comment by [deleted] · 2012-06-01T19:34:08.900Z · LW(p) · GW(p)

I gave a quick talk about the singularity a few days ago. One guy kept heckling me about 'rapture for geeks'. It's definitely a thing.

Replies from: John_Maxwell_IV, wedrifid
comment by John_Maxwell (John_Maxwell_IV) · 2012-06-01T20:37:07.317Z · LW(p) · GW(p)

This is a good illustration of how hucksters and differentiated meme virulence mean we can't have nice things.

People really want X (e.g. to live forever, to lose weight, etc.). Hucksters take advantage of this by promising X, and memes that persuade people they can achieve X by adopting the meme (e.g. Christianity in the case of living forever) spread. Then people develop antibodies to the hucksters or memes, and the antibodies end up attacking anything that promises X (since it resembles the mistaken claims).

As Randall Munroe joked:

Somewhere out there is a company that has actually figured out how to enlarge penises, and it's helpless to reach potential customers.

Hence my proposed slogan for cryonics, "Cryonics: A scheme for living forever that might actually work". Of course, we should only use the slogan if it might actually work, which looks highly doubtful to one LWer who is a neuroscientist.

Replies from: ciphergoth, Nisan
comment by Paul Crowley (ciphergoth) · 2012-06-02T13:53:00.600Z · LW(p) · GW(p)

If that one LWer has a technical critique of cryonics, they should write it up. cf, oh, just about everything on my blog. http://blog.ciphergoth.org/

comment by Nisan · 2012-06-02T15:53:06.027Z · LW(p) · GW(p)

That's a really nice explanation of the situation.

comment by wedrifid · 2012-06-01T23:50:26.084Z · LW(p) · GW(p)

I gave a quick talk about the singularity a few days ago. One guy kept heckling me about 'rapture for geeks'. It's definitely a thing.

If one guy heckled you about 'rapture for the geeks' I'd agree - it's definitely a thing. If one guy kept heckling you about the same thing then sure, I'd still agree but I'd suggest that all the additional heckles of the same trite jest tell little about the 'thing' and present an almost entirely social problem regarding presentations and how to combat heckling.

comment by MichaelAnissimov · 2012-06-05T06:49:10.534Z · LW(p) · GW(p)

This would be a research FAQ, not a general Singularity or organizational FAQ, though there will be a separate FAQ for the latter, and I will consider including that question.

comment by Baughn · 2012-06-02T13:35:21.404Z · LW(p) · GW(p)

How do you intend to get ahead of huge corporations like Google, who also do AI research?

comment by private_messaging · 2012-06-01T18:47:23.603Z · LW(p) · GW(p)

I'm kind of curious how do you explain why people with more proven expertise and accomplishment in relevant areas don't seem to be offering any ai risk reduction for anyone to buy yet. Quack remedies always came before cures, through the history.

Replies from: wedrifid
comment by wedrifid · 2012-06-01T23:18:09.174Z · LW(p) · GW(p)

I'm kind of curious how do you explain why people with more proven expertise and accomplishment in relevant areas don't seem to be offering any ai risk reduction for anyone to buy yet. Quack remedies always came before cures, through the history.

This kind of question - and how much more fun people seem to have when arguing about this kind of question - would just be a distraction from the intent of the document. It is best to save the apologetics for elsewhere and give the plain information here.

Replies from: private_messaging
comment by private_messaging · 2012-06-02T06:58:24.828Z · LW(p) · GW(p)

Well, it's not so much of a question as of an answer to 'what to think about this specific offering of a cure'. People whom can generate that sort of question - sceptical minded people - won't donate anyway.