Update on establishment of Cambridge’s Centre for Study of Existential Risk

post by Sean_o_h · 2013-08-12T16:11:23.263Z · LW · GW · Legacy · 15 comments

Contents

15 comments
Cambridge’s high-profile launch of the Centre for Study of Existential Risk last November received a lot of attention on LessWrong, and a number of people have been enquiring as to what‘s happened since. This post is meant to give a little explanation and update of what’s been going on.

Motivated by a common concern over human activity-related risks to humanity, Lord Martin Rees, Professor Huw Price, and Jaan Tallinn founded the Centre for Study of Existential Risk last year.  However, this announcement was made before the establishment of a physical research centre or securement of long-term funding. The last 9 months have been focused on turning an important idea into a reality.

Following the announcement in November, Professor Price contacted us at the Future of Humanity Institute regarding the possibility of collaboration on joint academic funding opportunities; the aim being both to raise the funds for CSER’s research programmes and to support joint work by the FHI and CSER’s researchers on anthropogenic existential risk. We submitted our first grant application in January to the European Research Council – an ambitious project to create “A New Science of Existential Risk” that, if successful, would provide enough funding for CSER’s first research programme - a sizeable programme that will run for five years.
We’ve been successful in the first and second rounds, and we will hear a final round decision at the end of the year. It was also an opportunity for us to get some additional leading academics onto the project – Sir Partha Dasgupta, Professor of Economics at Cambridge and an expert in social choice theory, sustainability and intergenerational ethics, is a co-PI (along with Huw Price, Martin Rees and Nick Bostrom). In addition, a number of prominent academics concerned about technology-related risk – including Stephen Hawking, David Spiegelhalter, George Church and David Chalmers – have joined our advisory board.

The FHI regards establishment of CSER as of the highest priority for a number of reasons including:

1) The value of the research the Centre will engage in
2) The reputational boost to the field of Existential Risk gained by the establishment of high-profile research centre in Cambridge.
3) The impact on policy and public perception that academic heavy-hitters like Rees and Price can have

Therefore we’ve been working with CSER behind the scenes over the last 9 months. Progress has been a little slow until now – Huw, Martin and Jaan are fully committed to this project, but due to their other responsibilities aren’t in a position to work full-time on it yet. 

However, we’re now in a position to make CSER’s establishment official. Cambridge’s new Centre for Research in the Arts, Social Sciences and Humanities (CRASSH) will host CSER and provide logistical support. I’ll be acting manager of CSER’s activities over the coming 6-12 months, under the guidance of Huw, Martin and Jaan. A generous seed funding donation from Jaan Tallinn is funding CSER’s establishment and these activities – which will include a lecture series, workshops, public outreach, and staff time on grant-writing and fundraising. It’ll also provide a buyout of a fraction of my time from FHI (providing funds for us to hire part-time staff to offload some of the FHI workload and help with some of the CSER work).

At the moment and over the next couple of months we’re going to be focused on identifying and working on additional academic funding opportunities for additional programmes, as well as chasing some promising leads in industry, private and philanthropic funding. I’ll also be aiming to keep CSER’s public profile active. There will be newsletters every three months (sign up here), the website’s going to be fleshed out to contain more detail about our planned research and existing literature, and we’ll be arranging regular high-quality media engagement. While we’re unlikely to have time to answer every general query that comes in (though we’ll try whenever possible: email: admin@cser.org), we’ll aim to keep the existential risk community informed through the newsletters and posts such as these.

We’ve been lucky to get a lot of support from the academic and existential risk community for the CSER centre. In addition to CRASSH, Cambridge’s Centre for Science and Policy will provide support in making policy-relevant links, and may co-host and co-publicise events. Luke Muehlhauser, MIRI’s Executive Director, has been very supportive and has provided valuable advice, and has generously offered to direct some of MIRI’s volunteer support towards CSER tasks. We also expect to get valuable support from the growing community around FHI.

From where I’m sitting, CSER’s successful launch is looking very promising. The timeline on our research programmes, however, is still a little more uncertain. If we’re successful with the European Research Council, we can expect to be hiring a full research team next spring. If not, it may take a little longer, but we’re exploring a number of different opportunities in parallel and are feeling confident. The support of the existential risk community continues to be invaluable.

Thanks,

Seán Ó hÉigeartaigh
Academic Manager, Future of Humanity Institute 

http://www.fhi.ox.ac.uk

Acting Academic Manager, Cambridge Centre for Study of Existential Risk.

http://www.cser.org



15 comments

Comments sorted by top scores.

comment by Larks · 2013-08-13T00:43:31.246Z · LW(p) · GW(p)

This is excellent news. I look forward to the invigorating effects of competition between the greatest university in the world and another university.

Replies from: AlexMennen
comment by AlexMennen · 2013-08-13T19:43:34.615Z · LW(p) · GW(p)

You sound like you're trying to be sarcastic, but I don't actually know what you're trying to say.

Replies from: John_Maxwell_IV, Larks
comment by Larks · 2013-08-14T02:15:24.628Z · LW(p) · GW(p)

It's not at all sarcasm. I do think this is excellent news, I do think competition is (in standard cases) an excellent thing, and I do think that one of the universities is excellent.

Replies from: Sean_o_h
comment by Sean_o_h · 2013-08-15T15:24:11.254Z · LW(p) · GW(p)

I must admit it leaves me in a bit of a quandry. Now that I've got a foot in both camps, I have no idea who it's safe to support in the annual Water Polo and Tiddlywinks Intervarsity Grudge Match.

comment by Pablo (Pablo_Stafforini) · 2013-08-12T18:21:24.795Z · LW(p) · GW(p)

Currently this post has "125% positive" votes. I'm happy to see so much interest in x-risk reduction!

Replies from: AlexMennen
comment by AlexMennen · 2013-08-13T19:44:32.740Z · LW(p) · GW(p)

Earlier it was acting like it had -1 downvote. It says 100% positive now. Does anyone know whether the problem got fixed, or if someone just downvoted it?

comment by Ben Pace (Benito) · 2013-08-12T23:16:34.339Z · LW(p) · GW(p)

A video lecture series? That would be great to have on YouTube.

Replies from: RomeoStevens
comment by RomeoStevens · 2013-08-13T03:44:46.862Z · LW(p) · GW(p)

And would provide awesome source material for an RSA animate style effort.

Replies from: Sean_o_h
comment by Sean_o_h · 2013-08-13T09:26:23.644Z · LW(p) · GW(p)

We'll make sure to get high-quality recordings.

In the meantime, the FHI's youtube channel (http://www.youtube.com/user/FHIOxford/videos) may be of interest (talks from Tegmark, Bostrom, Armstrong, Sandberg, Yudkowsky, Omohundro, plus a recent animation of Bostrom's "Fable of the Dragon Tyrant").

Replies from: RomeoStevens
comment by RomeoStevens · 2013-08-13T10:15:14.866Z · LW(p) · GW(p)

The Fable of the Dragon Tyrant cartoon did make it to reddit with moderate upvotes IIRC.

comment by AlexMennen · 2014-01-02T03:43:50.040Z · LW(p) · GW(p)

We submitted our first grant application in January to the European Research Council – an ambitious project to create “A New Science of Existential Risk” that, if successful, would provide enough funding for CSER’s first research programme - a sizeable programme that will run for five years. We’ve been successful in the first and second rounds, and we will hear a final round decision at the end of the year.

How'd it go?

Replies from: Sean_o_h
comment by Sean_o_h · 2014-01-02T10:47:15.334Z · LW(p) · GW(p)

Unfortunately it got to a very late stage but was not funded. While reviewers ranked it very highly, it was always a long shot - we were asking for a lot of money for what is not a "traditional" academic discipline. However, we think that there are several foundations that might be inclined to support the type of research programme proposed - we aim to submit proposals to these early this year.

(Note: we had the same result with an Arts and Humanities Research Counciul grant submitted this fall - highly-ranked but ultimately unsuccessful. Also should be good material for further applications).

comment by turchin · 2013-08-20T16:17:33.081Z · LW(p) · GW(p)

It is a little bit strange that organizers could not donate at least some money to the project or invest their time in it as volonteers. In result we see more fighting for funds than actual x-risks resistance. The same problem plagues other x-risk organizations, most of all Lifeboat foundation. By the way most notable work on x-risks was done without any visable funding, I mean articles of Bostrom and Yudkowsky.

Replies from: Sean_o_h
comment by Sean_o_h · 2013-08-21T12:33:32.074Z · LW(p) · GW(p)

The organisers certainly are doing so. However, it's easy to underestimate the sheer amount of work involved in setting up a centre. Huw and Martin have been putting a lot of time into contacting academic advisors, making policy connections, liaising with Cambridge University and the relevant centres within Cambridge, meeting with representatives from various funding bodies, writing funding applications, and doing media and public outreach. Jaan has provided seed funding, is also making relevant connections and doing media outreach, and has been helping with website design.

Regarding money: Martin and Huw don't possess the kind of wealth to fund a whole research centre, and Jaan in addition to his CSER funding is funding MIRI, FHI and other organisations. Furthermore, an organisation getting its funds from outside sources, particularly respected academic funding bodies, probably looks more reputable than one that is mainly funded by its own organisers. Raising funds is a big part of setting up any new research centre, Xrisk or otherwise.

Regarding time: Jaan helping with the website is generous, but is not the best use of his time, given his earning and influence power - so I'm going to be minimising how much he's doing that. Martin and Huw manning the general email account and doing the time-consuming legwork involved in writing grant applications and dealing with bureaucracy is not the best use of their time, given their positions of influence. Better to have someone like me (and others like me) doing that, and for them to be making the connections that I can't.

There's just a lot of legwork to be done. The founders aren't in a position to quit their other positions and responsibilities to devote themselves to that legwork, and even if they were it wouldn't represent the best use of their time - they would lose valuable influence and earning potential.

"By the way most notable work on x-risks was done without any visable funding, I mean articles of Bostrom and Yudkowsky." I can't speak for Yudkowsky, but there certainly was visible (if flexible) funding from the Oxford Martin School for Bostrom's work on existential risk.