MIRI's technical agenda: an annotated bibliography, and other updates
post by So8res · 2015-02-05T18:11:05.051Z · LW · GW · Legacy · 4 commentsContents
4 comments
This week, I'm pleased to present Aligning Superintelligence with Human Interests: An Annotated Bibliography. This annotated bibliography complements our technical agenda and the six supporting papers that I've released over the past few months. Once you've read the supporting papers, this annotated bibliography will help you figure out what to read next on any given topic, in order to get to the cutting edge.
This annotated bibliography concludes my series of updates on MIRI's technical agenda. To review, I've presented a series of eight papers which sketch out MIRI's research strategy and overview a number of active research areas. Those papers are:
- Aligning Superintelligence with Human Interests: A Technical Research Agenda
- Formalizing Two Problems of Realistic World Models
- Toward Idealized Decision Theory
- Questions of Reasoning Under Logical Uncertainty
- Vingean Reflection: Reliable Reasoning for Self-Modifying Agents
- Corrigibility
- The Value Learning Problem
- Aligning Superintelligence with Human Interests: An Annotated Bibliography
4 comments
Comments sorted by top scores.
comment by Ben Pace (Benito) · 2015-02-05T19:10:26.061Z · LW(p) · GW(p)
Thank you very much! This is exactly what I wanted for when I begin my CS course at Oxford in October.
comment by ahbwramc · 2015-02-06T18:47:41.091Z · LW(p) · GW(p)
I'm curious, has this recent series of papers garnered much interest from the wider (or "mainstream") AI community? It seems like MIRI has made a lot of progress over the past few years in getting a lot of very smart people to take their ideas seriously (and in cultivating a more respectable, "serious" image). I was wondering if similar progress had been made in creating inroads into academia.
Replies from: So8res↑ comment by So8res · 2015-02-06T21:41:19.255Z · LW(p) · GW(p)
Seven of the papers (every one except the annotated bibliography) are referenced in the FLI research priorities document attached to the open letter which received a whole lot of recent publicity :-) Beyond that, it's a bit too early to guess how these particular papers will affect academia more broadly, but recent progress looks promising.
Replies from: ahbwramc