FHI (Future of Humanity Institute) has shut down (2005–2024)

post by gwern · 2024-04-17T13:54:16.791Z · LW · GW · 21 comments

This is a link post for https://www.futureofhumanityinstitute.org/

Over time FHI faced increasing administrative headwinds within the Faculty of Philosophy (the Institute’s organizational home). Starting in 2020, the Faculty imposed a freeze on fundraising and hiring. In late 2023, the Faculty of Philosophy decided that the contracts of the remaining FHI staff would not be renewed. On 16 April 2024, the Institute was closed down.

21 comments

Comments sorted by top scores.

comment by gwern · 2024-04-17T13:54:53.584Z · LW(p) · GW(p)

Notable: Anders Sandberg has written an 'oral history' of FHI as a final FHI report: https://static1.squarespace.com/static/660e95991cf0293c2463bcc8/t/661a3fc3cecceb2b8ffce80d/1712996303164/FHI+Final+Report.pdf (excerpts [EA · GW])

Replies from: gwern
comment by gwern · 2024-04-19T02:08:22.028Z · LW(p) · GW(p)

And some further personal comments: https://aleph.se/andart2/personal/thoughts-at-the-end-of-an-era/

Replies from: mateusz-baginski
comment by Mateusz Bagiński (mateusz-baginski) · 2024-04-19T04:14:36.848Z · LW(p) · GW(p)

Why did FHI get closed down? In the end, because it did not fit in with the surrounding administrative culture. I often described Oxford like a coral reef of calcified institutions built on top of each other, a hard structure that had emerged organically and haphazardly and hence had many little nooks and crannies where colorful fish could hide and thrive. FHI was one such fish but grew too big for its hole. At that point it became either vulnerable to predators, or had to enlarge the hole, upsetting the neighbors. When an organization grows in size or influence, it needs to scale in the right way to function well internally – but it also needs to scale its relationships to the environment to match what it is.

comment by gwern · 2024-04-19T01:46:18.294Z · LW(p) · GW(p)

The Daily Nous (a relatively 'popular' academic philosophy blog) managed to get a non-statement out of Oxford:

Oxford University has taken the difficult decision to close the Future of Humanity Institute, a research centre in the Faculty of Philosophy. The Institute has made an important contribution to the study of the future of humanity, for which we would like to thank and recognise the research team. Researchers elsewhere across Oxford University are likely to continue to work on this emerging field.

comment by Roko · 2024-04-17T19:54:22.990Z · LW(p) · GW(p)

I would hope that there is a plan to reconstitute FHI as an independent research organization

comment by jimrandomh · 2024-04-17T19:11:13.414Z · LW(p) · GW(p)

This is tragic, but seems to have been inevitable for awhile; an institution cannot survive under a parent institution that's so hostile as to ban it from fundraising and hiring.

I took a look at the list of other research centers within Oxford. There seems to be some overlap in scope with the Institute for Ethics in AI. But I don't think they do the same sort of research or do research on the same tier; there are many important concepts and important papers that come to mind having come from FHI (and Nick Bostrom in particular), I can't think of a single idea or paper that affected my thinking that came from IEAI.

Replies from: Zach Stein-Perlman, gwern
comment by Zach Stein-Perlman · 2024-04-18T06:00:01.117Z · LW(p) · GW(p)

Harry let himself be pulled, but as Hermione dragged him away, he said, raising his voice even louder, "It is entirely possible that in a thousand years, the fact that FHI was at Oxford will be the only reason anyone remembers Oxford!"

comment by gwern · 2024-04-19T01:42:25.006Z · LW(p) · GW(p)

I would say that the closest to FHI at Oxford right now would probably be Global Priorities Institute (GPI). A lot of these papers would've made just as much sense coming out of FHI. (Might be worth considering how GPI apparently seems to have navigated Oxford better.)

comment by Roko · 2024-04-17T15:40:49.602Z · LW(p) · GW(p)

Is this a downstream consequence of the Nick Bostrom comments about race from the 1990s?

Replies from: Benito, niplav
comment by Ben Pace (Benito) · 2024-04-17T19:19:09.733Z · LW(p) · GW(p)

I don't believe so. The gossip I've heard leads me to think that it was substantially downstream of attempts to scale the institute by GovAI and Research Scholars program (involving hiring lots of junior people, which the university doesn't like), as well as the university in general being a terrible bureaucracy (e.g. as incompetent and micromanage-y as "remove the plants you bought because the university cannot commit to watering them").

Replies from: Pablo_Stafforini, Jan_Kulveit, Roko, Shaedys
comment by Pablo (Pablo_Stafforini) · 2024-04-18T22:17:23.073Z · LW(p) · GW(p)

“How many Oxford dons does it take to change a lightbulb?”

CHANGE‽‽‽

comment by Jan_Kulveit · 2024-04-18T16:23:47.194Z · LW(p) · GW(p)

I sort of want to flag this interpretation of whatever gossip you heard seems misleading/only telling small part of the story, based on my understanding.

Replies from: JesperO
comment by JesperO · 2024-04-19T03:36:01.634Z · LW(p) · GW(p)

Possible to say anything more about the story?

comment by Roko · 2024-04-17T19:53:38.845Z · LW(p) · GW(p)

Hmm okay. That does seem encouraging.

comment by Shaedys · 2024-04-18T05:19:58.762Z · LW(p) · GW(p)

Which all seems very much like university bureaucracy, sadly.

comment by ryan_b · 2024-04-18T14:19:02.007Z · LW(p) · GW(p)

Suddenly more poignant: 

comment by Algon · 2024-04-17T20:30:33.738Z · LW(p) · GW(p)

This seems to have come out of nowhere. Was anyone aware of this ahead of time? Why didn't anyone try sharing the news to get prestigious academics, institutions and others to loudly say this is a terrible idea? Or get Kelsey Piper or someone to write a big news article about this? 

Replies from: habryka4
comment by habryka (habryka4) · 2024-04-17T20:57:54.487Z · LW(p) · GW(p)

I knew this was going on for quite a while (my guess is around a year or two). I think ultimately it was a slow smothering by the university administration and given the adversarialness of that relationship with the university, I don't really think outrage would have really helped that much (though it might have, I don't really understand the university's perspective on this). 

My guess is dragging this out longer would have caused more ongoing friction and would have overall destroyed more time and energy by the really smart and competent people at FHI than they would have benefitted from the institution.

Replies from: Algon
comment by Algon · 2024-04-17T21:19:05.061Z · LW(p) · GW(p)

That makes sense.

Did you know they were going to close today? Were you suprised by the news?

Replies from: habryka4
comment by habryka (habryka4) · 2024-04-17T21:54:11.985Z · LW(p) · GW(p)

My sense is FHI was somewhat accurately modeled as "closed" for a few months. I did not know today would be the date of the official announcement.