Announcing “Key Phenomena in AI Risk” (facilitated reading group)

post by Nora_Ammann, particlemania · 2023-05-09T00:31:10.294Z · LW · GW · 4 comments

Contents

  What?
  For Who? 
  When?
  Overview of the curriculum
  Sign up
  About the application
None
4 comments

TLDR: “Key Phenomena in AI Risk” is a 7 week-long, facilitated reading group. It is aimed at people interested in conceptual AI alignment research, in particular from fields such as philosophy, systems research, biology, cognitive and social sciences.

The program will run between July and August 2023. Sign up here by May 28th.

What?

The “Key Phenomena in AI risk” reading curriculum provides an extended introduction to some key ideas in AI risk, in particular risks from misdirected optimization or 'consequentialist cognition'. As such, it aims to remain largely agnostic of solution paradigms. 

See here [LW · GW] for a short overview of the curriculum; here for a more extensive summary; and here for the full curriculum. 

This is a 7-week long program, which consists of a weekly 90’ facilitated call to discuss the week’s key phenomena and readings, as well as individual time for reading (min. 2h, more if you would like to explore the optional readings).  

The courses are virtual and free of charge.

For Who? 

The curriculum is primarily aimed at people interested in conceptual research in AI risk and alignment. 

It is designed to be accessible to audiences in, among others, philosophy (of agency, knowledge, power, etc.) and systems research (e.g. biological, cognitive, information-theoretic, social systems, etc.).

When?

The reading groups will be taking place in July and August 2023.

 We expect to run 2-6 groups à 4-8 participants (including 1 facilitator). Each group will be led by a facilitator with substantive knowledge of AI risk. 

Overview of the curriculum

Here is a longer summary. Here is the full curriculum. 

The curriculum has been developed by TJ (Research Scholar FHI) with inputs from Nora Ammann, Sahil Kulshrestha, and Tsvi Benson-Tilsen. The program is operationally supported by PIBBSS

The curriculum was initially developed as part of the PIBBSS summer research fellowship,. but we realized that it might be of interest and useful to people outside of the fellowship program, too. 

We are orienting to this present round of reading groups as a way to test whether it’s worth continuing to run them on a more regular basis, as well so to help us improve the program. 

Sign up

Sign up here by May 28th.

About the application

The application consists of one stage, where we ask you to fill in a form with 

We select people based on our best understanding of their motivation to contribute to AI alignment and how much they would counterfactually benefit from participating in the program. 


If you have any questions, feel free to leave a comment below or contact us at contact@pibbss.ai 

If you are keen to facilitate one of the reading group, also reach out. 

4 comments

Comments sorted by top scores.

comment by Leon Lang (leon-lang) · 2023-05-09T16:54:30.658Z · LW(p) · GW(p)

After filling out the form, I could click on "see previous responses", which allowed me to see the responses of all other people who have filled out the form so far

That is probably not intended?

Replies from: Nora_Ammann
comment by Nora_Ammann · 2023-05-09T18:26:30.749Z · LW(p) · GW(p)

Indeed that wasn't intended. Thanks a lot for spotting & sharing it! It's fixed now.

comment by Chris_Leong · 2023-05-09T00:46:21.105Z · LW(p) · GW(p)

Sounds really cool. Would be useful to have some idea of the kind of time you're planning to pick so that people in other timezones can make a call about whether or not to apply.

Replies from: Nora_Ammann
comment by Nora_Ammann · 2023-05-09T00:53:13.452Z · LW(p) · GW(p)

Good point! We are planning to gauge time preferences among the participants and fix slots then. What is maybe most relevant, we are intending to accommodate all time zones. (We have been doing this with PIBBSS fellows as well, so I am pretty confident we will be able to find time slots that work pretty well across the globe.)