Summaries: Alignment Fundamentals Curriculum

post by Leon Lang (leon-lang) · 2022-09-18T13:08:05.335Z · LW · GW · 3 comments

This is a link post for https://docs.google.com/document/d/1mVwQgyrEgWJ9xsO6wIizDp2T3578OqNe4K5goKiOLgE/edit?usp=sharing

The linked document provides my summaries for most core readings and many further readings of the alignment fundamentals curriculum composed by Richard Ngo, as accessed from July to early September 2022. Additionally, it often contains my preliminary opinions on the texts. Note that I’m not an expert on the topic. 

I have read all texts while simultaneously doing full-time work unrelated to AI alignment, and thus, due to time constraints, many summaries probably contain mistakes,  and my opinions would change upon further reflection. Additionally:

Nevertheless, I was told that these summaries are useful, and therefore I’m sharing them with the wider community of people interested in alignment. 

If anyone wants to contribute their own summary, please put a suggestion into the google doc, and I will accept it with an attribution to the (optionally anonymous) author.

Acknowledgments: I want to thank Albert Garde, Benjamin Kolb, Fritz Dorn, Jens Brandt, and Tom Lieberum for discussions on the curriculum.


 

3 comments

Comments sorted by top scores.

comment by trevor (TrevorWiesinger) · 2022-09-19T07:53:44.093Z · LW(p) · GW(p)

If you do AI policy, this is a great way to quickly skill up at explaining alignment, and also quickly skilling up on AI itself.

Replies from: leon-lang
comment by Leon Lang (leon-lang) · 2022-09-19T15:31:58.745Z · LW(p) · GW(p)

So far, the summaries are only "tested" by people who have worked through the whole curriculum themselves. They used the summaries to check their understanding of the articles and contrast their view with mine.

So I'm not yet confident that someone could just read my summaries without at the same time going through the full articles, but it seems worth a try.

comment by jimrandomh · 2022-09-18T21:40:55.001Z · LW(p) · GW(p)

Thank you for writing this. I plan on working through it over the next couple weeks to fill in gaps in my previous alignment-related knowledge.