Some Lessons Learned from Studying Indirect Object Identification in GPT-2 small 2022-10-28T23:55:44.755Z

Gears-Level Mental Models of Transformer Interpretability 2022-03-29T20:09:53.073Z

Lessons After a Couple Months of Trying to Do ML Research 2022-03-22T23:45:44.398Z

Comment by KevinRoWang on Lessons After a Couple Months of Trying to Do ML Research · 2022-03-27T21:43:40.063Z · LW · GW

Hm, I think this tool would've been really helpful for me in the past for a couple of occasions. Usually if I want to save a cell output, I just won't edit that cell and I'll create a new one, even if it means redundant code. 

Also +1 on keeping track of bugs! I should've added to the og post that one thing I do that's really helpful for me is keeping track of procedural knowledge (i.e. how to setup a GPU, how to fix common issue X, etc.) in a personal Slack that I've created as a second brain basically. I found that I used the message-yourself-in-slack feature a lot to keep track of small notes for myself, and since I did it so much, I created a whole private, personal Slack and that's been pretty useful in keeping track of bugs, etc.

Comment by KevinRoWang on Lessons After a Couple Months of Trying to Do ML Research · 2022-03-27T21:36:28.552Z · LW · GW

Let's definitely catch up!

Comment by KevinRoWang on Lessons After a Couple Months of Trying to Do ML Research · 2022-03-27T21:35:39.891Z · LW · GW

Yes! Especially if you show you have can provide relevant thoughts about their work, a lot of people will be happy to call or at least reply to some questions via email