Comment by Perusha Moodley (perusha-moodley) on Induction heads - illustrated · 2023-06-15T11:47:40.514Z · LW · GW

I'm at the beginning of the MI journey: I read the paper, watched a video and I am working through the notebooks.  I have seen the single diagram version of this before but I needed this post to really help me get a feel for how the subspaces and composition work. I think it works well as a stand-alone document and I feel like it has helped setup some mental scaffolding for the next more detailed steps I need to take. Thank you for this!