Locating and Editing Knowledge in LMs 2025-01-24T22:53:40.559Z

Updating and Editing Factual Knowledge in Language Models 2025-01-23T19:34:37.121Z

Comment by Dhananjay Ashok (dhananjay-ashok) on Updating and Editing Factual Knowledge in Language Models · 2025-01-24T06:37:48.067Z · LW · GW

I think we know very little about how humans learn individual new facts from a neuroscience perspective. There are some studies that track fMRI scans of individuals who learn new things over the course of a day (sleep seems particularly important for the formation of connections in the brain having to do with new learning), but I am sceptical that it is the kind of learning that could be applied to Language Model type systems as of now. 

 

In general though, I think humans are the gold standard for factual knowledge updating. I agree with you that there are some examples of failures, but no other system comes close in my view.