Posts

Comments

Comment by LatticeDefect on Paper: LLMs trained on “A is B” fail to learn “B is A” · 2023-10-04T00:00:53.041Z · LW · GW

We might also be using working memory to reconstruct reverse relations on the fly. E.g. reciting a poem backwards will consist of remembering chunks of it in forward direction and then rearranging the chunk to be in reverse direction.
If that is correct than a variation of CoT-prompting might work. By first having the model recall any context in which it recalls an object and then picking the answer out of that.

Comment by LatticeDefect on Why it's so hard to talk about Consciousness · 2023-07-05T17:16:08.272Z · LW · GW

I wonder how much camp #1 correlates with aphantasia.

Comment by LatticeDefect on Why it's so hard to talk about Consciousness · 2023-07-05T17:05:27.447Z · LW · GW

The thoughtexperiments suggest that qualia is tied to memory-formation. If your nociceptors are firing like crazy but the CNS never updates on it, was there any pain?

Then the obvious next question is what distinguishes qualia from memory-formation?

Comment by LatticeDefect on Pausing AI Developments Isn't Enough. We Need to Shut it All Down by Eliezer Yudkowsky · 2023-03-31T19:29:27.169Z · LW · GW

There are can order at least 10k-basepair DNA synthesis online, longer sequences are "call to get a quote" on the sites I found. The smallest synthetic genome for a viable self-replicating bacterium is 531kb. The genome for a virus would be even smaller.

My understanding is that there are existing processes to encapsulate genes into virus shells from other species for gene therapy purposes. That leaves the logistics of buying both services, hooking them up and getting the particles injected into some lab animals.

It doesn't look trivial, but less complicated than buying an entire nuclear arsenal.

Comment by LatticeDefect on GPT-4 · 2023-03-14T21:10:23.484Z · LW · GW

Point (b) sounds like early stages of gain of function research.

Comment by LatticeDefect on Omicron Variant Post #1: We’re F***ed, It’s Never Over · 2021-11-27T13:37:07.215Z · LW · GW

What updates on your predictions, if any, would you make if we learned that the variant developed from a long-term infection in an immunocompromised person, i.e. had plenty of opportunity to adapt to the immune response.