Comment by EduardoNeville (eduardoneville) on Scaffolded LLMs as natural language computers · 2023-11-08T22:26:18.105Z · LW · GW

Comment by EduardoNeville (eduardoneville) on Scaffolded LLMs as natural language computers · 2023-11-08T22:24:09.955Z · LW · GW

Very interesting! Similar to error correcting codes used in hardware, research can be conducted to create "semantic" error correcting codes for LLM outputs. These codes would help repair errors or inconsistencies in the outputs of NLOPs, enabling the stitching together of extended sequences of operations in a coherent and consistent manner.