LessWrong 2.0 Reader

How does this explain the Decoy effect ^[1]?

1. ^{^}

   I am not sure how real and how well researched the 'decoy effect' is

You might also like this short summary from MinutePhysics: 

Author here: I'm excited for people to make better versions of TruthfulQA. We started working on TruthfulQA in early 2021 and we would do various things differently if we were making a truthfulness benchmark for LLMs in early 2025.

That said, you do not provide evidence that "many" questions are badly labelled. You just pointed to one question where you disagree with our labeling. (I agree with you that there is ambiguity as to how to label questions like that). I acknowledge that there are mistakes in TruthfulQA but this is true of almost all benchmarks of this kind.

Yes

Ultrapersonal Healthcare appears to have forgotten to pay Squarespace to renew their website, which doesn't seem like a great sign.

This post is essentially talking about an issue that arises even without AI alignment, and that is relevant for capitalism, and the big issue is that AI will by default give people the ability to replace humans, making those humans essentially superfluous, and often it's not good when a human has no leverage.

This post is a +4 for me, if only because this is the first good argument against something like a capitalist economic order surviving AGI for me, and importantly doesn't ideologize like so many critiques of capitalism do.

So I'm new here and this website is great because it doesn't have bite-sized oversimplifying propaganda. But isn't that common everywhere else? Those posts seem very typical for reddit and at least they're not outright misinformation.

Also I... don't hate these memes. They strike me as decent quality. Memes aren't supposed to make you think deeply about things.

I also dislike many of the posts you included here, but I feel like this is perhaps unfairly harsh on some of the matters that come down to subjective taste; while it's perfectly reasonable to find a post cringe or unfunny for your own part, not everyone will necessarily agree, and the opinions of those who enjoy this sort of content aren't incorrect per se.

As a note, since it seems like you're pretty frustrated with how many of her posts you're seeing, blocking her might be a helpful intervention; Reddit's help page says blocked users' posts are hidden from your feeds.

Owen, have you looked at the GitHub issues in your repo? There are other issues too. I submitted one here about wrong labels.

I really think it's worth making TruthfulQA 2.0, give the amount of usage it sees and the room for improvement.

TruthfulQA is actually quite bad. I don't blame the authors, as no one has made anything better, but we really should. It's only ~800 samples. And many of them are badly labelled.