Posts

Comments

Comment by MrCheeze on The ‘ petertodd’ phenomenon · 2023-04-15T17:49:44.624Z · LW · GW

Doesn't strike me as inevitable at all, just a result of OpenAI following similar methods for creating their tokenizer twice. (In both cases, leading to a few long strings being included as tokens even though they don't actually appear frequently in large corpuses.)

They presumably had already made the GPT-4 tokenizer long before SolidGoldMagikarp was discovered in the GPT-2/GPT-3 one.

Comment by MrCheeze on The ‘ petertodd’ phenomenon · 2023-04-15T12:46:52.055Z · LW · GW

Prior to OpenAI's 2023-02-14 patching of ChatGPT (which seemingly prevents it from directly encountering glitch tokens like ‘ petertodd’)

I've never seen it mentioned around here, but since that update, ChatGPT is using a different tokenizer that has glitch tokens of its own:

https://github.com/openai/tiktoken/blob/46287bfa493f8ccca4d927386d7ea9cc20487525/tiktoken/model.py#L16

https://wetdry.world/@MrCheeze/110130795421274483
 

Comment by MrCheeze on Rationality Quotes September 2012 · 2013-01-26T03:10:32.520Z · LW · GW

I'd say this captures the spirit of Less Wrong perfectly.

Comment by MrCheeze on Unbounded Scales, Huge Jury Awards, & Futurism · 2012-10-28T00:48:19.245Z · LW · GW

500 years still sounds optimistic to me.

Comment by MrCheeze on AI timeline predictions: are we getting better? · 2012-09-10T02:46:25.829Z · LW · GW

The key is in the phrase "much more complicated". The sort of algorithm that could become a mind would be an enormous leap forward in comparison to anything that has ever been done so far.

Comment by MrCheeze on AI timeline predictions: are we getting better? · 2012-08-30T18:46:54.927Z · LW · GW

Man, people's estimations seem REALLY early. The idea of AI in fifty years seems almost absurd to me.

Comment by MrCheeze on Math is Subjunctively Objective · 2012-08-12T02:31:23.472Z · LW · GW

I still stand by my belief that 2 + 3 = 5 does not in fact exist, and yet it is still true that adding two things with three things will always result in five things.

Comment by MrCheeze on How to Seem (and Be) Deep · 2012-06-04T00:54:08.450Z · LW · GW

"I think that if you took someone who was immortal, and asked them if they wanted to die for benefit X, they would say no."

This doesn't help against arguments that stable immortality is impossible or incredibly unlikely, of course, but I suppose those aren't the arguments you were countering at the time.

Comment by MrCheeze on Pascal's Mugging: Tiny Probabilities of Vast Utilities · 2012-04-23T22:33:33.449Z · LW · GW

Yes, but the chance of magic powers from outside the matrix is low enough that what he says has an insignificant difference.

...or is an insignificant difference even possible?

Comment by MrCheeze on SIAI - An Examination · 2011-10-11T00:31:00.914Z · LW · GW

Hm. I'd rather have seen more of the analysis on whether what they do with the money is useful, but this is something.

Comment by MrCheeze on "Stuck In The Middle With Bruce" · 2011-10-09T23:22:45.304Z · LW · GW

Hmm, didn't really get anything out of this. Maybe you need to be able to be competent at stuff in the first place to sabotage yourself?

Comment by MrCheeze on Prisoner's Dilemma Tournament Results · 2011-09-08T00:52:07.386Z · LW · GW

If this ever happens again I'd make one for the long-term evolutionary one that tries to learn strategies U-style, and then remembers what it learned in future rounds. If that's allowed.

Comment by MrCheeze on On the unpopularity of cryonics: life sucks, but at least then you die · 2011-08-31T04:21:36.107Z · LW · GW

Shouldn't priority be given to improving quality of lives first?

Comment by MrCheeze on An Outside View on Less Wrong's Advice · 2011-07-12T14:49:24.699Z · LW · GW

It makes me sad because it means smart people aren't doing things that are actually useful.

Comment by MrCheeze on Decoherence is Simple · 2011-03-16T15:19:41.915Z · LW · GW

This isn't quite what your post was about, but one thing I've never understood is how anyone could possibly find "the universe is totally random" to be a MORE simple explanation.

Comment by MrCheeze on To Spread Science, Keep It Secret · 2011-02-07T21:20:12.114Z · LW · GW

Well this explains a lot.

Comment by MrCheeze on Counterfactual Calculation and Observational Knowledge · 2011-02-07T20:58:28.701Z · LW · GW

The thing is, the other world was chosen specifically BECAUSE it had the opposite answer, not randomly like the world you're in.

Comment by MrCheeze on Why Truth? · 2011-01-31T03:49:20.658Z · LW · GW

Maybe in ninety-eight universes out of 100 it does blow up and we just see the one that's left; and he's actually giving an accurate number. :P

Comment by MrCheeze on Not Taking Over the World · 2011-01-31T03:35:08.913Z · LW · GW

"Give it to you" is a pretty lame answer but I'm at least able to recognise the fact that I'm not even close to being a good choice for having it.

That's more or less completely ignoring the question but the only answers I could ever come up with at the moment are what I think you call cached thoughts here.

Comment by MrCheeze on 31 Laws of Fun · 2011-01-31T03:08:21.889Z · LW · GW

Well it's good to see that if you somehow found a way to implement your ideas you would at least do it well.

Comment by MrCheeze on You Only Live Twice · 2011-01-23T23:43:59.553Z · LW · GW

retracted

Comment by MrCheeze on The Moral Void · 2010-12-12T18:31:26.644Z · LW · GW

So... the correct answer is to dissolve the question, yes?

Comment by MrCheeze on The Hero With A Thousand Chances · 2010-12-10T21:54:32.837Z · LW · GW

I had trouble reading it too. If you really don't want to do it like that, then at least just take out all the quotes except for at the very beginning and end of the speech (no quotes at all between paragraphs).

Comment by MrCheeze on Two Cult Koans · 2010-12-02T21:27:51.570Z · LW · GW

Okay, I have no idea whatsoever what this is supposed to be saying.

EDIT: Wait, hold on. Is it supposed to not make sense?

Comment by MrCheeze on The Sword of Good · 2010-12-02T21:21:48.874Z · LW · GW

Loved the story and also the first time I took you strong atheism completely seriously, but I think that one bit where they stab those three sleeping guys went a bit too strongly to the "no, this definately isn't right" side of things. Although I didn't think about that scene at all when I was trying to figure out which side was the Good side and thought about the death of Alek as my main piece of evidence for the Lord of Dark being Bad possibility so that's something.