keltan's Shortform

post by keltan · 2024-04-25T12:07:41.753Z · LW · GW · 53 comments

Contents

53 comments

53 comments

Comments sorted by top scores.

comment by keltan · 2024-05-29T18:30:38.551Z · LW(p) · GW(p)

From Newcastle, Australia to Berkeley, San Francisco. I arrived yesterday for Less.online. I’ve had a bit of culture shock, a big helping of being increasingly scared, and quite a few questions. I’ll start with those. Feel free to skip them.

These questions are based on warnings I’ve gotten from local non-rationalists. Idk if they’re scared because of the media they consume or because of actual stats. I’m asking these because they feel untrue.

  1. Is it ok to be outside after dark?
  2. Will I really get ‘rolled’ mid day in Oakland?
  3. Are there gangs walking around Oakland looking to stab people?
  4. Will all the streets fill up with homeless people at night?
  5. Are they chill? In Aus they’re usually down to talk if you are.

Culture shocks for your enjoyment:

  1. Why is everyone doing yoga?
  2. To my Uber driver: “THAT TRAIN IS ON THE ROAD!?”
  3. “I thought (X) was just in movies!”
  4. Your billboards are about science instead of coal mining!
  5. “Wait, you’re telling me everything is vegan?” Thank Bayes, this is the best. All our vegan restaurants went out of business.
  6. People brag about things? And they do it openly? At least, I think that’s what’s happening?
  7. “Silicon Valley is actually a valley?!” Should have predicted this one. I kinda knew, but I didn’t know like I do now.
  8. “Wow! This shop is openly selling nangs!” (whip its) “And a jungle juice display!”
  9. All your cars are so new and shiny. 60% of ours are second hand
  10. Most people I see in the streets look below 40. It’s like I’m walking around a university!
  11. Wow. It’s really sunny.
  12. American accents irl make me feel like I’m walking through a film.
  13. “HOLY SHIT! A CYBER TRUCK?!”
  14. Ok this is a big one. Apps I’ve had for 8+ years are suddenly different when I arrive here?
  15. This is what Uber is meant to be. I will go back to Australia and cry. Your airport has custom instruction… in app! WHAT!? The car arrives in 2 minutes instead of 30 minutes. Also, the car arrives at all.
  16. The google app has a beaker for tests now?
  17. Snap maps has gifs in it
  18. Apple Maps lets you scan buildings? And has tips about good restaurants and events?
  19. When I bet in the Manifold app. A real paper Crain flies from the nearest tree, lands in front of me and unfolds. Written inside, “Will Eliezer Yudkowsky open a rationalist bakery?” I circle “Yes”. The paper meticulously folds itself back to a Crain. It looks at me. Makes a little sound that doesn’t echo in the streets but in my head, and it burns. Every time this happens I save the ashes. Are Manifold creating new matter? How are they doing this?
  20. That one was a lie

Things that won’t kill me but scare me rational/irrational:

  1. What if I’ve been wrong? What if this is all a scam? A cult? What if Mum was right?
  2. What if I show up to the location and there is no building there?
  3. What if I make some terribly awkward cultural blunder for SF and everyone yells at me?
  4. What if no one tells me?
  5. I’m sure I’ll be at least in the bottom 5% for intelligence at Less Online. I won’t be surprised or hurt if I’ve got the least Gs of people there. But what if it all goes over my head? Maybe I can’t even communicate with smart people about the things I care about.
  6. What if I can’t handle people telling me what they think of my arguments without kid gloves? What if I get angry and haven’t learnt to handle that?
  7. I’m just a Drama teacher and Psych student. My head is filled with improv games and fun facts about Clever Hans! ‘Average’ Americans seem to achieve much higher than ‘average’ Australians. I’m scared of feeling under qualified.

Other things:

  1. Can you think of something I should be worried about, that I’ve not written here?
  2. I’ve brought my copies of the Rationality A-Z books. I want to ask people I meet to sign their favourite post in the two books. Is that culturally acceptable? Feels kinda weird bc Yud is going to be there. But it would be a really warm/fuzzy item to me in the future.
  3. I don’t actually know what a lot of the writers going look like. I hope this doesn’t result in a blunder. But might be funny, given that I expect rationalists to be pretty chill.
  4. Are other people as excited about the Fooming Shoggoths as I am?
  5. I’m 23, I have no idea if that is very old, very young, or about normal for a rationalist. I’d guess about normal, with big spread across the right of a graph.

It feels super weird to be in the same town as a bunch of you guys now. I’ve never met a rationalist irl. I talked to Ruby over zoom once, who said to me “You know you don’t have to stay in Australia right?” I hope Ruby is a good baseline for niceness levels of you all.

If you’re going, I’ll see you at Less.Online. If you’re not, I’d still love to meet you. Feel free to DM me!

Replies from: davekasten, Nathan Young, lahwran, Screwtape, Nisan, cata, austin-chen, Viliam
comment by davekasten · 2024-05-30T04:40:19.327Z · LW(p) · GW(p)

I would bet hard cash that "I’m sure I’ll be at least in the bottom 5% for intelligence at Less Online. I won’t be surprised or hurt if I’ve got the least Gs of people there" is wrong.  

But okay, let's just go with your fears and assume for sake of argument that you're right...  Last year,  Aella did a live polling event at Manifest where she asked us to, in general, first predict how we relatively compared to the crowd on any N, then define actual buckets of values and arrange ourselves by those buckets.  

(So, e.g., "predict how recently have you exercised compared to others; the most recent, all the way on the left, the least recent, all the way on the right" and then "okay, let's define from that fence to that chair as 'in the last hour', the chair to the steps as 'in the last day', etc." and have folks line up twice based on first their relative guess, then their actual value.)

I was overall deeply surprised when she had folks line up under that system by SAT scores and IQ scores.  It was, generally, extremely poorly correlated with how awesome it was to get to talk with a given person.

This post already expresses a great deal of the vibes that make me think it will be awesome to meet you, and that you get a lot of the vibes folks are aiming for, as far as I can tell.  Looking forward to meeting ya!

comment by Nathan Young · 2024-05-30T04:42:26.149Z · LW(p) · GW(p)

Re safety, I don't know about Oakland but some parts of SF are genuinely the most dangerous feeling places I've ever been to after dark (because normally I wouldn't go somewhere, but SF feels very fine until it isn't). If I am travelling to places in SF after dark I'll check how dodgy the street entrances are. 

comment by the gears to ascension (lahwran) · 2024-05-30T08:31:25.193Z · LW(p) · GW(p)

Have fun! I won't be going. Some random notes:

  • berkeley, san francisco is like saying maitland, newcastle
  • re: #1: yeah I don't feel unsafe outside after dark in the bay. If a homeless person walks by, I'll just say hi and ask if they have any urgent unmet needs. even just acknowledging them as a person is a nice gesture, though. many will try to engage much more than you have time or interest for; it's okay to just walk away from the convo.
  • had to look up what "getting rolled" is. yeah, it's possible, but not that hard to avoid. if an area seems very poor, there will be more desperate people. but the highest risk of being robbed is probably opportunistically on the train. keep your eyes mobile; it's probably a 1 in 300 to 1 in 3,000 train trips event, but it's pretty annoying when it happens, to put it mildly.
  • I'm not aware of there being an intense presence of organized aggressive groups in oakland, but there's certainly plenty of disorganized aggression, again mostly from desperate people. I got out of what was going to be a mugging once by offering to send them internet money (venmo) before they asked for anything, and they were so knocked off balance by this (I was saying "I don't have cash but I can send it on an app") that they almost bolted instead of accepting it. carry cash if you want to share it on purpose (people ask for money a lot and it feels nicer to say yes than no); don't if you don't. it's not as bad as some places though, because the warmth means less desperation from homeless folks; homeless folks are usually pretty chill, if rather upset at the system. there is a specific ongoing aggressive presence: there are organized car-breakin and bike theft rings. but I don't think it's like gangs you may have heard about in the past in LA. the theft rings generally want to grab the thing and get the fuck away, not engage. if you hadn't asked and nobody had told you, you probably wouldn't even have noticed anything besides harmless homeless people mumbling something they think is interesting under their breath and not expecting to be understood because they get ignored by everyone.
  • yeah homeless people often have tents. it's not where a civ would hope to be, but tents are just houses. treat it similarly.
  • is it a cult: you tell me whether it has the bad patterns that define cults. I'd personally say there have been cults spawned by it, but it's more of a general community, with reasonably healthy community patterns. Don't (ever) let your guard down about cults, though, in any context.
  • you should be worried someone convinces you to move to the bay. it's not worth it. like, literally entirely for cost of housing reasons, no other reason, everything else is great, there's a reason people are there anyway. but phew, the niceness comes with a honkin price tag. and no, living in a 10ft by 10ft room to get vaguely normal sounding rent is not a good idea, even though it's possible.
  • average bay area people are definitely overachievers, see above about cost of housing. this is not true of america in general.
  • the most important california warnings are about weed: don't buy weed. DON'T USE INHALED WEED. edibles can be a bad time if you take more than you think you're taking, but won't ruin your whole life as long as you go in with steadfast rules about when you have them, and rules like not buying them yourself. in fact, never use an inhaled or injected recreational drug, period - the fast uptake is extremely dangerous and will likely actually knock your motivation system off balance hard enough to probably ruin your life. you probably won't be offered weed unless you ask for it, and even then most people won't have any to share. If they do, it might be because they have a bad habit. It's a fun drug when contained to a social setting, though. if someone has some I might suggest trying 2mg or less (ie, one fifth chunk of a normal 10mg edible), even if you're used to weed it's not the vibe I'd suggest for highly technical conversations.
Replies from: Algon, frankybegs, keltan
comment by Algon · 2024-05-30T12:10:22.175Z · LW(p) · GW(p)
  • you should be worried someone convinces you to move to the bay. it's not worth it. like, literally entirely for cost of housing reasons, no other reason, everything else is great, there's a reason people are there anyway. but phew, the niceness comes with a honkin price tag. and no, living in a 10ft by 10ft room to get vaguely normal sounding rent is not a good idea, even though it's possible.

Why's this not a good idea? 10ft by 10ft is a lot of room. More than I had in some flats when I went to university.

Replies from: lahwran
comment by the gears to ascension (lahwran) · 2024-05-30T17:54:03.861Z · LW(p) · GW(p)

I went pretty stir crazy without enough room to move around.

Replies from: Algon
comment by Algon · 2024-05-30T18:46:35.097Z · LW(p) · GW(p)

That's fair, but it sounds like a personal preference. I asked because maybe you knew there was something unusually bad about small flats in the Bay Area that even folks like me would find annoying. 

comment by frankybegs · 2024-05-30T23:29:24.094Z · LW(p) · GW(p)

in fact, never use an inhaled or injected recreational drug, period - the fast uptake is extremely dangerous and will likely actually knock your motivation system off balance hard enough to probably ruin your life.

I don't think this can be remotely justified by the evidence, formal or anecdotal. Inhaling weed isn't dangerous, let alone extremely so, and will almost certainly not ruin anyone's life, as the hundreds of millions of happy users can attest (get yours today!) Hell, shisha is an inhaled recreational drug!

I'm not sure it makes sense to generalise about an entire method of delivery, when all sorts of substances with very different effects can be consumed that way.

comment by keltan · 2024-05-30T17:47:24.241Z · LW(p) · GW(p)

That first point made me laugh. It’s exactly the type of mistake I expected to make, and I still didn’t see it coming.

I appreciate all this safety advice and will update my decision making based on that.

Geez, the weed thing surprises me. I hadn’t planned to smoke any until after the event. But I think I’ll avoid that now. I’m already struggling with motivation from jet lag. I don’t want to increase that feeling.

Replies from: frankybegs, lahwran
comment by frankybegs · 2024-05-30T23:30:31.350Z · LW(p) · GW(p)

The weed thing is not true. It can sap your motivation acutely, and perhaps even have a more sustained (if definitely temporary) effect. But it certainly doesn't ruin your life by instantly "knocking your motivational system off balance".

comment by the gears to ascension (lahwran) · 2024-05-30T18:01:07.438Z · LW(p) · GW(p)

It's a relatively chemically safe drug, but is easily habit forming and knocks you out of a productive space if used more than once every 3 to 6 months, imo. your reasoning seems reasonable. have fun with the trip!

comment by Screwtape · 2024-05-30T06:08:06.239Z · LW(p) · GW(p)

I think go ahead and ask people to sign things. I've done it before and it went great, and the resulting book is a great memento. You've got a good conversation starter right there with asking them their favourite sequences post.

Welcome to the US!

comment by Nisan · 2024-05-29T21:06:01.836Z · LW(p) · GW(p)

Re: safety, it depends on exactly where you are, your skill in assessing strangers' intentions from a distance, and probably the way you carry yourself.

Speaking of which, I'd be interested in playing some improv games with you at less.online, if you want to do that!

Replies from: keltan
comment by keltan · 2024-05-30T02:24:24.823Z · LW(p) · GW(p)

Hmmm, I think I’m mostly bad at those things. I’ll play it safe.

And thanks for the good idea! I’ve added a session at 3pm on the Sunday.

comment by cata · 2024-06-22T06:03:44.644Z · LW(p) · GW(p)

How did you like your trip in the end?

Replies from: keltan
comment by keltan · 2024-06-22T07:29:20.025Z · LW(p) · GW(p)

I’m messing around with a post about this. However:

  • overwhelmingly positive
  • with a few things I was a little icked about But I need to think about that more to understand if it’s a problem with me, or the thing that made me icked out

And thanks for checking in. That’s very kind of you

comment by Austin Chen (austin-chen) · 2024-05-30T03:57:57.389Z · LW(p) · GW(p)

Welcome to the US; excited for your time at LessOnline (and maybe Manifest too?)

And re: 19., we're working on it![1]

  1. ^

    (Sorry, that was a lie too.)

comment by Viliam · 2024-05-31T17:27:19.229Z · LW(p) · GW(p)

Are there gangs walking around Oakland looking to stab people?

Please don't ask on Manifold, you might incentivize creating one.

comment by keltan · 2024-05-17T01:17:05.797Z · LW(p) · GW(p)

Note to self, write a post about the novel akrasia solutions I thought up before becoming a rationalist.

  • Figuring out how to want to want to do things
  • Personalised advertising of Things I Wanted to Want to Do
  • What I do when all else fails
Replies from: TrevorWiesinger, keltan
comment by trevor (TrevorWiesinger) · 2024-05-17T22:51:14.917Z · LW(p) · GW(p)

Have you tried whiteboarding-related techniques?

I think that suddenly starting to using written media (even journals), in an environment without much or any guidance, is like pressing too hard on the gas; you're gaining incredible power and going from zero to one on things faster than you ever have before. 

Depending on their environment and what they're interested in starting out, some people might learn (or be shown) how to steer quickly, whereas others might accumulate/scaffold really lopsided optimization power and crash and burn (e.g. getting involved in tons of stuff at once that upon reflection was way too much for someone just starting out).

Replies from: keltan
comment by keltan · 2024-05-18T03:24:50.890Z · LW(p) · GW(p)

This seems incredibly interesting to me. Googling “White-boarding techniques” only gives me results about digitally shared idea spaces. Is this what you’re referring to? I’d love to hear more on this topic.

comment by keltan · 2024-05-17T01:17:58.126Z · LW(p) · GW(p)

Maybe I could even write a sequence on this?

comment by keltan · 2024-09-01T22:38:24.948Z · LW(p) · GW(p)

I was recently ease-dropping on a loud phone conversation. A man, maybe late 40s? Had been cheated on. He was angry. He was arguing with his girlfriend.

I noticed that all he argued the way people argue in movies. “Put yourself in my shoes”, “No, you listen to me!”, “I thought you would be the one!”. It hurt to listen to someone in pain.

A few weeks later, I was in a heated discussion with some Non-Rationalist friends. Long story short, I failed to output correct emotional signals, which was making them upset. I noticed the same thing in them. Copying the way people argue on social media. It felt ‘Therapy Culture’ for lack of a better descriptor.

But then I noticed myself. Do you remember when Sam Altman went on world tour? Doing tens of interviews. I watched every one of those. And that is now how I speak in arguments. I think this sounds like a bad thing. Because of what we now know about Sam. But I personally trusted him when he spoke back then.

The moral is, you are what you consume. Be careful.

comment by keltan · 2024-11-28T21:18:15.812Z · LW(p) · GW(p)

Thought: Confidently saying “(X) has no Manhattan Project”. Is forgetting how secret the Manhattan Project was.

Replies from: gwern, Seth Herd
comment by gwern · 2024-11-29T00:52:15.969Z · LW(p) · GW(p)

Which was not terribly secret. The details of the Project were indeed super-secret, to the point where most of the politicians hadn't known anything, but despite the massive global-scale censorship & secrecy, many had observed the signs of a major project of some sort and some got as far as a nuclear bomb specifically. Also, commercial satellites with meter resolution did not exist which could quantify major facilities or new cities like Los Alamos or Hanford (but overflights, and then satellites, now exist and have helped reveal later top-secret nuclear bomb programs). An AI Manhattan Project, as we currently think of it, would be amusingly similar in footprint (eg. energy consumption) to the original and often observable from space: all those gigawatts have to go somewhere, after all.* I'm sure you can find plenty more about secrecy breaches in Rhodes.

This was not necessarily all that useful in the context of WWII - of course America had some big secret projects going, everyone did. It was a total world war. Everyone was aware there was a war on. The devil was in the details of what the program was - a failure like the V2-s, or a success like Enigma decrypts and Manhattan? But a binary exists/does-not-exist is useful in a peacetime context and the current discussion.

(If nothing else, the fact that DeepSeek keeps publishing is a signal. I would note here BTW that you cannot argue, without tying yourself into some pretzel knots explaining 4-D chess logic, that Chinese AI is about to catch up to and surpass the West because the best Chinese AI group, DeepSeek, just released a model or published this-or-that revealing the secrets of OA, and argue that there is already a secret all-out Chinese Manhattan Project going on which will potentially reach AGI first - because the first thing the latter would have done is stop the former from publishing anything which might help Western AI and then devour it for researchers.)

* A wag on Twitter has pointed out that the total energy/heat output of something like a GPT-4 or GPT-5 training run is the same as or larger than the output of a Hiroshima/Nagasaki-scale nuclear bomb explosion. Which is helpful intuition for why your datacenters need so much cooling, at least.

Replies from: rhollerith_dot_com, anaguma
comment by RHollerith (rhollerith_dot_com) · 2024-11-29T02:27:08.710Z · LW(p) · GW(p)

new cities like Los Alamos or Hanover

You mean Hanford.

comment by anaguma · 2024-11-29T06:29:57.565Z · LW(p) · GW(p)

What signal do we get from DeepSeek continuing to publish?

comment by Seth Herd · 2024-11-28T22:50:12.165Z · LW(p) · GW(p)

Before the internet?

I think the idea is that there would be clues, particularly talented engineers not doing public work. Of course, I don't know who's carefully tracking that for Chinese scientists.

Scientists did guess the Manhattan project existed because several top physicists had ceased publishing. I don't know if that made it to the relevant governments. That would be vastly easier to do with the internet - if anyone is bothering.

comment by keltan · 2024-04-25T12:07:41.833Z · LW(p) · GW(p)

A potentially good way to avoid low level criminals scamming your family and friends with a clone of your voice is to set a password that you each must exchange.

An extra layer of security might be to make the password offensive, an info hazard, or politically sensitive. Doing this, criminals with little technical expertise will have a harder time bypassing corporate language filters.

Good luck getting the voice model to parrot a basic meth recipe!

Replies from: lahwran, Dagon
comment by the gears to ascension (lahwran) · 2024-04-26T08:07:39.805Z · LW(p) · GW(p)

Good luck getting the voice model to parrot a basic meth recipe!

This is not particularly useful, plenty of voice models will happily parrot absolutely anything. The important part is not letting your phrase get out; there's work out there on designs for protocols for how to exchange sentences in a way that guarantees no leakage even if someone overhears.

comment by Dagon · 2024-04-25T20:33:58.373Z · LW(p) · GW(p)

Hmm.  I don't doubt that targeted voice-mimicking scams exist (or will soon).  I don't think memorable, reused passwords are likely to work well enough to foil them.  Between forgetting (on the sender or receiver end), claimed ignorance ("Mom,  I'm in jail and really need money, and I'm freaking out!  No, I don't remember what we said the password would be"), and general social hurdles ("that's a weird thing to want"), I don't think it'll catch on.

Instead, I'd look to context-dependent auth (looking for more confidence when the ask is scammer-adjacent), challenge-response (remember our summer in Fiji?), 2FA (let me call the court to provide the bail), or just much more context (5 minutes of casual conversation with a friend or relative is likely hard to really fake, even if the voice is close).

But really, I recommend security mindset and understanding of authorization levels, even if authentication isn't the main worry.  Most friends, even close ones, shouldn't be allowed to ask you to mail $500 in gift cards to a random address, even if they prove they are really themselves.

Replies from: keltan
comment by keltan · 2024-04-25T22:03:56.626Z · LW(p) · GW(p)

I now realize that my thinking may have been particularly brutal, and I may have skipped inferential steps.

To clarify, If someone didn't know, or was reluctant to repeat a password, I would end contact or request an in person meeting.

But to further clarify, that does not make your points invalid. I think it makes them stronger. If something is weird and risky, good luck convincing people to do it.

comment by keltan · 2024-12-04T22:46:46.563Z · LW(p) · GW(p)

I’m not entirely sure why, but I find it trivial to get GPT-4o to output harmful content in advanced voice mode (AVM), given that it doesn’t have a direct content filter on it e.g. NSFW.

In the span of 30 minutes it gave me 1) instructions to make a pipe bomb to attach to a car. And 2) Instructions on how to leak a virus into the public without detection (avoiding saying more on this).

I have a theory as to why it might be easy for me specifically. But I would like to know if this is the experience that others have with AVM?

Replies from: abandon
comment by dirk (abandon) · 2024-12-04T23:09:00.320Z · LW(p) · GW(p)

I haven't tried harmful outputs, but FWIW I've tried getting it to sing a few times and found that pretty difficult.

Replies from: keltan
comment by keltan · 2024-12-05T02:10:00.875Z · LW(p) · GW(p)

Hu. That is extremely useful. Thank you. 

I've got a lot of singing out of AVM. While my current method works well for this, I find it more challenging than eliciting harmful outputs.

Replies from: daya-chowdry
comment by Daya Chowdry (daya-chowdry) · 2024-12-05T06:15:19.973Z · LW(p) · GW(p)

Did you use any specific prompt in memory or custom instructions?

Replies from: keltan
comment by keltan · 2024-12-05T22:15:43.118Z · LW(p) · GW(p)

Omg. Oops! I completely forgot about custom instructions and memory! I’ll run some more trials with those off. Thank you very much for pointing this out.

comment by keltan · 2024-12-22T01:34:18.722Z · LW(p) · GW(p)

My timelines have now updated to something closer to fast takeoff. In a world like this, how valuable is educating the general public? Claude claims science started worrying about the climate in the 50s/60s. It wasn't until 2010s that we saw meaningful action beginning to take place. Do we have the time to educate?

To be clear, this is more of a question than an opinion that I hold. I am working to form an opinion.

Replies from: elriggs, ChristianKl, nc
comment by Logan Riggs (elriggs) · 2024-12-22T12:28:49.188Z · LW(p) · GW(p)

In my experience, most of the general public will verbally agree that AI X-risk is a big deal, but then go about their day (cause reasonably, they have no power). There's no obvious social role/action to do in response to that.

For climate, people understand that they should recycle, not keep the water running, and if there's a way to donate to clean the ocean on a Mr. Beast video, then some will even donate (sadly, none of these are very effective for solving the climate problem though! Gotta avoid that for our case).

Having a clear call-to-action seems relevant. For example, educating the public about AI taking jobs for the purpose of building support for UBI. It's then clear what to communicate and the call-to-action.

I'd be curious to hear what you think an ask should be? 

Alternatively, you could argue that generally informing folks on a wide scale about the risks involved will then allow general public to do what they believe is locally best. This could involve a documentary or realistic movie.

comment by ChristianKl · 2024-12-22T15:52:11.017Z · LW(p) · GW(p)

What do you mean with "meaningful action" regarding climate in the 2010s?

If you look at solar energy, panel prices go down largely in a straight (on a logarithmic scale) since 1975 with a short pause between 2005 to 2010. German pro-solar policy started in the 1990 and the biggest change in 2011 was the new five-year plan of th CCP which was probably driven more by economic justifications.

There are few people who currently think we should do whatever is possible to reduce temperature rise. Doing so would mean to have a plan for geoengineering. Climate activist often use climate as a justification to push for anticapitalist policies that they independently believe.

comment by nc · 2024-12-22T16:43:54.069Z · LW(p) · GW(p)

The fight for human flourishing doesn't end at the initiation of takeoff [echo many points from Seth Herd [LW · GW] here]. More generally, it's very possible to win the fight and lose the war, and a broader base of people who are invested in AI issues will improve the situation.

 

(I also don't think this is an accurate simplification of the climate movement or its successes/failures. But that's tangential to the point I'd like to make.)

comment by keltan · 2024-09-23T06:41:54.613Z · LW(p) · GW(p)

If I had sufficient funds. I would consider if it would be beneficial to invade a few subreddits, and offer $1000 to whoever can make the most viral meme that subtly teaches basic concepts of AI Doom.

This thought stems from a comment on “The Best Lay Argument is not a Simple English Yud Essay”. I have more thoughts, but not much time. If my reasoning is unclear I apologise.

comment by keltan · 2024-07-02T23:02:04.815Z · LW(p) · GW(p)

Idk if people around the world have those cardboard “Recycle your phone” boxes. That take phones and recycle their components. But I’ve rummaged through a certain one ~5 different times and found 2 completely functional and reset iPhones.

Surely there’s something better we can do with these than disassembling them?

Replies from: gwern
comment by gwern · 2024-07-03T00:05:49.823Z · LW(p) · GW(p)

Sounds like that would encourage theft.

comment by keltan · 2024-05-11T02:49:10.995Z · LW(p) · GW(p)

I currently am completing psychological studies for credit in my university psych course. The entire time, all I can think is “I wonder if that detail is the one they’re using to trick me with?”

I wonder how this impacts results. I can’t imagine being in a heightened state of looking out for deception has no impact.

comment by keltan · 2024-11-06T22:17:38.678Z · LW(p) · GW(p)

I recently saw a tweet that asked GPT, what micro skills a person should master. I asked Claude a similar question, though had preloaded the conversation with “things a modern day Aristotle would teach a 24yo student”.

I think this is probably a valuable exercise to undertake yourself. I’m providing my prompt, and Claude’s response as an ‘appetiser’ to get you interested in this task.

Prompt Wonderful. Now Let's think less utilized by society. What are some more niche micro skills that you would want a person who you are tutoring to have. And this is given that you want them to be as successful as possible.​​​​​​​​​​​​​​​​

Claude Let me think deeply about valuable micro skills that are often overlooked but can create significant advantages in life...

  1. Cold Reading & Behavioral Analysis
  • Understanding micro-expressions
  • Picking up on subtle vocal tone changes
  • Recognizing behavioral patterns in groups
  • Reading body language clusters rather than isolated gestures
  • This isn't about manipulation, but rather developing deeper empathy and understanding
  1. Strategic Silence & Information Management
  • Knowing when not to speak
  • Understanding information asymmetry
  • The power of selective disclosure
  • Using thoughtful pauses in conversation
  • The art of asking rather than telling
  1. Scenario Planning & Secondary Consequence Analysis
  • Ability to see 3-4 moves ahead in decisions
  • Understanding cascade effects
  • Identifying hidden risks and opportunities
  • Planning for both success and failure scenarios
  • Recognition of system dynamics
  1. Social Capital Accounting
  • Understanding relationship networks
  • Tracking favors and obligations implicitly
  • Building genuine reciprocity
  • Recognition of social momentum
  • Understanding status games without playing them
  1. Energy Management & Recovery Tactics
  • Understanding personal energy patterns
  • Quick recovery techniques between intense tasks
  • Environmental design for optimal performance
  • Micro-rest optimization
  • State switching abilities
  1. Pattern Recognition Across Domains
  • Transferring insights between unrelated fields
  • Spotting emerging trends early
  • Recognition of historical rhymes
  • Understanding cyclic behaviors
  • Identifying underlying principles
  1. Meta-Learning Optimization
  • Learning how you specifically learn best
  • Creating personal knowledge management systems
  • Information synthesis techniques
  • Retention optimization
  • Skill transfer mechanisms
  1. Probabilistic Thinking & Calibration
  • Understanding base rates
  • Recognizing cognitive biases in real-time
  • Bayesian updating in daily life
  • Risk assessment calibration
  • Decision journaling
  1. Attention Direction & Management
  • Understanding attention as a finite resource
  • Strategic ignorance
  • Focus maintenance techniques
  • Context switching optimization
  • Signal-to-noise ratio improvement
  1. Time Perception Management
  • Understanding psychological time vs clock time
  • Managing time horizons
  • Chronotype optimization
  • Timeline compression and expansion techniques
  • Personal tempo awareness

Would you like me to elaborate on any of these? I find them fascinating because they're rarely taught explicitly yet can be transformative when mastered. I'm curious which ones resonate most with you?

These skills compound over time and create second-order advantages that aren't immediately obvious to others. They're also relatively timeless - they worked in ancient Athens and still work today.​​​​​​​​​​​​​​​​

Replies from: CstineSublime, keltan
comment by CstineSublime · 2024-11-07T00:02:38.470Z · LW(p) · GW(p)

I'm curious why you opted for Aristotle (albeit "modern") as the prompt pre-load? Most of those responses seem not directly tethered to Aristotelian concepts/books or even what he directly posits as being the most important skills and faculties of human cognition. For example, cold reading, I don't recall anything of the sort anywhere in any Aristotle I've read. 

While we're not sure Aristotle himself designed the layout of the corpus, we do know that in the Nicomachean Ethics lists the faculties of "whereby the soul attains Truth":

Techne (Τεχνε) - which refers to conventional ways of achieving goals, i.e. without deliberation 
Episteme (Επιστήμε) - which is apodeiktike or the faculty of arguing from proofs
Phronesis (Φρονέσις) - confusingly translated as "practical wisdom" this refers to the ability to deliberate to attain goals by means of deliberation. Excellence in phronesis is translated by the latinate word 'Prudence'.
Sofia (Σοφια) - often translated as 'wisdom' - Aristotle calls this the investigation of causes.
Nous (Νους ) - which refers to the archai - or the 'first principles'


According to Diogenes Laertius, the corpus (at least as it has come to us) divides into the practical books and the theoretical - the practical itself would be subdivided between the books on Techne (say Rhetoric and Poetics), and Phronesis (Ethics and Politics), the theoretical is then covered in works like the Metaphysics (which is probably not even a cohesive book, but a hodge-podge), Categories etc. etc. 

This would appear to me to be a better guide for the timeless education in Aristotelian tradition and how we should guide a modern adaptation.

comment by keltan · 2024-11-06T22:26:39.962Z · LW(p) · GW(p)

I asked for further details on the 10th point and Claude listed a bunch of stuff I’ve absolutely never heard of. I’d say it’s probably related to meditation if I had to guess. Here’s that.

Claude Let me break down Time Perception Management into its deeper components, as this is one of the most subtle yet powerful micro-skills...

  1. Understanding Psychological Time vs Clock Time
  • How different mental states alter time perception
    • Flow states can make hours feel like minutes
    • Anxiety can make minutes feel like hours
  • Learning to intentionally shift between time perspectives
    • When to use event-based time vs clock-based time
    • How to enter "timeless" states for creative work
  • Reading your internal clock
    • Understanding your natural rhythms
    • Recognizing when time perception is distorted by emotions
  1. Managing Time Horizons
  • Developing multiple concurrent time frames
    • Thinking in day/month/year/decade simultaneously
    • Balancing immediate tasks with long-term vision
  • Time horizon switching
    • When to zoom out to years
    • When to zoom in to minutes
    • How to maintain strategic clarity while handling tactics
  • Future-self continuity
    • Techniques for making future consequences feel real
    • Building strong mental connections to your future self
  1. Chronotype Optimization
  • Understanding your natural energy patterns
    • Peak creative hours
    • Peak analytical hours
    • Recovery periods
  • Designing your life around your chronotype
    • When to schedule different types of work
    • How to handle obligations that fight your natural rhythm
  • Seasonal adjustments
    • Adapting to changing daylight
    • Modifying routines for different seasons
  1. Timeline Compression and Expansion Techniques
  • How to make time feel longer when needed
    • Breaking experiences into smaller chunks
    • Increasing novelty to slow perceived time
    • Using attention to expand moments
  • How to make time feel shorter when beneficial
    • Chunking similar tasks
    • Creating flow states
    • Using routine to speed through necessary tasks
  1. Personal Tempo Awareness
  • Understanding your natural pace
    • Speaking tempo
    • Walking pace
    • Decision-making speed
  • Tempo matching and mismatching
    • When to match others' tempo
    • When to intentionally mismatch
    • How to set the tempo in group situations
  • Rhythm management
    • Creating sustainable work rhythms
    • Building in recovery cycles
    • Recognizing when to speed up or slow down
  1. Advanced Applications:
  • Using time perception in negotiations
    • Creating or relieving time pressure
    • Understanding how others perceive time
  • Memory engineering
    • Making good times feel longer in memory
    • Making difficult times feel shorter in memory
  • Social time management
    • Managing group time perception
    • Creating shared time experiences
  • Decision timing
    • Understanding when to decide quickly vs slowly
    • Recognizing optimal timing windows

This skill set is particularly valuable because most people are unconscious of how their time perception affects their decisions and experiences. Mastering it gives you significant advantages in:

  • Personal productivity
  • Emotional regulation
  • Strategic planning
  • Social influence
  • Life satisfaction

Would you like me to elaborate on any particular aspect? Or shall we explore how this connects with some of the other micro-skills we discussed?​​​​​​​​​​​​​​​​

comment by keltan · 2024-05-19T11:05:13.532Z · LW(p) · GW(p)

I’ve seen a lot about GPT4o being kinda bad, and I’ve experienced that myself. This surprises me.

Now I will say something that feels like a silly idea. Is it possible that having the audio/visual part of the network cut off results in 4o’s poor reasoning? As in, the whole model is doing some sort of audio/visual reasoning. But we don’t have the whole model, so it can’t reason in the way it was trained to.

If that is the case, I’d expect that when those parts are publicly released, scores on benchmarks shoot up?

Do people smarter and more informed than me have predictions about this?

Replies from: nw-daniel, andeslodes
comment by NW Daniel (nw-daniel) · 2024-05-19T17:53:17.736Z · LW(p) · GW(p)

Without a detailed Model Card for 4o it is impossible to know " for sure" why models drift in performance over time, but drift they do.

It is entirely possible that Open-AI started with a version of GPT-4 Turbo, parallelize processing and performed an extensive "fine tune" to improve the multi-modal capabilities.

Essentially, the model could "forget" how to complete prompuppies. Workhfrom just a week ago, because some of its "memory" was over-written with instructions to complete requests for multi-modal replies.

comment by andeslodes · 2024-05-19T14:45:18.801Z · LW(p) · GW(p)

I'm confused by what you mean that GPT-4o is bad? In my experience it has been stronger than plain GPT-4, especially at more complex stuff. I do physics research and it's the first model that can actually improve the computational efficiency of parts of my code that implement physical models. It has also become more useful for discussing my research, in the sense that it dives deeper into specialized topics, while the previous GPT-4 would just respond in a very handwavy way. 

Replies from: keltan
comment by keltan · 2024-05-19T21:05:16.386Z · LW(p) · GW(p)

Man, I wish that was my experience. I feel like I’m constantly asking GPT4o a question, getting a weird or bad response. Then switching to 4 to finish the job.

Replies from: ann-brown
comment by Ann (ann-brown) · 2024-05-20T16:24:39.999Z · LW(p) · GW(p)

Benchmarks are consistent with GPT-4o having different strengths than GPT4-Turbo, though at a similar overall level - EQ-Bench is lower, MAGI-Hard is higher, best tested model for Creative Writing according to Claude Opus, but notably worse at judging writing (though still good for its price point).

In my experience different strengths also mean different prompt strategies are necessary; a small highly instruction-focused model might benefit from few-shot repetition and emphasis that just distract a more powerful OpenAI model for example. Which might make universal custom instructions more annoying.