Posts

London Rationalish meetup - Lincoln's Inn Fields 2024-08-08T22:51:38.062Z
Book review: the Iliad 2024-06-18T18:50:21.941Z
Cryptocurrency taxation in the UK 2024-03-30T13:10:07.424Z
Conditional prediction markets are evidential, not causal 2024-02-07T21:52:47.476Z
London rationalish meetup: Feedbackloop-first rationality 2024-02-04T23:47:14.899Z
When and why should you use the Kelly criterion? 2023-11-05T23:26:38.952Z
Headphones hook 2023-09-29T22:50:04.962Z
London rationalish meetup - Thinking Physics 2023-09-03T22:47:05.391Z
Ruining an expected-log-money maximizer 2023-08-20T21:20:02.817Z
Three configurable prettyprinters 2023-08-10T23:10:02.000Z
How tall is the Shard, really? 2023-06-23T08:10:02.124Z
London rationalish meetup - relinquishing curiosity 2023-05-16T21:42:12.487Z
Does descaling a kettle help? Theory and practice 2023-05-02T20:20:04.401Z
London rationalish meetup 2023-02-08T21:17:36.417Z
Life Has a Cruel Symmetry 2023-01-23T23:40:04.161Z
When to mention irrelevant accusations? 2023-01-14T21:58:08.015Z
Smallpox Eradication Day Unconference 2022-12-02T19:25:05.532Z
On Kelly and altruism 2022-11-24T23:40:04.095Z
A list of Petrov buttons 2022-10-26T20:50:04.025Z
London Rationalish meetup 2022-10-06T23:19:30.042Z
London Rationalish meetup 2022-09-10T11:18:45.700Z
London Rationalish meetup 2022-08-07T23:00:54.924Z
PD-alikes in two dimensions 2022-04-23T09:52:38.765Z
Variadic functions in Hindley Milner 2022-04-02T20:00:03.972Z
London rationalish meta-meetup 2022-03-10T23:04:00.845Z
London Rationalish meetup 2022-02-11T22:22:21.160Z
Walkthrough: Filing a UK self-assessment tax return 2021-12-29T23:10:03.764Z
Ten Hundred Megaseconds 2021-09-20T21:30:05.464Z
Against "blankfaces" 2021-08-08T23:00:04.126Z
Book Review: Order Without Law 2021-07-10T21:50:03.589Z
99% shorter 2021-05-27T19:50:03.532Z
philh's Shortform 2021-04-22T20:50:46.556Z
A command-line grammar of graphics 2021-03-30T20:30:03.071Z
Haskenthetical update: user-defined macros 2021-03-14T21:20:04.108Z
Specialized Labor and Counterfactual Compensation 2020-11-14T18:13:43.044Z
Against boots theory 2020-09-14T13:20:04.056Z
Classifying games like the Prisoner's Dilemma 2020-07-04T17:10:01.965Z
Short essays on various things I've watched 2020-06-12T22:50:01.957Z
Haskenthetical 2020-05-19T22:00:02.014Z
Chris Masterjohn on Coronavirus, Part 2 2020-04-28T21:50:01.430Z
In my culture: the responsibilities of open source maintainers 2020-04-13T13:40:01.174Z
Chris Masterjohn on Coronavirus, Part 1 2020-03-29T11:00:00.819Z
My Bet Log 2020-03-19T21:10:00.929Z
Tapping Out In Two 2019-12-05T23:10:00.935Z
The history of smallpox and the origins of vaccines 2019-12-01T20:51:29.618Z
The Effect pattern: Transparent updates in Elm 2019-10-20T20:00:01.101Z
London Rationalish meetup (part of SSC meetups everywhere) 2019-09-12T20:32:52.306Z
Is this info on zinc lozenges accurate? 2019-07-27T22:05:11.318Z
A reckless introduction to Hindley-Milner type inference 2019-05-05T14:00:00.862Z
"Now here's why I'm punching you..." 2018-10-16T21:30:01.723Z

Comments

Comment by philh on Book review: the Iliad · 2024-11-20T22:12:50.891Z · LW · GW

My guess: [signalling] is why some people read the Iliad, but it's not the main thing that makes it a classic.

Incidentally, there was one reddit comment that pushed me slightly in the direction of "yep, it's just signalling".

This was obviously not the intended point of that comment. But (ignoring how they misunderstood my own writing), the user

  • Quotes multiple high status people talking about the Iliad;
  • Tantalizingly hints that they are widely-read enough to be able to talk in detail about the Iliad and the old testament, and compare translations;
  • Says approximately nothing about the Iliad;
  • And says nothing at all about why they think the Iliad is good, and nor do roughly 3/4 of the people they quote. (Frye explains why it's important, but that's different. The last 6 lines of Keats talk about how Keats reacted to it, but that doesn't say what's good about it. Borges says a particular line is more beautiful than some other line (I think both lines are fine). Only Santayana tells me what he thinks is good about the Iliad.)

So like, you're trying to convince me the Iliad isn't just signalling by quoting Keats, saying essentially "I'd heard the Iliad was so good, but it took me forever to track down a copy[1]. When I did? Blew my mind, man. Blew my mind." Nonspecific praise feels like signalling, appeal to authority feels like signalling, and the authority giving nospecific praise? This just really solidly rings my signalling bells, you know?

  1. ^

    I misunderstood Keats when I first replied to the comment. I'd assumed that when he said he "heard Chapman speak out loud and bold", he had, you know, heard someone named Chapman speak, perhaps loudly and boldly. Apparently it was what is called a "metaphor", and he had actually just read Chapman's translation.

Comment by philh on philh's Shortform · 2024-11-09T13:05:41.824Z · LW · GW

Complex Systems (31 Oct 2024): From molecule to medicine, with Ross Rheingans-Yoo

When you first do human studies with a new drug, there's something like a 2/3 chance it'll make it to the second round of studies. Then something like half of those make it to the next round; and there's a point where you talk to the FDA and say "we're planning to do this study" and they say "cool, if you do that and get these results you'll probably be approved" and then in that case there's like an 85% chance you'll be approved; and I guess at least one other filter I'm forgetting. Overall something like 10-15% of drugs that start on this pipeline get approved, typically taking at least 7 years.

A drug that gets approved needs to make about $2 billion, to make up for the costs of all those trials plus the trials for the drugs that didn't get approved. And it has about 10 years to do that before patent protections expire, because you filed the patent before doing the first human studies and you only get 20 years from that point.

Typically what happens is someone forms a company for a specific drug, and while it's in fairly early trials the company gets bought by a big pharma company. The trials themselves are done by companies that specialize in running clinical trials.

Ross says Thalidomide was sort of the middle of a story. The story started with Upton Sinclair's The Jungle, which he wrote as a "look at the horrible conditions meat packers have to endure" but what the public took from it is "excuse me, there are human fingers in my sausages?" So after that was the pure food and drug act which said that anything had to be just the thing it said it was.

But then a drug came which was exactly what it said it was, and that thing was bad for people. So after that you needed to do studies to show safety, but they were less rigorous than they are now?

And then thalidomide happened, which was fine for most people but caused birth defects when taken by a pregnant person. When it came up for approval, the beurocrat looking at it happened to have previously looked at rabbits and seen that drug uptake and metabolization could be different in pregnant rabbits, making something otherwise non-toxic become toxic. And so she said the company needed data about safety in pregnant people, even though this was a non-standard requirement at the time. The company tried to avoid that, she insisted, and it never got approved in the US. But standards still got stricter.

(It did get approved in Europe. It's relevant that Germany didn't like tracking birth defects due to previous history, so the problems weren't noticed as early as they might have been.)

One of the times when regulations got stricter, part of the story is that at the same time as public outrage, there also happened to be a bill in progress for reasons of punishing pharma for something something, so that's the bill that got through.

At some point you started to get patient advocacy groups, saying "we are dying while you hold this drug up", and the FDA would pay attention to that. And then the pharma companies would get involved in those groups, and now it's at the point where you kinda need one of those or the FDA will be like "why would we prioritize you?"

There are drugs that the FDA wants to encourage but which aren't profitable, e.g. helping with diseases common in the third world and rare in the US. One motivation is if you make one they'll give you a priority review voucher, good to help another drug of yours get approved faster. These vouchers are transferrable, and the market price is... I think $100k or $200k?

With covid vaccines, the government said "if you produce a thing that satisfies these criteria, we will buy X amount of it for sure". That took some uncertainty out of the process and helped things get made.

Sometimes a drug will succeed in trials but not get pushed forward for various reasons, sometimes just falling through cracks. One drug this happened with was a covid treatment, which seemed to reduce hospitalizations by 70% in vaccinated people. When it was in development the FDA said it was unlikely to get emergency use authorization, and the company dropped it.

(Related: VaccinateCA got a lot of funding for a while, and then after the funders themselves got vaccinated, it got less funding.)

Later the company was going bankrupt, and they sold off their assets, which included "drugs that seemed promising but we never went anywhere with", including this one. Ross was involved in some other company buying up that drug.

You can do trials for covid much cheaper than for cancer drugs. For cancer you'll often have a list of a smallish number of people and try to find the specific individuals who give you the best chance of a statistically significant result based on comorbidities and such, and have someone specifically approach the people you want. For covid the cheap thing to do is: everyone who comes to your clinic with a cough gets the drug and gets a covid test. Later you find out if they had covid and (thanks to a phone call) what happened to their symptoms. And you can do this sort of thing somewhere like Brazil, instead of doing it in the most prestigious hospital (where there are a bunch of other studies going on distracting people). But it's kind of a weird thing to do, and if trials fail your investors might be like "why didn't you do the normal thing?"

Comment by philh on A basic systems architecture for AI agents that do autonomous research · 2024-10-14T20:31:20.328Z · LW · GW

Though this particular story for weight exfiltration also seems pretty easy to prevent with standard computer security: there’s no reason for the inference servers to have the permission to create outgoing network connections.

But it might be convenient to have that setting configured through some file stored in Github, which the execution server has access to.

Comment by philh on [Completed] The 2024 Petrov Day Scenario · 2024-09-27T07:02:35.959Z · LW · GW

Yeah, if that was the only consideration I think I would have created the market myself.

Comment by philh on [Completed] The 2024 Petrov Day Scenario · 2024-09-26T14:57:27.522Z · LW · GW

Launching nukes is one thing, but downvoting posts that don't deserve it? I'm not sure I want to retaliate that strongly.

Comment by philh on [Completed] The 2024 Petrov Day Scenario · 2024-09-26T10:17:40.560Z · LW · GW

I looked for a manifold market on whether anyone gets nuked, and considered making one when I didn't find it. But:

  • If the implied probability is high, generals might be more likely to push the button. So someone who wants someone to get nuked can buy YES.
  • If the implied probability is low, generals can get mana by buying YES and pushing the button. I... don't think any of the generals will be very motivated by that? But not great.

So I decided not to.

Comment by philh on I would have shit in that alley, too · 2024-08-28T12:18:10.219Z · LW · GW

No they’re not interchangeable. They are all designed with each other in mind, along the spectrum, to maximize profits under constraints, and the reality of rivalrousness is one reason to not simply try to run at 100% capacity every instant.

I can't tell what this paragraph is responding to. What are "they"?

You explained they popped up from the ground. Those are just about the most excludable toilets in existence!

Okay I do feel a bit silly for missing this... but I also still maintain that "allows everyone or no one to use" is a stretch when it comes to excludability. (Like, if the reason we're talking about it is "can the free market provide this service at a profit", then we care about "can the provider limit access to people who are paying for it". If they can't do that, do we care that they can turn the service off during the day and on at night?)

Overall it still seems like you want to use words in a way that I think is unhelpful.

Comment by philh on I would have shit in that alley, too · 2024-08-22T17:34:06.220Z · LW · GW

Idk, I think my reaction here is that you're defining terms far more broadly than is actually going to be helpful in practice. Like, excludability and rivalry are spectrums in multiple dimensions, and if we're going to treat them as binaries then sure, we could say anything with a hint of them counts in the "yes" bin, but... I think for most purposes,

  • "occasionally, someone else arrives at the parking lot at the same time as me, and then I have to spend a minute or so waiting for the pay-and-display meter"

is closer to

  • "other people using the parking lot doesn't affect me"

than it is to

  • "when I get to the parking lot there are often no spaces at all"

I wouldn't even say that: bathrooms are highly rivalrous and this is why they need to be so overbuilt in terms of capacity. While working at a cinema, did you never notice the lines for the womens' bathroom vs the mens' bathroom once a big movie let out? And that like 99% of the time the bathrooms were completely empty?

My memory is we didn't often have that problem, but it was over ten years ago so dunno.

I'd say part of why they're (generally in my experience) low-rivalrous is because they're overbuilt. They (generally in my experience) have enough capacity that people typically don't have to wait, and when they do have to wait they don't have to wait long. There are exceptions (during the interval at a theatre), but it still seems to me that most bathrooms (as they actually exist, and not hypothetical other bathrooms that had been built with less capacity) are low-rivalrous.

None of your examples are a counterexample. All of them are excludable, and you explain how and that the operators choose not to.

I'm willing to concede on the ones that could be pay gated but aren't, though I still think "how easy is it to install a pay gate" matters.

But did you miss my example of the pop-up urinals? I did not explain how those are excludable, and I maintain that they're not.

Comment by philh on philh's Shortform · 2024-08-18T21:09:07.804Z · LW · GW

Thing I've been wrong about for a long time: I remembered that the rocket equation "is exponential", but I thought it was exponential in dry mass. It's not, it's linear in dry mass and exponential in Δv.

This explains a lot of times where I've been reading SF and was mildly surprised at how cavalier people seemed to be about payload, like allowing astronauts to have personal items.

Comment by philh on London Rationalish meetup - Lincoln's Inn Fields · 2024-08-18T18:35:50.083Z · LW · GW

Sorry, I didn't see this notification until after - did you find us?

Comment by philh on Economics101 predicted the failure of special card payments for refugees, 3 months later whole of Germany wants to adopt it · 2024-08-16T11:24:50.979Z · LW · GW

I agree that econ 101 models are sometimes incorrect or inapplicable. But

I don’t know how much that additional cost is, but seemingly less than the benefit, because three months later, the whole of Germany wants to introduce this card. The introduction has to be delayed by some legal issues, and then a few counties want to introduce it independently. So popular is this special card!

The argument here seems to be that the card must satisfy a cost-benefit analysis or it wouldn't be so popular, and I don't buy that either.

Comment by philh on Organisation for Program Equilibrium reading group · 2024-08-15T07:54:17.479Z · LW · GW

Ah, I can sometimes make fridays but not tomorrow. Hope it goes well.

Comment by philh on Multiplex Gene Editing: Where Are We Now? · 2024-08-03T10:53:09.807Z · LW · GW

they turn a C/G base pair to an A/T, or vice versa.

Can they also turn it into a G/C or a T/A? I wasn't sure if this was an example or a "this is the only edit they do". Or I might just be misunderstanding and this question is wrong.

Comment by philh on Poker is a bad game for teaching epistemics. Figgie is a better one. · 2024-07-23T08:38:54.310Z · LW · GW

I think Ben's proposal is: between rounds, it takes a while to split the whole deck into suits, all hearts in one pile and all spades in another and so on. Instead you can just pick out four hearts, and four spades, and so on, and remove 0/2/2/4 cards from those piles, and shuffle the rest back into the deck. But no matter how you shuffle, I don't think you can do that without leaking information.

Comment by philh on Sci-Fi books micro-reviews · 2024-07-22T13:32:41.685Z · LW · GW

The Gap Cycle by Stephen R. Donaldson

I think I've read this twice, in my early teens and early twenties, and loved it both times. But I'm now 34 and can't talk about it in depth. I think past-me especially liked the grimness and was impressed at how characters seemed to be doing things for internally motivated reasons. (IIRC Donaldson calls this giving characters "dignity". I feel like since then I've picked up another term for it that's temporarily slipped my mind.)

I still think A Dark and Hungry God Arises and This Day All Gods Die are excellent book titles.

A caveat is that back then I also loved Donaldson's Thomas Covenant books, and I think that by my mid-twenties I enjoyed them but not so much. So plausibly I'd like the Gap Cycle less now than then too? But I want to re-read.

Too Like the Lightning by Ada Palmer

I once saw a conversation that went something like: "I don't find writing quality in sci-fi that important." / "You clearly haven't read Too Like the Lightning".

I wasn't sure if the second person meant TLTL's writing is good or bad. Having read TLTL, both interpretations seemed plausible. (They meant good.)

I found it very difficult to get through this book, except that the last few chapters were kind of gripping. That was enough to get me to read the next one, which was hard to get through again. Ultimately I read the whole series, and I'm not sure how much I enjoyed the process of reading it. But they're some of my favorite books to have read, and I can imagine myself re-reading them.

Crystal trilogy by Max Harms

I enjoyed this but don't have much to say. As an AI safety parable it seemed plausible enough; I hadn't previously seen aliens like that; I occasionally thought some of the writing was amateurish in a way I couldn't put my finger on, but that wasn't a big deal.

Comment by philh on Poker is a bad game for teaching epistemics. Figgie is a better one. · 2024-07-22T11:45:16.388Z · LW · GW

just make 4 piles of 4 cards from each suit and remove from those

I don't think you can do this because at least one person will see which cards are in those piles, and then seeing those cards in game will give them more info than they're supposed to have. E.g. if they see 9h in one of the piles and then 9h in game, they know hearts isn't the 8-card suit.

(The rules as written are unclear on this. But I assume that you're meant to remove cards at random from the suits, rather than having e.g. A-8 in one suit, A-Q in one, and A-10 in the other two. If you did that then getting dealt the Q or J would be a dead giveaway.)

Comment by philh on Exercise: Planmaking, Surprise Anticipation, and "Baba is You" · 2024-07-11T06:53:13.546Z · LW · GW

I think Causality would be good for this. Levels have their full state visible from the start, and there's no randomness. There's a relatively small number of mechanics to learn, though I worry that some of them (particularly around details of movement, like "what will an astronaut do when they can't move forward any more?") might be "there are multiple equally good guesses here" which seems suboptimal.

Actually, there's one detail of state that I'm not sure is visible, in some levels:

When you come out of a portal, which way do you face? I think there's probably a consistent rule for this but I'm not sure, I could believe that in some levels you just have to try it to see.

Comment by philh on I would have shit in that alley, too · 2024-07-09T12:08:30.052Z · LW · GW

they are by definition rivalrous ("the consumption of a good or service by one person diminishes the ability of another person to consume the same good or service"), as only one person in a stall at a time, and the timeframe doesn't matter to this point.

Why does timeframe not matter? If there's a pay-and-display parking lot, with enough spaces for everyone, but only one ticket machine, would you say this is rivalrous because only one person can be using the ticket machine at once?

Bathrooms aren't zero rivalrous, but they seem fairly low-rivalrous to me. (There are some people for whom bathroom use is more urgent, making bathrooms more rivalrous, e.g. pregnant people and those with certain disabilities. My understanding is these people sometimes get access to extra bathrooms that the rest of us don't.)

(As for dirtiness, all I can say is that the public bathrooms I've used tend to be somewhere between "just fine" and "unpleasant but bearable". I did once have to clean shit from the toilet walls in the cinema where I used to work, but I believe it's literally once in my life I've encountered that. Obviously people will have very different experiences here.)

they are extremely excludable: "Excludability refers to the characteristic of a good or service that allows its provider to prevent some people from using it."

Depends on details. London has some street urinals that afaict pop up at night, they have no locks or even walls, they're nonexcludable. Some are "open to everyone the attendant decides to let in", and some are "open to everyone with a credit card", and these seem just straightforwardly excludable. Other bathrooms can be locked but have no attendant and no means of accepting payment, so they're either "open to everyone" or "closed to everyone", and calling that "excludable" feels like a stretch to me. I suppose you could say that you could install a pay gate so it's "excludable but currently choosing not to exclude people", but then it depends how easy it is to install one of them.

Comment by philh on CIV: a story · 2024-07-03T11:26:56.037Z · LW · GW

So I guess Stuart is named for John Stuart Mill and Milton for Milton Friedman, but what about Carla (is CARLA an acronym?) and Victoria (Tori?)?

Comment by philh on My AI Model Delta Compared To Christiano · 2024-06-29T23:08:28.220Z · LW · GW

Note that to the extent this is true, it suggests verification is even harder than John thinks.

Comment by philh on philh's Shortform · 2024-06-17T10:12:54.606Z · LW · GW

In any case, where is this hedging discussion happening?

I've seen and taken part in discussions about hedging on LW, but the thing that made me write this comment was a conversation on Duncan Sabien's facebook.

What things are over-discussed?

Interesting question, but nothing comes to mind.

Comment by philh on philh's Shortform · 2024-06-15T09:23:12.303Z · LW · GW

A thing that feels under-discussed when it comes to hedging is, hedging doesn't just have to be swapping from "X" to "I believe X". You can say "the sky looks blue" or "wikipedia says the sky is blue" or "rumor has it the sky is blue" or "IIRC the sky is blue" or "if I did the math right, the sky is blue".

Comment by philh on How it All Went Down: The Puzzle Hunt that took us way, way Less Online · 2024-06-03T15:52:56.338Z · LW · GW

I for one welcome our new AI overlord whom I unwittingly helped install. Otherwise I'd need to feel conflicted about my actions this weekend.

I still have questions about one of the puzzles. Will the solutions be made available somewhere (ideally in a format where people can try them unspoiled first), or should I just ask?

Comment by philh on Big-endian is better than little-endian · 2024-05-31T13:46:45.334Z · LW · GW

Ah, thanks, I see now. You're saying that even if it's written with the small end before the big end according to the way the words flow, the direction of eye scanning and of mentally parsing and of giving a name to the number is still big end before small end? Similarly I might write a single word sdrawkcab in English text but the reader would still read it first-letter-to-last-letter.

Curious, when handwriting, what order do you write in?

Comment by philh on OpenAI: Fallout · 2024-05-31T13:32:51.833Z · LW · GW

Even better, Daniel then get to keep his equity

I missed this part?

Comment by philh on Big-endian is better than little-endian · 2024-05-16T16:40:16.850Z · LW · GW

Isn't this showing that Hebrew and Arabic write numbers little-endian? Surely big-versus-little-endian isn't about left-to-right or right-to-left, it's about how numbers flow relative to word reading order.

Comment by philh on On Not Pulling The Ladder Up Behind You · 2024-04-27T23:31:36.513Z · LW · GW

Ask me about the 2019 NYC Solstice Afterparty sometime if you want a minor ops horror story.

Consider yourself asked.

Comment by philh on philh's Shortform · 2024-04-08T13:37:45.811Z · LW · GW

(I confess I have no idea how to interpret the agree-votes on this.)

Comment by philh on General Thoughts on Secular Solstice · 2024-04-07T08:44:34.720Z · LW · GW

Yeah, I was wrong to suggest/assume that the definition is original to you and not the way it's defined in other communities that I just am not familiar with.

It still seems like you're making the core mistake I was trying to point at, which is asserting that a word means something different than what other people mean by it; rather than acknowledging that sometimes words have different meanings in different contexts.

Like, people are talking about what sort of toppings should be on a donut and how large the hole should be, and you're chiming in to say you came around on donuts when you realized that instead of being ring-shaped with toppings they're ball-shaped with fillings. You didn't come around on donuts. You just discovered that even though you don't like ring donuts, you do like filled donuts, a related but different baked good.

Comment by philh on General Thoughts on Secular Solstice · 2024-04-06T22:18:45.061Z · LW · GW

I only came around on faith once I realized it was just Latin for trust, and specifically trust in the world to be just as it is.

This really just seems to me like you're asserting that what a word "really means" is some weird new definition that ~no one else means when they say the word.

(I don't know Latin. Nevertheless I am extremely confident that the word "faith" in Latin does not specifically refer to the concept of "trust in the world to be just as it is".)

Comment by philh on philh's Shortform · 2024-04-03T21:36:17.983Z · LW · GW

Also now running as an in-progress youtube short series. (I haven't read the original.)

Comment by philh on philh's Shortform · 2024-04-03T15:02:41.095Z · LW · GW

"It seems a lot of our pills cause vomiting as a side-effect?"

"Yeah, the company knows about it but it's tricky to fix."

"How so? Our competitors don't have this problem, and we make basically the same products, right?"

"Right, no, it's a corporate structure issue."

"?"

"If a pill does too much or too little of something, we have a group of clever people whose job it is to care about that and to reformulate it slightly to improve it. If it doesn't kill enough pain, the analgesic division will step in. If it causes clotting, the anticoagulant folks have a look. If it makes your bones brittle, it'll be the antiosteoporosises. You see? But if it causes vomiting-"

"Right, yeah. There's no one to take ownership of the problem, because-"

"There is no antiemetics division."

Comment by philh on philh's Shortform · 2024-03-08T23:41:24.909Z · LW · GW

Oh, huh. Searle's original Chinese room paper (first eight pages) doesn't say machines can't think.

"OK, but could a digital computer think?"

If by "digital computer" we mean anything at all that has a level of description where it can correctly be described as the instantiation of a computer program, then again the answer is, of course, yes, since we are the instantiations of any number of computer programs, and we can think.

"But could something think, understand, and so on solely in virtue of being a computer with the right sort of program? Could instantiating a program, the right program of course, by itself be a sufficient condition of understanding?"

This I think is the right question to ask, though it is usually confused with one or more of the earlier questions, and the answer to it is no.

"Why not?"

Because the formal symbol manipulations by themselves don't have any intentionality; they are quite meaningless; they aren't even symbol manipulations, since the symbols don't symbolize anything. In the linguistic jargon, they have only a syntax but no semantics. Such intentionality as computers appear to have is solely in the minds of those who program them and those who use them, those who send in the input and those who interpret the output.

I can't say I really understand what he's trying to say, but it's different from what I thought it was.

Comment by philh on The Gemini Incident · 2024-02-27T00:33:51.554Z · LW · GW

Yeah. It's still possible to program in such a way that that works, and it's always been possible to program in such a way that it doesn't work. But prepared statements make it easier to program in such a way that it doesn't work, by allowing the programmer to pass executable code (which is probably directly embedded as a literal in their application language) separately from the parameters (which may be user-supplied).

(I could imagine a SQL implementation forbidding all strings directly embedded in queries, and requiring them to be passed through prepared statements or a similar mechanism. That still wouldn't make these attacks outright impossible, but it would be an added layer of security.)

Comment by philh on Monthly Roundup #15: February 2024 · 2024-02-27T00:15:21.940Z · LW · GW

A large majority of empirical evidence reported in leading economics journals is potentially misleading. Results reported to be statistically significant are about as likely to be misleading as not (falsely positive) and statistically nonsignificant results are much more likely to be misleading (falsely negative). We also compare observational to experimental research and find that the quality of experimental economic evidence is notably higher.

I'm confused by this "falsely negative". Like, without that, that part sounds like it's saying something like

when a result is reported as "we observed a small effect here, but it wasn't statistically significant", then more often than not, there's no real effect there

but that's a false positive. If they're saying it's a false negative, it suggests something like

when a result is reported as statistically insignificant, that makes it sound like there's no effect there, but more often than not there actually is an effect

...but that's (a) not a natural reading of that part and (b) surely not true.

Comment by philh on The Gemini Incident · 2024-02-26T23:43:37.952Z · LW · GW

Were SQL a better language this wouldn’t be possible, all the command strings would separated somehow

SQL does support prepared statements which forbid injection. Maybe you're thinking of something stronger than this? I'm not sure how long they've been around for, but wikipedia's list of SQL injection examples only has two since 2015 which hints that SQL injection is much less common than it used to be.

(Pedantic clarification: dunno if this is in any SQL standard, but it looks like every SQL implementation I can think of supports them.)

Comment by philh on philh's Shortform · 2024-02-19T23:56:18.532Z · LW · GW

Planet Money #902 (28 Mar 2019): The Phoebus Cartel

Listened to this one a few weeks ago and don't remember most of it. But half the episode was about the phoebus cartel, a case of planned obsolesence when lightbulb manufacturers decided that no light bulb should be allowed to last more than 1000 hours.

Writing this for Gell-Mann amnesia reasons: in the episode someone says there was no benefit to consumers from this, but I'd recently seen a technology connections episode on the subject saying that longer lasting incandescent light bulbs are less energy efficient (i.e. more heat less light) for physics reasons, to the extent that they could easily be more expensive over their lifetime. Seems like an important caveat that PM missed!

The other half was about psychological obsolesence, where manufacturers make long-lasting goods like cars cosmetically different to convince you you need a new one.

Comment by philh on philh's Shortform · 2024-02-19T23:48:04.288Z · LW · GW

Planet Money #1717 (9 Feb 2024): A Lawsuit for your broken heart

Keith met woman, fell in love, got married, had kids. She helped with his BMX company and she'd post sickeningly cute things on facebook about how she had the best family.

Then Keith saw some very messages she was exchanging with some other guy (from him: «do you like how tall I am», «show me a bikini pic», that kind of thing). He got mad, called him, said «never fucking talk to my wife again» and thought that would be the end of it.

It was not the end of it. She had affair, they got divorced. A bit later he was catching up with an old school friend who'd been in a similar situation, and she told him she was suing the woman her husband had cheated with. You can do that?

These are heartbalm laws and they're kind of archaic. In the past if a woman got engaged and the man broke things off, she could be ruined, so she got to sue him for breach of promise. There's also seduction, where she could sue someone for lying her into bed. And criminal conversation, which is adultery. And the one relevant to the show, alienation of affections, where you can sue someone for damaging your marriage.

Most states have abolished these, partly because public perception moved towards women using these in ways that were unpopular, this is where the term "gold digger" took off. There were also a bunch of famous people who got sued.

But a few states still have alienation of affections, including North Carolina, which is where most of the suits are. Possibly because that's where most of the legal experts in them are.

Keith presents evidence that his marriage would otherwise have been happy: the sickeningly cute facebook posts, messages between him and his ex, messages from her to her girlfriends saying the marriage would have been fine if not for this other guy. (She subsequently married him.)

And because marriage is in part an economic arrangement, his lawyer also talks about the work that the ex had been doing for the company, and all the unpaid labor she was doing like childcare and washing dishes. The hosts point out it's kinda weird that Keith is suing some other guy for the unpaid labor his ex wife used to do. But that's what's happening, and Keith wins the suit and is awarded $8 million.

Other guy files for bankruptcy. Keith probably won't get anything from him, and still owes his lawyers thousands of dollars in fees. But he says it was worth it.

Comment by philh on Epistemic Hell · 2024-02-13T00:23:57.425Z · LW · GW

Nice!

Wikipedia says his mission began on 08/29/1498 and ended on 01/07/1499 (so about 3 months).

It looks like this is just one leg of the return journey. In total the outward journey was about 10 months and the return was about 11, and both spent 3+ months without landing.

Comment by philh on Conditional prediction markets are evidential, not causal · 2024-02-09T23:44:39.233Z · LW · GW

Hm, do you want to go into more depth? Intuitively I agree this is obviously distortionary, but I'm finding it awkward to think through the details of the distortion.

One thing that comes to mind is "if the market is at 10% but you think 5% is "correct" according to what seems like the spirit of the question, you're going to expect that the market just doesn't get resolved, so why bother betting it down". But I feel like there's probably more than that. (E: oh, the dynomight essay linked above mentions this one as well.)

Comment by philh on Conditional prediction markets are evidential, not causal · 2024-02-07T23:48:37.680Z · LW · GW

Thanks! Yeah, I think that's making the same basic point with a different focus.

And that makes me more confident in changing the title, so doing that now. (Original title: "Conditional prediction markets are, specifically, conditioned on the thing happening".)

Comment by philh on Conditional prediction markets are evidential, not causal · 2024-02-07T22:13:50.385Z · LW · GW

Maybe a pithier title would be "Conditional prediction markets are evidential, not causal"?

Comment by philh on Epistemic Hell · 2024-02-05T18:50:06.128Z · LW · GW

The problem was so common that shipowners and governments assumed a 50% death rate from scurvy for their sailors on any major voyage.

Sticking my neck out: roll to disbelieve that 50% of sailors on major voyages died in general, let alone specifically of scurvy.

Ways to change the claim that I'd find much more believable:

  • 50% of those who got scurvy died of it
  • A 50% death rate was considered plausible, and the possibility was planned for, but it wasn't common
  • "Major voyage" here is a much smaller category than I expect; think Magellan rather than Columbus.
Comment by philh on Gender Exploration · 2024-01-26T01:34:48.153Z · LW · GW

Note that in general there's no contradiction between

"X is a very not-Y trait, in fact just about the least Y trait there is"

And

"Nevertheless, one can be X and also overall very Y"

Comment by philh on philh's Shortform · 2024-01-21T20:01:07.456Z · LW · GW

Planet Money: The Maine Potato War

The standard potato today is the russet, mostly associated with Idaho and Washington, but in the... 70s? 80s?... it was some other kind from Maine.

These potatos were sold on the New York Mercantile Exchange, and in particular you could buy and sell futures there. Futures are good for hedging, farmers could lock in the price early to avoid risk of a crash, and buyers could lock it in early to avoid risk of a rise. You could also just speculate, with no intention of ever seeing a potato. Speculators are generally good for markets because they put a bunch of money in there which helps them flow better.

The big Western potato farmers didn't like that Maine potatos were on the exchange, because it gave them an advantage. So one year they entered the market with like a million dollars worth of contracts. (I vaguely recall that these were buy contracts, but I think it fits better with the rest of the story if they were sell.) Trading is weird for the year, and when things finally play out after close date, the Western farmers collectively owe the market millions of pounds of Maine potatoes, possibly more than existed in the entire state of Maine.

They try to get around it by offering russet potatoes instead, but buyers say no dice. So in the end they just default. They have to pay back the buyers plus pay heavy fines. I think banned from the exchange for a bit? Short term expensive for them.

But long term very good for them! Markets don't like defaults, so the Maine potatoes are removed from the exchange a bit later.

Comment by philh on If Clarity Seems Like Death to Them · 2024-01-19T22:30:52.402Z · LW · GW

I think he is using the argument as a soldier.

I see. That's not a sense I pick up on myself, but I suppose it's not worth litigating.

To be clear, skimming my previous posts, I don't see anything that I don't endorse when it comes to literary criticism. Like, if I've said something that you agree with most of the time, but disagree with for literary criticism, then we likely disagree. (Though of course there may be subtleties e.g. in the way that I think something applies when the topic is literary criticism.)

You mention that “awesome” and “terrible” are very subjective words, unlike “blue”, and this is relevant. I agree. Similarly, media criticism is very subjective, unlike dress colors.

Media criticism can be very subjective, but it doesn't have to be. "I love Star Wars" is more subjective than "Star Wars is great" is more subjective than "Star Wars is a technical masterpiece of the art of filmmaking" is more subjective than "Star Wars is a book about a young boy who goes to wizard school". And as I said above:

I’m comfortable with “Luke is a Jedi”, and I think it’s importantly different from, say, “Yoda is wise” or “the Death Star is indestructible” or “the Emperor has been defeated once and for all”.

And I think the ways it’s different are similar to the differences between claims about base-level reality like “Tim Cook is a CEO” versus “the Dalai Lama is wise” or “the Titanic is unsinkable” or “Napoleon has been defeated once and for all”.

Comment by philh on philh's Shortform · 2024-01-18T18:07:13.828Z · LW · GW

Planet money #904 (6 Apr 2019): Joke Theft

Meg is an Internet comedian. After a picture of Kanye kissing Kim at some ceremony, she photoshopped it to be a pic of Kanye kissing Kanye. It went viral. But her own tweet only got a couple hundred likes. Most of the viral came from an Instagram account called Fuck Jerry which has 14 million followers and reposted it without credit.

And Fuck Jerry does that a lot, and gets a lot of ad money, including from Comedy Central who should know better than to support someone who keeps stealing from comedians. So that made Meg kinda mad.

Stand up comedy started after the death of vaudeville. At first it was just throwing out one-liner after one-liner, the jokes didn't have much effort put into them so no one really cared if you stole them. Later the acts and the jokes got more sophisticated and comedians did care.

You can copyright a joke, but it costs $35 to register, it can't be too short, and just changing the wording gets around it. This is partly to stop stuff like "don't you hate it when..." from being taken out of the commons. A comedy lawyer couldn't find any case of one stand up comedian suing another for joke theft.

What do they do instead? A comedian gives three strategies.

  • Violence: every time you steal one of my jokes, I'll damage your car.
  • Warnings: if you as a friend of the comic see a known joke thief in the audience, write a message on a napkin and have the waitress deliver it to the comic who can then finish early or avoid using their more precious material. (Robin Williams was a known joke thief. He said he just absorbed stuff and couldn't remember where it was from. Comedian says Robin once stole one from him, but at least when he called him out he cut him a cheque. It said "sorry for the inconvenience", not "sorry for stealing". But it was $200 which was a lot of money in the mid 80s.)
  • Organizing: get venues to blacklist them.

Meg makes a campaign "fuck Fuck Jerry" trying to get people to unfollow. A bunch of famous comedians join in (I think Amy Schumer was mentioned). It works at least a bit, they lose 300,000 followers. That doesn't sound like much, maybe there was more?

PM speaks to Elliot who is behind Fuck Jerry. He considers himself a curator, not thief. He wishes people would know he's not a bad person. PM is not very sympathetic. He says he now asks for permission; Meg says that's not enough. He says he's thinking of starting to pay; PM says it's unclear how that would work but it's a bold thing to put on the air.

Comment by philh on If Clarity Seems Like Death to Them · 2024-01-16T11:22:02.763Z · LW · GW

Thanks for replying. I’m going to leave aside non-fictional examples (“The Dress”) because I intended to discuss literary criticism.

So uh. Fair enough but I don't think anything else in your comment hinged on examples being drawn from literary criticism rather than reality? And I like the dress as an example a lot, so I think I'm gonna keep using it.

I’m not sure exactly what you mean, see Taboo “Outside View”. My best guess is that you mean that “X seems Y to me” implies my independent impression, not deferring to the views of others, whereas “X is Y” doesn’t.

From a quick skim, I'd say many of the things in both the inside-view and outside-view lists there could fit. Like if I say "the dress looks white to me but I think it's actually blue", some ways this could fit inside/outside view:

  • Inside is one model available to me (visual appearance), outside is all-things-considered (wikipedia).
  • Inside is my personal guess, outside is taking a poll (most people think it's blue, they're probably right).
  • Inside is my initial guess, outside is reference class forecasting (I have a weird visual processing bug and most things that look white to me turn out to be blue).

If so, I don’t think I am missing this.

I don't really know how to reply to this, because it seems to me that you listed "acknowledging or changing social reality", I said "I think you're missing inside versus outside view", and you're saying "I don't think I am missing that" and elaborating on the social reality thing. I claim the two are different, and if they seem the same to you, I don't really know where to proceed from there.

Again, I don’t think I am missing this. I agree that “X seems Y to me” implies something like a gut reaction or a hot take. I think this is because “X seems Y to me” expresses lower confidence than “X is Y”, and someone reporting a gut reaction or a hot take would have lower confidence than someone who has studied the text at length and sought input from other authorities.

I think you have causality backwards here. I'd buy "it seems low confidence because it suggests a gut reaction" (though I'm not gonna rule out that there's more going on). I don't buy "it suggests a gut reaction because it seems low confidence".

So I claim the gut-reaction thing is more specific than the low-confidence thing.

Well, that isn’t his stated goal.

Right. Very loosely speaking, Eliezer said to do it because it was kind to authors; Zack objected because it was opposed to truth; I replied that in fact it's pro-truth. (And as you point out, Eliezer had already explained that it's pro-truth, differently but compatibly with my own explanation.)

Yudkowsky doesn’t advise critics to say: “mileage varied, I thought character X seemed clever to me”, he doesn’t say “please don’t tell me what good things the author was thinking unless the author plainly came out and said so”.

Well, I can't speak for Eliezer, and what Eliezer thinks is less important than what's true. For myself, I think both of those would be good advice for the purpose of saying true and informative things; neutral advice for the purpose of being kind to authors.

Given the one-sided application of the advice, I don’t take it very seriously.

I'm not sure what you mean by not taking it very seriously.

Applying a rule in one situation is either good advice for some purpose, or it's not. Applying a rule in another situation is either good advice for some purpose, or it's not. If someone advises applying the rule in one situation, and says nothing about another situation... so what?

My vague sense here is that you think he has hidden motives? Like "the fact that he advises it in this situation and not that situation tells us... something"? But:

  • I don't think his motives are hidden. He's pretty explicitly talking about how to be kind to authors, and the rule helps that purpose more in one situation than another.
  • You can just decide for yourself what your purposes are and whether it's good advice for them in any given situation. If he makes arguments that are only relevant to purposes you don't share, you can ignore them. If he makes bad arguments you can point them out and/or ignore them. If he makes good arguments that generalize further than he takes them, in ways that you endorse but you think he wouldn't, you can follow the generalization anyway.

I claim that this text would not be more true and informative with “mileage varies, I think x seems y to me”. What do you think?

Eliezer described it as his opinion before saying it, and to me that does the same work.

If it weren't flagged as opinion, then yes, I think a "seems" or "to me" or something would make it slightly more true and informative. Not loads in this case - "awesome" and "terrible" are already very subjective words, unlike "blue" or "indestructible".


This feels like the type of conversation that takes a lot of time and doesn't help anyone much. So after this I'm gonna try to limit myself to two more effortful replies to you in this thread.

Comment by philh on If Clarity Seems Like Death to Them · 2024-01-16T09:20:20.267Z · LW · GW

Fair enough! I did indeed miss that.

Comment by philh on If Clarity Seems Like Death to Them · 2024-01-15T18:43:45.708Z · LW · GW

Hm, I think I'm maybe somewhat equivocating between "the dress looks blue to me" as a statement about my state of mind and as a statement about the dress.

Like I think this distinction could be unpacked and it would be fine, I'd still endorse what I'm getting at above. But I haven't unpacked it as much as would be good.