Posts

Simple probes can catch sleeper agents 2024-04-23T21:10:47.784Z
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training 2024-01-12T19:51:01.021Z

Comments

Comment by David Duvenaud (david-duvenaud) on Fixed Point: a love story · 2023-07-09T23:29:18.916Z · LW · GW

Bravo.  I'm really glad you're writing on this theme.  Where I've been stuck lately in thinking about the future is trying to figure out what is the best we can coherently hope for.  Which, as your story notes, seems like it involves tradeoffs between remaining human and having meaningful autonomy.

Comment by David Duvenaud (david-duvenaud) on What can we learn from Lex Fridman’s interview with Sam Altman? · 2023-03-27T17:05:20.362Z · LW · GW

We’ve got the [molecular?] problem

I think he was saying "Moloch", as in the problem of avoiding a tragedy of the commons.

Comment by david-duvenaud on [deleted post] 2022-11-29T03:02:22.881Z

The nice thing about loaners losing money on unprofitable businesses is that it's a self-correcting problem to some degree - those loaners can only lose all their money once!  And if consumers get part of that money, it's effectively a charity.

Sometimes it seems like investors might not even consider whether their investments will make money, but most of the ones who last very long do care.

Comment by david-duvenaud on [deleted post] 2022-11-28T15:54:20.119Z

It is an option, but it only allows for relatively slow growth, and only for businesses that aren't capital-intensive.  So it's a good option for something like consulting firms or law firms, where there aren't really any up-front costs that need to be paid off over time.

But imagine you invent a new type of power plant.  Many plants benefit from economies of scale, and also take 10-20 years to pay off their up-front construction costs.   How could a co-op finance building even a single plant?  Similar arguments apply to most forms of manufacturing, or really anything that can be mass-produced.

Even in the case where organic growth is sustainable, it'll usually have to compete with much faster inorganic, financed growth.