Posts

Forecasting future gains due to post-training enhancements 2024-03-08T02:11:57.228Z
[Link post] Michael Nielsen's "Notes on Existential Risk from Artificial Superintelligence" 2023-09-19T13:31:02.298Z
Reslab Request for Information: EA hardware projects 2022-10-26T21:13:10.695Z

Comments

Comment by Joel Becker (joel-becker) on LawrenceC's Shortform · 2024-03-22T18:10:08.261Z · LW · GW

Found this helpful, thanks!

Comment by Joel Becker (joel-becker) on Sharing Information About Nonlinear · 2023-09-13T11:14:05.044Z · LW · GW

To "there were various suspicious/bad things Drew did," I would reply:

I have this opposing consideration. [...] I gather that part of the reason Alice and Chloe feel this way is that Drew did try to be helpful with respect to their concerns, at least to whatever degree was required for them to ask for him to be shielded from professional consequences.

and, to "the choice he's made to kinda hang around Emerson and Kat for this long," I would reply:

To the extent you believe that Nonlinear has been a disfunctional environment, in significant part due to domineering characteristics of senior staff, I think that you should also believe that a junior family member beginning to work in this environment is going to have a hard time reasoning through and pushing back against it.

Comment by Joel Becker (joel-becker) on Sharing Information About Nonlinear · 2023-09-12T13:38:58.578Z · LW · GW

Repost from EA forum:

Thank you very much for sharing, Chloe.

Ben, Kat, Emerson, and readers of the original post have all noticed that the nature of Ben's process leads to selection against positive observations about Nonlinear. I encourage readers to notice that the reverse might also be true. Examples of selection against negative information include:

  1. Ben has reason to exclude stories that are less objective or have a less strong evidence base. The above comment is a concrete example of this.
    1. There's also something related here about the supposed unreliability of Alice as a source: Ben needs to include this to give a complete picture/because other people (in particular the Nonlinear co-founders) have said this. I strongly concur with Ben when he writes that he "found Alice very willing and ready to share primary sources [...] so I don’t believe her to be acting in bad faith." Personally, my impression is that people are making an incorrect inference about Alice from her characteristics (that are perhaps correlated with source-reliability in a large population, but aren't logically related, and aren't relevant in this case).
  2. To the extent that you expect other people to have been silenced (e.g. via anticipated retaliation), you might expect not to hear relevant information from them.
  3. To the extent that you expect Alice and Chloe to have had burnout-style experiences, you might expect not to read clarifications on or news about negative experiences.
    1. Until this post came out, this was true of ~everything in the post. 
    2. There is a reason the post was published 1.5 years after the relevant events took place -- people involved in the events really do not want to spend further mental effort on this.
Comment by Joel Becker (joel-becker) on Sharing Information About Nonlinear · 2023-09-11T11:05:33.392Z · LW · GW

I have this opposing consideration. I think it does speak to your point -- I gather that part of the reason Alice and Chloe feel this way is that Drew did try to be helpful with respect to their concerns, at least to whatever degree was required for them to ask for him to be shielded from professional consequences.

Here's another (in my view weaker, but perhaps more directly relevant to your point) consideration. To the extent you believe that Nonlinear has been a disfunctional environment, in significant part due to domineering characteristics of senior staff, I think that you should also believe that a junior family member beginning to work in this environment is going to have a hard time reasoning through and pushing back against it. Happy to expand.

Comment by Joel Becker (joel-becker) on Sharing Information About Nonlinear · 2023-09-08T13:55:00.678Z · LW · GW

My understanding (definitely fallible, but I’ve been quite engaged in this case, and am one of the people Ben interviewed) has been that Alice and Chloe are not concerned about this, and in fact that they both wish to insulate Drew from any negative consequences. This seems to me like an informative and important consideration. (It also gives me reason to think that the benefits of gaining more information about this are less likely to be worth the costs.)

Comment by Joel Becker (joel-becker) on Sharing Information About Nonlinear · 2023-09-07T18:58:20.636Z · LW · GW

Why include Drew?

Comment by Joel Becker (joel-becker) on What are examples of someone doing a lot of work to find the best of something? · 2023-07-28T01:17:45.978Z · LW · GW

Enthusiasts of {wine/coffee/whiskey/potato/etc.} tasting?

Comment by Joel Becker (joel-becker) on What are examples of someone doing a lot of work to find the best of something? · 2023-07-27T17:31:11.774Z · LW · GW

I love this question!

Comment by Joel Becker (joel-becker) on Forecasts are not enough · 2023-05-03T10:12:33.580Z · LW · GW

Speaking of macroeconomics, there's a nice connection here to the famous Lucas critique:

The Lucas critique, named for American economist Robert Lucas's work on macroeconomic policymaking, argues that it is naive to try to predict the effects of a change in economic policy entirely on the basis of relationships observed in historical data, especially highly aggregated historical data.[1] More formally, it states that the decision rules of Keynesian models—such as the consumption function—cannot be considered as structural in the sense of being invariant with respect to changes in government policy variables.[2]

Comment by Joel Becker (joel-becker) on Mechanism Design for AI Safety - Reading Group Curriculum · 2022-12-27T21:25:16.281Z · LW · GW

Interesting, thank you! Has the group gotten around to discussing something like "lessons from contract theory or corporate governance for factored cognition-style proposals" at all?