Who is Sam Bankman-Fried (SBF) really, and how could he have done what he did? - three theories and a lot of evidence

post by spencerg · 2023-11-11T01:04:22.747Z · LW · GW · 28 comments

This is a link post for https://www.spencergreenberg.com/2023/11/who-is-sam-bankman-fried-sbf-really-and-how-could-he-have-done-what-he-did-three-theories-and-a-lot-of-evidence/

28 comments

Comments sorted by top scores.

comment by cata · 2023-11-11T03:21:51.503Z · LW(p) · GW(p)

I think "theory B" (DAE + EA) is likely true, but it also seems like he was independently considerably incompetent. The anecdotes about his mismanagement at Alameda and FTX (e.g. total lack of accounting, repeated expensive security breaches, taking objectively dumb risks, not sleeping, alienating the whole Alameda team by being so untrustworthy) weren't clever utilitarian coinflip gambits that he got unlucky on, or selfish defections that he was trying to get away with. They were just dumb mistakes.

My guess is that a number of those mistakes largely came from a kind of overapplication of startup culture (move fast, break things, grow at all costs, minimize bureaucracy, ask forgiveness rather than permission) way past the point where it made sense. Until the end he was acting like he was running a ten-person company that had to 100x or die, even though he was actually running a medium-sized popular company with a perfectly workable business model. (Maybe he justified this to himself by thinking of it like he had to win even bigger to save the world with his money, or something, I don't know.)

Since he was very inexperienced and terrible at taking advice, I don't think there's anything shocking about him being really bad at being in charge of a company moving a lot of money, regardless of how smart he was.

Replies from: spencerg
comment by spencerg · 2023-11-11T17:48:29.297Z · LW(p) · GW(p)

There were clear ways in which he was really bad at things, but also, clear ways that he was really good at some things.  The FTX exchange is not something easy to build, and it's much harder still to make it into a successful exchange like he did. Seems pretty clear he was really skilled at some things, despite his big weaknesses. But I don't think it can be dismissed as just that he was bad at stuff.  Also, him being bad at stuff doesn't explain highly unethical actions that he appears to have taken.

Replies from: steve2152
comment by Steven Byrnes (steve2152) · 2023-11-11T18:26:17.728Z · LW(p) · GW(p)

I think SBF was bad at the same kinds of things that other high-functioning sociopaths tend to be bad at, e.g. problems stemming from

  • relative aversion to doing boring low-stimulation things (e.g. maintaining a spreadsheet)
  • conversely, a relative penchant for arousal-seeking / thrill-seeking (psychologically I think [LW · GW] this stems from global under-arousal),
  • relative lack of seriousness about avoiding downside risks (psychologically I think this stems from lack of visceral worry about such things)

All the “mismanagement” examples that @cata [LW · GW] mentioned seem to fit into those categories, more or less, I think.

For example, I recall hearing that high-functioning sociopaths in general tend to be terrible at managing their finances and often wind up in debt. I can’t immediately find where I heard that, but it is very true for both of the high-functioning sociopaths that I’ve known personally.

comment by denyeverywhere (daniel-radetsky) · 2023-11-11T22:17:00.138Z · LW(p) · GW(p)

I've been trying to figure out how someone who appears to believe deeply in the principles of effective altruism could do what SBF did. ... It seems important to me to seek an understanding of the deeper causes of this disaster to help prevent future such disasters.

There's a part of my brain screaming "Why are you leaving yourself wide open to affinity fraud? Are you trying to ensure 'SBF 2: This Time It's Personal' happens or what?" However, I'll ask him to be quiet and explain.

The problem was that you should never go around thinking "Somebody who believes in EA wouldn't screw me, therefore this investment must be safe." Instead you should think "The rate of return on this investment is not possible without crime, therefore I don't know why somebody who claims to be an EA would do this, but I don't have to know, I just have to stay away." Or as I said in response to Zvi's book review

You have to think: this man wouldn't offer me free candy just to get in his unmarked van, that doesn't make sense. I wouldn't give anyone candy for that. What's going on here?

It doesn't matter why something is too good to be true. If it is, it must be a lie, and thus bad. Don't take the deal. In case it's not clear "taking the deal" can mean more than just investing with FTX; it also encompasses other sorts of relationships one might get into with SBF or FTX, like taking their money or allowing them to be a public symbol of you.

The point here is that understanding human psychology and motivations, especially where the human you're trying to understand might be trying to trick you, is way harder than just knowing what sorts of returns are possible on capital investments with given amounts of risk. You can try to understand the SBFs of the world in the hopes of being able to identify them, but why do all that extra work? Just don't trust anyone who says they can make you a 50% return on your investment in a year with zero risk (or comparable risk to T-bills) because every single one of them is lying and committing crimes.

Replies from: Viliam
comment by Viliam · 2023-11-12T00:28:43.483Z · LW(p) · GW(p)

Somebody who believes in EA wouldn't screw me

If they can steal your savings and buy 1000 anti-malaria nets, why wouldn't they?

(Just kidding... mostly.)

Replies from: daniel-radetsky
comment by denyeverywhere (daniel-radetsky) · 2023-11-12T00:38:59.877Z · LW(p) · GW(p)

What, you don't think Plasmodum falciparium is a living being with a right to exist? Don't be such a humanity chauvinist.

comment by jmh · 2023-11-11T13:18:26.579Z · LW(p) · GW(p)

Is DAE a terms that is often uses withing some community or is that something you made to formulate your thinking here?

If it's a unique term of your for this analysis I'm curious as to why you chose that approach rather than using an existing term, like sociopath/sociopathic which seems to be both more broadly known and applied. (Not just how sure Healthline is in terms of definitional rigor here but https://www.healthline.com/health/mental-health/sociopath#signs) They seem to cover what you include as well as some other aspect. 

Replies from: spencerg, nathaniel-monson
comment by spencerg · 2023-11-11T17:44:19.206Z · LW(p) · GW(p)

It's more specific than sociopathy.  Also, terms like sociopath/psychopath are problematic because people have a lot of associations with those terms, not all of them accurate, and so I thought it would be better to be more precise about what I mean and also to avoid terms that people have connations around.

Replies from: jmh
comment by jmh · 2023-11-17T02:47:01.852Z · LW(p) · GW(p)

Thanks.

comment by Nathaniel Monson (nathaniel-monson) · 2023-11-11T17:37:40.929Z · LW(p) · GW(p)

If you click the link where OP introduces the term, it's the Wikipedia page for psychopathy. Wiki lists 3 primary traits for it, one of which is DAE

Replies from: M. Y. Zuo
comment by M. Y. Zuo · 2023-11-12T01:59:16.362Z · LW(p) · GW(p)

Is there a specific reason 'affective' was chosen instead of 'emotional' in the naming? 

Is it also a connotation issue?

comment by PHX Photography Services (phx-photography-services) · 2023-11-11T02:49:31.993Z · LW(p) · GW(p)

Why don't you just call it like it is: Narcissistic Personality Disorde - NOT this sugar coated definition titled "Deficient Affective Experience." The term "Experience" is such an overused cliché of a word that now it's getting used to describe a very serious and dangerous personality disorder. Are you going to tell an abused victim of Narcissistic Rage like me and thousands of others - primarily women - that their partners that physically assaulted them, verbally and emotionally abused them, was simply having a "Deficient Affective Experience?"

Replies from: spencerg
comment by spencerg · 2023-11-16T19:16:48.918Z · LW(p) · GW(p)

The reason I talk about DAE and not NPD is because DAE and NPD are different conditions, and while I took seriously while investigating this the possibility that NPD was the cause, I didn’t find enough evidence for that explanation, whereas I found a lot of evidence for DAE. If you think I’m wrong, and see significant evidence for NPD I’d be interested to see that evidence.

Not to say that DAE and NPD have nothing to do with each other, but they aren’t the same.

I would never say to someone who was abused by someone with NPD that they are merely experiencing the result of DAE.

To clarify, DAE refers to two very specific things: a person lacking the emotion of guilt, and/or a person lacking the experience of empathy.

NPD in DSM 5, as I understand it, involves: “the presence of at least 5 of the following 9 criteria: A grandiose sense of self-importance A preoccupation with fantasies of unlimited success, power, brilliance, beauty, or ideal love A belief that he or she is special and unique and can only be understood by, or should associate with, other special or high-status people or institutions A need for excessive admiration A sense of entitlement Interpersonally exploitive behavior A lack of empathy Envy of others or a belief that others are envious of him or her A demonstration of arrogant and haughty behaviors or attitudes”

So a lack of empathy (from DAE) is one potential feature or NPD out of 9. Lack of guilt is not on the list at all.

comment by Steven Byrnes (steve2152) · 2023-11-12T03:45:57.292Z · LW(p) · GW(p)

This strikes me as a good post but it seems to be getting a bunch of downvotes. I'm confused why. Anyone care to explain?

Replies from: nathaniel-monson
comment by Nathaniel Monson (nathaniel-monson) · 2023-11-12T12:33:29.424Z · LW(p) · GW(p)

(I didn't downvote, but here's a guess) I enjoyed what there was of it, but I got really irritated by "This is not the full post - for the rest of it, including an in-depth discussion of the evidence for and against each of these theories, you can find the full version of this post on my blog". I don't know why this bothers me--maybe because I pay some attention to the "time to read" tag at the top, or because having to click through to a different page feels like an annoyance with no benefit to me.

Replies from: spencerg
comment by spencerg · 2023-11-13T02:55:24.669Z · LW(p) · GW(p)

Thanks for letting me know

Replies from: nathaniel-monson
comment by Nathaniel Monson (nathaniel-monson) · 2023-11-13T06:22:26.472Z · LW(p) · GW(p)

Glad to, thanks for taking it well.

I think this would have been mitigated by something at the beginning saying "this is an excerpt of x words of a y word post located at url", so I can decide at the outset to read here, read there, or skip.

Is the reason you didn't put the entire thing here basically blog traffic numbers?

Replies from: spencerg
comment by spencerg · 2023-11-16T19:27:01.400Z · LW(p) · GW(p)

At the top it says it’s a link post and links to the full post, I thought that would make it clear that it’s a link post not a full post.

It’s difficult to keep three versions in sync as I fix typos and correct mistakes, which is why I prefer to not have three separate full versions.

Replies from: nathaniel-monson
comment by Nathaniel Monson (nathaniel-monson) · 2023-11-16T19:42:38.713Z · LW(p) · GW(p)

That's fair. I guess I'm used to linkposts which are either full, or a short enough excerpt that I can immediately see they aren't full.

comment by Alex K. Chen (parrot) (alex-k-chen) · 2023-12-12T21:24:36.100Z · LW(p) · GW(p)

https://twitter.com/alexeyguzey/status/1728549209949995299

comment by alexey · 2023-12-11T21:55:50.208Z · LW(p) · GW(p)

Based on the full text:

Some readers may think that this sounds circular: if I’m trying to explain why someone would do what SBF did, how is it valid to use the fact that he did it as a piece of evidence for the explanation? But treating the convictions as evidence for SBF’s DAE is valid in the same way that, if you were trying to explain why the grass is wet, it would be valid to use the fact that the grass is wet as evidence for the hypothesis that it rained recently (since wet grass is typically substantial evidence for rain).

But a lot of your pro-DAE evidence seems to me to fail this test. E.g. ok, he lied to the customers and to the Congress; why is this substantial evidence of DAE in particular?

oh, FTX doesn’t have a bank account, I guess people can wire to Alameda’s to get money on FTX….3 years later…oh fuck it looks like people wired $8b to Alameda and oh god we basically forgot about the stub account that corresponded to that, and so it was never delivered to FTX.

This seems like evidence in favor of Theory A and against DAE if you look at those as competing explanations? That is, he (is claiming that in this particular case he) commingled funds for reasons unrelated to DAE. 

In November 2022, he also tweeted these statements

It seems likely he believed at that point that if a run could be avoided, he would have enough assets; so making these statements could help most customers, and not making them could hurt most of them, even if it helped a few lucky and quick ones. Not evidence of decreased empathy at all (in my view).

(3) There are multiple sources suggesting that he has a tendency and willingness to lie and deceive others.

Everything under this seems to fail the rain test, at least; very many people have this willingness, most of them don't have DAE (simply based on the prevalence you mention). Is this particular "style" of dishonesty characteristic of DAE?

(4) is actual evidence for DAE, great.

(5) and (10) For the rain test you need to provide a reason to believe most manipulative people have DAE. 

Etc.

For decreased affective guilt the situation seems to be worse: as far as I can see, no evidence for it is presented, just evidence there is some reported guilt and then

In the context of the large amounts of evidence for his lack of affective empathy, it seems more likely that the quote above is an example of cognitive guilt rather than affective guilt.

This seems to require a very large correlation between DAEmpathy and DAGuilt. Why couldn't he have one but not the other?

When I wrote the above, I was just going by your stated definition of DAE; after going to the page you linked, which I should have done earlier, a lot of your evidence seems to cover the facets of psychopathy other than DAE; you could argue they are correlated, but it seems replacing DAE with psychopathy (as defined there) in theories B and C would make the evidence fit strictly better.

Replies from: spencerg
comment by spencerg · 2023-12-13T01:46:38.504Z · LW(p) · GW(p)

Thanks for your comment. Some thoughts:

"But a lot of your pro-DAE evidence seems to me to fail this test. E.g. ok, he lied to the customers and to the Congress; why is this substantial evidence of DAE in particular?"

Because E is evidence in favor of a hypothesis H if:

P(E given H is true) > P(E given H is false)

And the strength of the evidence is determined by the ratio:

bayes factor = P(E given H is true)/P(E given H is false)

In my view there isn't really any other reasonable mathematical definition of evidence other than the bayes factor (or transformations of the bayes factor).

Applied to this specific case:

Probabilityiity(Lying to congress given DAE) > Probability(Lying to congress given not DAE)

And the reason that inequality is true is because people with DAE are more likely to lie than people without DAE (all else equal). 

"Everything under this seems to fail the rain test, at least; very many people have this willingness [to lie and deceive others] most of them don't have DAE (simply based on the prevalence you mention). Is this particular "style" of dishonesty characteristic of DAE?"

The question of whether E is evidence for H is not the same as the question "Is H true most of the time when E?" That's just a different question, and in my view, not the correct question to ask when evaluating evidence. The question to ask to evaluate evidence is whether the evidence is more likely if the hypothesis is true than if it's not true.

And yes, lying is indeed characteristic of DAE. 

Replies from: alexey, alexey
comment by alexey · 2023-12-16T11:28:54.815Z · LW(p) · GW(p)

Or to put it another way: in the full post you say

There is some evidence he has higher-than-normal narcissistic traits, and there’s a positive correlation between narcissistic traits and DAE. I think there is more evidence of him having DAE than there is of him having narcissistic traits

but to me it looks like you could have equally replaced DAE with "narcissistic traits" in Theories B and C, and provided the same list of evidence.

(1) Convicted criminals are more likely to have narcissistic traits.

(2) "extreme disregard for protecting his customers" is also evidence for narcissistic traits.

Etc. And then you could repeat the exercise with "sociopathy" and so on.

So there are two possibilities, as far as I can see:

  1. One or more things on the list are in fact not evidence for narcissistic traits.
  2. They are stronger evidence for DAE than for narcissistic traits. 

But it isn't clear which you believe and about what parts of the list in particular. (Of course, with the exception of (4) and (11), but they go in the opposite directions.)

comment by alexey · 2023-12-16T11:05:01.043Z · LW(p) · GW(p)

Yes, it's evidence. My question is how strong or weak this evidence is (and my expectation is that it's weak). Your comparison relies on "wet grass is typically substantial evidence for rain".

comment by TAG · 2023-11-11T16:58:07.781Z · LW(p) · GW(p)

I'm surprised you didn't mention the Kelsey Piper interview, which strongly supports C.

"So the ethics stuff is mostly a front" -- "Yeah".

Replies from: spencerg
comment by spencerg · 2023-11-11T17:44:34.955Z · LW(p) · GW(p)

I do go into that - see the full version on my blog.

comment by Mr.neitzsmith (nolan-harte) · 2023-11-11T14:09:26.209Z · LW(p) · GW(p)

This is a tremendous over-complication of SBF’s motives

SBF believed in effective altruism, but had the mindset of a degenerate gambler when it came to came to taking risk. He think of his actions as defrauding anyone because in his mind he was going to take customer money, use it to make high risk crypto trades (which he was convinced he’d win), venture capital investments, and pay off loans thus growing FTX and make several times the customer money he spent. He didn’t worry about the risk of a panic run on customer deposits. Basically he thought he’d just steal the money gamble it win his bets give back the money before anyone noticed and pocket the difference

So yes he did believe in effective altruism but he A) thought his goals were so lofty the ends justify the means B) horrible approach to risk C) arrogance

I also just wanna say the whole idea of DAE is absurd, you’re literally describing sociopathy but giving it a nice sounding name. I’m not even arguing that SBF is a sociopath. I think he’s definitely narcissistic but I wouldn’t go as far as to say he’s a sociopath, although who knows I’m not his shrink maybe he is. Anyways stop giving age old things fancy nice sounding names

Edit: I also want to point out that if your goal is to make a ton of money and use it to do good in the world I think opening an off shore casino and marketing it to unsophisticated retail investors is pretty questionable. Like we all know crypto is a highly speculative high risk asset class, and it’s speculative to the point where investing in it can resemble gambling more so than investing especially for retail investors

Sam marketed it as a place where you didn’t have to know anything to invest well. In the add steph curry literally says “I don’t know anything about crypto and with FTX I don’t need to”

I’m not saying that running a casino is inherently unethical, but if you’re such a “do gooder” whose goal in life is to make the world better it seems like a overall negative contribution to society you know what I mean? Like for him FTX was just a means to an end, and I’m sure in his mind he calculated at “I’ll do more good with the money I make than the bad of encouraging retail investors to gamble so it’s okay” and that line of thinking is just so flawed. It’s very very rare that the ends do justify the means, that mindset has been used to justify so many atrocities

It just seems like a very odd Career choice for an espoused do gooder

comment by Joseph Van Name (joseph-van-name) · 2023-11-11T12:38:30.671Z · LW(p) · GW(p)

The cryptocurrency sector is completely and totally unable to see any merit in using cryptocurrency mining to solve a scientific problem regardless of the importance of the scientific problem or the complete lack of drawbacks from using such a scientific problem as their mining algorithm. Yes. They would rather just see Bitcoin mining waste as much resources as possible than put those resources to good use. Since the cryptocurrency sector lacks the characteristics that should be desirable, FTX should not have surprised anyone.