Linkpost: Surely you can be serious

post by kave · 2024-07-18T22:18:09.271Z · LW · GW · 8 comments

This is a link post for https://www.experimental-history.com/p/surely-you-can-be-serious

Contents

8 comments

Adam Mastroianni writes about "actually caring about stuff, and for the right reasons", rather than just LARPing. The opening is excerpted below.

I once saw someone give a talk about a tiny intervention that caused a gigantic effect, something like, “We gave high school seniors a hearty slap on the back and then they scored 500 points higher on the SAT.”1

Everyone in the audience was like, “Hmm, interesting, I wonder if there were any gender effects, etc.”

I wanted to get up and yell: “EITHER THIS IS THE MOST POTENT PSYCHOLOGICAL INTERVENTION EVER, OR THIS STUDY IS TOTAL BULLSHIT.”

If those results are real, we should start a nationwide backslapping campaign immediately. We should be backslapping astronauts before their rocket launches and Olympians before their floor routines. We should be running followup studies to see just how many SAT points we can get—does a second slap get you another 500? Or just another 250? Can you slap someone raw and turn them into a genius?

Or—much more likely—the results are not real, and we should either be a) helping this person understand where they screwed up in their methods and data analysis, or b) kicking them out for fraud.

Those are the options. Asking a bunch of softball questions (“Which result was your favorite?”) is not a reasonable response. That’s like watching someone pull a rabbit out of a hat actually for real, not a magic trick, and then asking them, “What’s the rabbit’s name?”

8 comments

Comments sorted by top scores.

comment by bhauth · 2024-07-18T23:59:17.703Z · LW(p) · GW(p)

the reward for playing the game is more game ... It’s just the same thing over and over until you die. You don’t get out by winning; you get out by stopping.

What does this say about what it means for someone to be "qualified" for a position? What does it say about where you should expect to find the smartest people?

comment by Viliam · 2024-07-19T22:19:34.219Z · LW(p) · GW(p)

It would be great if you could get paid for doing the right thing.

And the first and third lies (lies? that's assuming the conclusion) seem to be about assuming that this actually is possible -- therefore, if you are not getting paid for doing the right thing, if you are not working full-time at doing the right thing, then you are not trying hard enough to do the right thing.

comment by DPiepgrass · 2024-07-19T03:27:03.025Z · LW(p) · GW(p)

I'm confused why this is so popular.

Sure, it appears to be espousing something important to me ("actually caring about stuff, and for the right reasons"). But specifically it appears to be about how non-serious people can become serious. Have you met non-serious people who long to be serious? People like that seem very rare to me. I've spent my life surrounded by people who work 9 to 5 and will not talk shop at 6; you do some work, then you stop working and enjoy life. 

some of the most serious people I know do their serious thing gratis and make their loot somewhere else.

Yeah, that's me. So it seems like the audience for the piece can't be the audience that the piece appears to be for. Unserious people are unserious because they don't care to be. Also:

For me, I felt like publishing in scientific journals required me to be dishonest.

...what?

Replies from: ben-lang, Seth Herd, Rana Dexsin, abramdemski, Augustin Portier
comment by Ben (ben-lang) · 2024-07-25T15:06:22.832Z · LW(p) · GW(p)

For me, I felt like publishing in scientific journals required me to be dishonest.

...what?

I can't speak to what the OP meant by that. But scientific publishing does require spin, at least if you are aiming for a good journal. There is not some magic axis by which people care about some things and not about others, so its your job as an author to persuade people to care about your results. This shifts the dial in all sorts of little ways. 

"Well, in the end it seems like we learned nothing." If that is the conclusion you don't get to publish the paper, which is not good for your career. Where-as "In conclusion, we have shown {really important result} beyond any shadow of a doubt" is good. But real results are in the middle. You have something, but there are caveats, assumptions, details that you don't think are important but who knows maybe they are? On any particular weakness, how much emphasis does it get? A paragraph? A sentence? A footnote? In the supplementary information? Entirely missing? How much emphasis would you give that weakness in your methodology if the publishing process was not incentivising you to put it as far down that list as possible? 

The manufacturing process was not reliable, but the 32nd device tested worked fairly well, as plotted in fig.3.
"Why mention the 31 devices that the paper is not about?"

Assumption 1, assumption 2....
"Its nice that you understand and explain these assumptions so well. But they are all pretty standard in the field. I think we can drop these paragraphs, just say "using standard approximations", actually "standard methods" sounds better."
 

The end result:

PhD student's draft: "It is possible that quantum information technology might be important at some point in the future. One aspect of that is 2-bit operations, but they need to be robust. One particular 2 bit operation is the CNOT gate. In this paper we demonstrate a CNOT quantum gate, that only worked on the 32nd tested device. Its nowhere near good enough for a useful quantum computer, but it  worked OK on Tuesday, which is something (when I returned to get more data on Wednesday it had permanently stopped working for inexplicable reasons.)."

Final (published) paper after the professor has had an edit: "Quantum technology will soon revolutionise all aspects of human society, bringing vast social and economic benefits. The key obstacle to realising these enormous gains is a reliable the 2-bit quantum gate. In this paper we propose a novel design for such a gate, and find that a high level of reliability can be achieved simultaneously with improving the device's speed."

comment by Seth Herd · 2024-07-20T20:32:40.334Z · LW(p) · GW(p)

It's popular because people think it's a helpful point to make. Nonserious people can and should become serious. And science shouldn't be a LARP.

I was a professional scientist (in cognitive psychology and neuroscience) for two decades and change. I quit largely because the field wasn't serious in this sense. Nobody cared much about applications. They were just enjoying "doing science" (or sometimes not even really enjoying it).

They damned well could and should get off their intellectual asses and become serious. That's what this post advocates, and it's very much a matter of choice and perspective. That's why it's perceived by many, including me, as a valuable point and perspective.

comment by Rana Dexsin · 2024-07-20T00:13:20.874Z · LW(p) · GW(p)

Have you met non-serious people who long to be serious?

I am one of those people—modulo some possible definitional skew, of course, especially around to what degree someone who wishes to be different from how they are can be considered to wish for it coherently.

I know that right now I am not acting seriously almost at all, and I feel a strong dislike of this condition. Most of my consciously held desires are oriented in the direction of seriousness. A great deal of me longs to be serious in wholeness, but that desire is also being opposed by a combination of deep (but ego-dystonic) conditioning, some other murkier limitations that seem ambiguously biological and in any case have been very difficult to get at or pin down, and some major internal conflicts around which path to be serious about—whose resolution in turn is being obstructed by the rest of it.

Edited to add: to be clear, this isn't a statement about whether the article winds up actually being useful for helping people become more serious, and indeed I have a vague intuition that most reading-actions applied to articles of this general nature may decay into traps of a “not getting out of the car” variety. (If I had a better way that I thought would be useful to talk about, I'd be talking about it.)

comment by abramdemski · 2024-10-24T16:47:14.648Z · LW(p) · GW(p)

For me, I felt like publishing in scientific journals required me to be dishonest.

...what?

Quoting a little more context:

I encounter this idea all the time when I’m talking to academics about academia. I give ‘em my whole spiel about publishing, being honest, blah blah blah, and they go, “Well, we don’t live in a utopia. You have to make tradeoffs in life.” Yes, of course! But the whole point of tradeoffs is to trade something you value less for something you value more. The thing you care about the most—that’s the thing you don’t compromise on!

(This is, by the way, Negotiations 101.)

For me, I felt like publishing in scientific journals required me to be dishonest. So I stopped publishing in scientific journals.

The "whole spiel" has a link to another essay by the same author. At the very end, it gives an example of what they mean by "being honest" -- what science can look like when one isn't worried about peer review.

comment by TeaTieAndHat (Augustin Portier) · 2024-07-19T04:49:04.337Z · LW(p) · GW(p)

"Have you met non-serious people who long to be serious? People like that seem very rare to me."
… Hmmm… kinda? Like, you’re probably right that it’s few people, and in specific circumstances, but I know some people who are doing something they don’t like, or who are doing something they like but struggling with motivation or whatever for other reasons, and certainly seem to wish they were more serious (or people who did in fact change careers or whatever and are now basically as serious as Mastroianni wants them to be, when they weren’t at all before). But those are basically people who were always inclined to be serious but were prevented from doing so by their circumstances, so you have a point, of course.