Hiring Programmers in Academia

post by jefftk (jkaufman) · 2022-07-24T20:20:05.683Z · LW · GW · 19 comments

A professor I know through the EA community has been trying to hire a software engineer for their research, and they explained some privately about how this is tricky. The following are points I took away that might be useful to programmers considering job postings, people in academia looking to hire programmers, and people trying to understand why it's hard for EA projects to hire programmers despite there being a lot of them in EA.

One effect of this is that if an EA academic project needs a full-time experienced software engineer, they will often need to hire an EA because they need someone who is willing to work for much less than they could get elsewhere. Even if the work seems like it could be done by a non-EA at market wages, academically affiliated projects won't be able to do that.

(The professor reviewed this post, and has asked to remain anonymous.)

19 comments

Comments sorted by top scores.

comment by Darmani · 2022-07-25T00:54:38.501Z · LW(p) · GW(p)

I've hired (short-term) programmers to assist on my research several times. Each time, I've paid from my own money. Even assuming I could have used grant money, it would have been too difficult. And, long story short, there was no good option that involved giving funds to my lab so they could do the hire properly.

comment by EKP · 2022-07-24T23:57:22.116Z · LW(p) · GW(p)

Possibly scarier: the federal government and national lab system has not identical, but very similar barriers.

Replies from: gworley
comment by Gordon Seidoh Worley (gworley) · 2022-07-25T02:32:33.553Z · LW(p) · GW(p)

Can confirm. I almost took a job with the federal government early in my career but passed because I could get paid more with less bullshit elsewhere (e.g. no strict dress code).

comment by Andrew_Critch · 2022-07-24T23:50:56.077Z · LW(p) · GW(p)

Jeff, are they working to reduce existential risk?  If so, this it totally the kind of thing that BERI supports :)

comment by cata · 2022-07-25T01:21:19.546Z · LW(p) · GW(p)

This makes it sound like if I am a good programmer and I want to help people out (and not get paid market rate, and not get job security), I should find lots of unusually good opportunities within academia. Do you think that's the case? If so, do you have any suggestions for how to find them? I have zero experience with any university ever.

Replies from: Linch, adam-jermyn
comment by Linch · 2022-07-25T04:53:38.855Z · LW(p) · GW(p)

My guess (from outside the system) is that great opportunities for high impact exist, but the search costs are going to be really high, and academics don't have a lot of incentive to make the best opportunities legibly better/more prominent than mediocre ones. 

comment by Adam Jermyn (adam-jermyn) · 2022-07-25T01:36:12.030Z · LW(p) · GW(p)

In my experience there are lots of things in academia that would be improved by someone writing software, but even below market rate there often isn’t any money for it. Funding agencies are (at least in the US) weirdly uninterested in funding software development unless it’s done by someone with the title “grad student” or perhaps “postdoc”. That’s not to say opportunities don’t exist, but the market failure goes deeper than being unwilling to pay market rate.

Replies from: jsteinhardt
comment by jsteinhardt · 2022-07-25T01:59:18.485Z · LW(p) · GW(p)

I think this might be an overstatement. It's true that NSF tends not to fund developers, but in ML the NSF is only one of many funders (lots of faculty have grants from industry partnerships, for instance).

Replies from: adam-jermyn
comment by Adam Jermyn (adam-jermyn) · 2022-07-25T02:19:25.104Z · LW(p) · GW(p)

Ah this is a good point! I’m thinking more of physics, which has much more centralized funding provided by a few actors (and where I see tons of low-hanging fruit if only some full-time SWE’s could be hired). In other fields YMMV.

comment by YimbyGeorge (mardukofbabylon) · 2022-07-24T21:55:14.188Z · LW(p) · GW(p)

Can't you just use grad students?

Replies from: Darmani, korin43
comment by Darmani · 2022-07-25T00:52:55.552Z · LW(p) · GW(p)

Grad students are training to become independent researchers. They have the jobs of conducting research (which in most fields is mostly not coding), giving presentations, writing, making figures, reading papers, and taking and teaching classes. Their career and skillset is rarely aligned with long-term maintenance of a software project; usually, they'd be sacrificing their career to build tools for the lab.

Replies from: Gunnar_Zarncke
comment by Gunnar_Zarncke · 2022-07-25T12:31:08.989Z · LW(p) · GW(p)

Many grad students go into the free market later anyway so there should be some that fit.

comment by Brendan Long (korin43) · 2022-07-24T22:43:19.371Z · LW(p) · GW(p)

I would expect grad students to have very little experience and you could hire people with similar levels of experience (junior engineers) with normal university wages.

Replies from: Linch
comment by Linch · 2022-07-25T04:49:54.977Z · LW(p) · GW(p)

Grad students are paid in prestige, research experience, and other forms of career capital, as well as mission, rather than just $s. Even so, arguably many of them are quite underpaid (when many of the EAs I know who have no intrinsic love of the academic life are considering grad school, they think of it as a sacrifice for future impact).

In comparison, software engineers for academia are only paid in $s, plus mission, plus (substantially less) prestige. So paying junior engineers the equivalent to a grad student is quite a raw deal in comparison.

Replies from: Derek-Jones
comment by Derek M. Jones (Derek-Jones) · 2022-07-25T11:10:22.234Z · LW(p) · GW(p)

Exactly. The incentives are not there to invest in becoming a decent developer.

comment by Dagon · 2022-07-25T00:22:04.840Z · LW(p) · GW(p)

In some places, this would lead to indirect hiring - rather than recruiting individuals, use an agency or contracting firm.  Contract limits are likely much higher than salary limits, at least for grant-funded work.

comment by weathersystems · 2022-07-25T03:29:02.366Z · LW(p) · GW(p)

Do you have a link to the job posting?

Replies from: jkaufman
comment by jefftk (jkaufman) · 2022-07-25T11:40:44.549Z · LW(p) · GW(p)

Sharing the link would disclose who I was talking to, sorry!

comment by mlinksva · 2022-07-25T01:17:41.043Z · LW(p) · GW(p)

I wonder if using the title research software engineer, posting on RSE job boards, networking in their communities, adhering to their norms, might help with matching. Idle/uninformed speculation; I only have become aware of the self-identified field/title in the last year, and gather it is only about 10 years old.