Policymakers don't have access to paywalled articles

post by Adam Jones (domdomegg) · 2025-01-05T10:56:11.495Z · LW · GW · 10 comments

This is a link post for https://adamjones.me/blog/policymaker-paywalls/

Contents

  Policymakers don’t have access
  Policymakers would benefit from access
  Policymakers would use this access
  Recommendation: Make your work open access
None
10 comments

tldr: Government policymakers want to read research, but lack journal access. Your research needs to be open access if you want policymakers to read it, and you should prefer citing open access resources to improve epistemic legibility [LW · GW].

Decorative cover image: policymaker in front of a computer being blocked by a paywall in an 8bit style

Policymakers don’t have access

Many seem to assume that government policymakers would have ready access to relevant scientific research.

Unfortunately, this isn’t the case. At multiple major US and UK government departments, the EU and the UN, staff often can't access the academic papers they need for their work. This sadly even includes those directly responsible for science and technology policy.

In one case, I heard that a Chief Scientific Advisor had to rely on Sci-Hub to get papers. In another, I heard a ministerial office’s policy of taking on interns was driven by wanting to use their university credentials to access papers.

During the COVID-19 pandemic, this became particularly apparent. Someone close to response efforts told me that policymakers frequently had to ask academic secondees to access research articles for them. This created delays and inefficiencies during a crisis where speed was essential.

Policymakers would benefit from access

Evidence-based policymaking requires access to evidence. Direct access would let policymakers validate claims and follow citation trails themselves. This especially matters when evaluating uncertain or conflicting recommendations.

The usual counterargument is that research flows through a pipeline: academic journals to think tank pieces to government policymakers. Think tanks can add value here by: filtering out noise, translating academic writing to policy speak, and analysing the policy implications of the science.

While this can work, it fails in several scenarios:

Policymakers would use this access

Another rebuttal I sometimes get when mentioning this to people is that policymakers wouldn't read research even if they had access.

My experiences suggest otherwise for many of the most impactful decision-makers. Multiple policymakers have expressed frustration at their lack of access, and their actions demonstrate genuine demand:

While not every policymaker will always dive deep into the literature, those most committed to evidence-based policy currently face artificial barriers to doing their jobs effectively. It’s possible that many more would use research if there weren’t trivial [LW · GW] (or quite real) barriers here.

Recommendation: Make your work open access

Given the above, I think this means publishing your work open access is important. This doesn’t necessarily mean ‘formally open access in a journal’, all the following things count:

I also think to reap more of the benefits, you should:

(There are also more systemic solutions like making sure governments have access to journals, or forcing more work to be open access e.g. through funding requirements. But these aren’t the focus of this post.)

  1. ^

    Government policymakers are unfortunately also incentivised to cite ‘reputable-seeming’ resources over the ones they actually used to come to that opinion. This makes it appear externally like these are relied on to come up with policy.

    But realistically a lot of government policy gets made based on travelling down interesting blog articles, Twitter threads and preprints from ‘everyday’ authors.

    Policymakers come to ideas, the report gets written, then citations are swapped out near the end of the process for final publication (I have it on good authority that comms teams prefer that you don’t state the government is getting its key policy ideas from Twitter user @BakedBureaucrat420).

    As someone once approximately said (probably John Godfrey Saxe), “Laws are like sausages, it is better not to see them being made.”

10 comments

Comments sorted by top scores.

comment by gwern · 2025-01-10T23:18:35.238Z · LW(p) · GW(p)

I believe this. There is a pervasive tendency to imagine that the grass is always greener on the other side: "sure, no one in $MY_AREA spends a lot of time going through paywalls, even when they ostensibly have access, because it's such a hassle, and rely heavily on social media or informal writings or Wikipedia, and for us it's definitely true that 'if it's not in Google it doesn't exist', but over there, among the grownups in the room, there they do it right, the way we wish we could, there they are of course doing all their homework and diligently reading every paper rather than just skimming or skipping!" And then sometimes you get over to that other room, and realize that it's more or less like where you just came from. Yeah, they too use Sci-Hub and Twitter and Google Docs. Yeah, the billionaires are using the same smartphones and SaaS apps you are too, and may be reading the same blogs too. What you see is what you get.

comment by Edouard Harris · 2025-01-11T20:51:00.241Z · LW(p) · GW(p)

Yep, can confirm this is true. And this often leads to shockingly stupid outcomes, such as key action officers at the Office of [redacted] in the Department of [redacted] not reading SemiAnalysis because they'd have to pay for their subscriptions out of pocket.

Replies from: gwern
comment by gwern · 2025-01-11T22:26:52.194Z · LW(p) · GW(p)

Dylan seems like a decent enough guy. Why not email him and request a free subscription for a specific email address such as the personal email addresses of key action officers at the redacted Office? (It's worth noting that because proprietary newsletters have zero marginal cost, their operators tend to be a lot more chill about giving away subscriptions, even ones with high face-values, than most people let themselves believe, especially if the person receiving the subscription is of any interest.)

Replies from: Edouard Harris
comment by Edouard Harris · 2025-01-12T14:19:33.374Z · LW(p) · GW(p)

Because of another stupid thing, which is that U.S. depts & agencies have strong internal regs against employees soliciting and/or accepting gifts other than in carefully carved out exceptional cases. For more on this, see, e.g., 5 CFR § 2635.204, but this isn't the only such reg. In practice U.S. government employees at all levels are broadly prohibited from accepting any gift with a market value above 20 USD for example. (As you'd expect this leads to a lot of weird outcomes, including occasional hilarious minor diplomatic incidents with inexperienced foreign counterparties who have different gift giving norms.)

Replies from: gwern
comment by gwern · 2025-01-12T23:03:07.500Z · LW(p) · GW(p)

Yeah, I was afraid that might apply here. It seems like you should still be able to do something like "government employee tier" subscriptions, not targeted at an individual but perhaps something like 'GS-8 and up', set low enough that it would appeal to such customers, perhaps? It is not a gift but a discount, it is not to an individual but to a class, it is part of a market, and it is not conditional on any government action or inaction, and such discounts are very common for 'students', 'veterans', 'first responders' etc, and I've never seen any fineprint warning government employees about it being >$20 despite many such discounts potentially crossing that threshold (eg. Sam's Club offers $50 off a new membership, and that seems clearly >$20, and to be doing it through a whole company devoted to this sort of discount, ID.me).

But I suppose that might be too complex for SA to be interested in bothering with?

Replies from: Edouard Harris
comment by Edouard Harris · 2025-01-13T14:06:29.194Z · LW(p) · GW(p)

Yeah that could be doable. Dylan's pretty natsec focused already so I would guess he'd take a broad view of the ROI from something like this. From what I hear he is already in touch with some of the folks who are in the mix, which helps, but the core goal is to get random leaf node action officers this access with minimum friction. I think an unconditional discount to all federal employees probably does pass muster with the regs, though of course folks would still be paying something out of pocket. I'll bring this up to SA next time we talk to them though, it might move the needle. For all I know, they might even be doing it already.

comment by Satron · 2025-01-05T11:04:29.956Z · LW(p) · GW(p)

If you are an AI researcher who desperately needs access to paywalled articles/papers to save humanity:

  • archive.is lets you access a lot of paywalled articles for free (one exception that I know of is Substack)
  • libgen.is lets you access a lot of paywalled academic papers for free (it has a much bigger library than SciHub and doesn't require DOI)
comment by bilalchughtai (beelal) · 2025-01-05T14:54:27.478Z · LW(p) · GW(p)

your image of a man with a huge monitor doesn't quite scream "government policymaker" to me

comment by nc · 2025-01-05T11:58:13.896Z · LW(p) · GW(p)

During the COVID-19 pandemic, this became particularly apparent. Someone close to response efforts told me that policymakers frequently had to ask academic secondees to access research articles for them. This created delays and inefficiencies during a crisis where speed was essential.

I wonder if this is why major governments pushed mandatory open access around 2022-2023. In the UK, all public-funded research is now required to be open access. I think the coverage is different in the US.

How big of this is an issue in practice? For AI in particular, considering that so much contemporary research is published on arxiv, it must be relatively accessible?

Replies from: domdomegg
comment by Adam Jones (domdomegg) · 2025-01-06T15:17:21.594Z · LW(p) · GW(p)

How big of this is an issue in practice? For AI in particular, considering that so much contemporary research is published on arxiv, it must be relatively accessible?

I think this is less of an issue for technical AI papers. But I'm finding more governance researchers (especially people moving from other academic communities) seem intent on journal publishing in places that policymakers can't read their stuff! I have also been blocked sometimes from sharing papers with governance friends easily because they are behind paywalls. I might see this more because at BlueDot we get a lot of people who are early on in their career transition, and producing projects they want to publish in places.