Drug development costs can range over two orders of magnitude

post by rossry · 2024-11-03T23:13:17.685Z · LW · GW · 0 comments

Contents

  New drugs being developed can be "easy" drugs or "difficult" drugs.
  A difficult drug can require literally one hundred times more investment than an easy one.
  Easy drugs can be made difficult.
  ...though the most lucrative "blockbuster" drugs will have to have many-to-most of the difficult factors.
  Industry players are far more used to developing difficult drugs than easy ones.
  Conclusions
None
No comments

This is a cross-post from my new newsletter, where I intend to post about clinical trials and biotech, and from my personal blog, where I intend to go on posting about all other sorts of topics as well.

I also recently went on the Complex Systems podcast, where I discuss these topics with more examples from actual trials in the world.


New drugs being developed can be "easy" drugs or "difficult" drugs.

In order to know whether your drug candidate is safe and effective, you're going to test it in a series of clinical trials. In each trial, you'll recruit some number of patients, give each patient the treatment, placebo, or a comparator drug, wait some time, and test them for pre-specified endpoints.

Within that framework, however the trials for different drugs will differ greatly. (And the different phases of a single drug's trials may differ by even more!) Typically, the greatest axes of variation will be:

In this framework, there are "easy" drugs that:

"Difficult" drugs, by contrast:

A difficult drug can require literally one hundred times more investment than an easy one.

A clinical trial is a statistical problem multiplied by a logistical problem:

Your per-patient logistics have a per-patient cost, which gets multiplied that by how many patients you (need to) include. In empirical practice, these patient-based costs will form the majority of the costs of your trial.

It follows that your trial can easily have lower (or higher) total costs if your statistical problem is smaller (larger), or if you solve it more (less) efficiently, or if your per-patient logistical problem is smaller (larger), or if you solve it more (less) efficiently. And the effects multiply.

Here's a naive back-of-the-envelope calculation of how this might go for a particular trial:

Table showing a 1.7× trial size due to "who: noise from complications", as well as 4× trial size from "what: number needed to treat", 2× cost from "where: setting", 1.5× cost from "where: country", 10× cost for "when: duration", 3.2× trial size from "when: days adding noise", and ÷1.6 to discounted revenues from "when: time until approval"

"Why" and "how" have a significant bearing on the trial's probability of success, but let's skip that for now. Based on the estimates listed, I get a final product of:

Taken literally, that means our difficult drug's trials cost 675× as much as our easy drug's do. When considering the extra revenue discounting, our difficult drug needs to make 1,086× as much in revenue in order to break even.

Those are multiplication signs, not percentages.

In reality, your difficult drug won't have all of those disadvantages (and there will be fixed costs that don't scale with the number of patients). Still, a—quite literal—factor of 100× sounds crazy, but is quite prosaically possible.

Sometimes, the world just sounds crazy.


sanity check: Moore et al. 2018 surveys 59 final-phase clinical trials from 2015 and 2016; they report a range of $5 million to $350 million in the wild.

conclusion: trial costs can differ by at least high double-digit factors.


Easy drugs can be made difficult.

All of the easy properties are, technically speaking, optional. You can choose to treat your easy drug as if it were difficult, and the costs will follow:

These are all choices! None of them are required by the laws of statistics, physics, or the United States! But neither are they prohibited.

Now, each of them is a choice that you might make for good reasons. Some drugs certainly require you to check one, two, more, or all of those checkboxes. Some diseases have a who that's susceptible to medical complications. Or is old. Or who react differently to different drugs and no one really understands why. The FDA might express quite explicitly what endpoints they'll want to see your results in, and how much of your where they want to be in the US. Drugs for chronic use will need safety and efficacy tests with a chronic when. For a vaccine, your patients typically won't be exposed to the infection on a convenient schedule, so your when will be a wait-and-see (and your what will have some low percentages). Some diseases we just don't understand the why or how of yet, or we aren't yet good at making animal models that give us a good preclinical why.

(That said, if you're reading this and you are running a trial with every one of these checkboxes checked, reach out and I promise I will buy you an appropriate alcoholic beverage in great sympathy.)


sanity check: a tale of two efficacy trials for Covid-19 treatments...

1) Pfizer developed paxlovid taking several chapters out of the typical playbook for blockbuster drugs. Their 10-Q for the third quarter of 2021 reported:

R&D expenses increased $1.1 billion in the third quarter primarily due to:

  • an upfront payment [of $650 million] related to the global collaboration agreement with Arvinas to develop and commercialize ARV-471; and
  • increased investments across multiple therapeutic areas, including additional spending related to the development and at-risk manufacturing of the COVID-19 anti-viral programs.

The EPIC-HR trial for paxlovid was the largest Covid-19 program they were running during that quarter (and ran well into the fourth quarter as well), so I'll ballpark their spending on the first half of the trial at $150–300 million and their total spending at maybe twice that.

2) I have a story that could go here, but the company that it's about would prefer I not identify them. Suffice it to say that they ran a clinical trial for 85% as many patients as EPIC-HR, smashed through the endpoints with efficacy approximately equal to that of paxlovid. Their budget was in the low single-digit millions of dollars, meaning a few thousand dollars per patient.

Unfortunately, they were not approved by the FDA for emergency use, and the company decided not to disclose why. But I believe it wasn't because they ran a bad trial, but rather because (a) they counted a different threshold for "time spent in hospital" than the FDA wanted, (b) the trial was 100% in Latin America, with no US sites, and (c) by the time they applied, there was already a drug and the FDA was reluctant to give another emergency approval without a second trial.

The choice of endpoint is a frustrating error that could have been resolved in "pre-submission" meetings with the FDA while the trial was going on. (Maybe the company couldn't get those meetings, because it was too small?) I don't know how much it would have cost to relocate a third of their trial to the US, but I find it hard to believe that it would have multiplied it by more than a factor of 3 or so.

conclusion: A trial that cost a few million dollars at a scrappy startup cost Pfizer a few hundred million. I don't have any good explanation for this besides, well, you can decide to make a cheap trial cost a lot of money if that's what you expect it should cost.


...though the most lucrative "blockbuster" drugs will have to have many-to-most of the difficult factors.

From the pharma company's perspective, the drugs that are most valuable per-patient are those that (a) are taken regularly for life (difficult "when"), and (b) are sold to well-insured Americans. The condition of being a well-insured American is associated with being rich and old. (difficult "who")

This means that (ignoring the relatively new anti-obesity sector) the invisible hand of the market will direct your attention to age-associated cancers, scary pediatric cancers (based on the parents' insurance), neurodegenerative disorders, chronic and yet-untreated cardiovascular conditions, and things of that general ilk. If there was a group of medical conditions with well-understood mechanisms, great animal models, and well-validated correlates of efficacy, this set is its opposite. (difficult "why" and "how")

Cancer trials specifically -- for reasons this margin is too narrow to contain -- tend to have particularly complex patient inclusion / exclusion conditions. (difficult "who", and a bit of difficult "what") In any case, they are typically looking for patients not responding to "first-line" / standard treatment for [body part] cancer (difficult "who"), for commercial reasons that I also won't get into here.

You absolutely would not believe how many startups there are trying to "solve patient recruitment", and those which list "focus areas" tend to be dominated by cancer indications. Those with patient testimonials usually have those testimonials come from cancer patients.

Webpage screenshot says 'You have treatment options. Treatment options near you for {Enter the type of cancer}. (Not an uncommon patient experience, for a patient interacting with a startup trying to "solve patient recruitment".)

Industry players are far more used to developing difficult drugs than easy ones.

Imagine a doctor who has invented a new drug. Their drug is being tested in patients for safety and efficacy right now. Close your eyes and visualize what they are doing.

You might be visualizing someone like Jonas Salk personally injecting a patient with his candidate polio vaccine (or a placebo):

Photograph of Jonas Salk giving a vaccine injection to a school-aged girl, assisted by an adult woman.

(This is a charming image that does does not reflect the reality of modern-day clinical trial operations.)

Instead, our modern-day doctor-inventor has—almost invariably—hired a contract research organization (CRO) to manage their trial, for much the same reason that you'll hire a general contractor when building a house. Right now they are on a video call for an hours-long meeting with the CRO project manager. Or rather, they're ignoring the video call while they answer another interminable email thread to some other contractor staff. The process typically does not suffer from a deficit of bureaucracy. (But the VC who led their last round said that this particular CRO ran the trial that worked well for their last portfolio company, and so...)

Whatever their other benefits or faults, a CRO will be most focused on the needs and problems of their best-paying customers, as compared to their small-time clients. (And their last big client felt that they were getting their money's worth with the 10-hour kickoff meeting and certainly didn't seem to mind that it took four weeks to set up the database...)

I don't mean to say that the trial you receive will be one-size-fits-all; that would be an exaggeration. But there are habits of mind and operating practices that will make it hard to switch from planning years-long, multi-hundred-million-dollar trials to relentlessly trimming every cost and delay from the trial that you already got down to $10 million and 18 months. Insist that it can cost $5 million and be done in 6 months, and they may just show you the door.

A cynic might also note that the CRO's fees are bundled into those costs, and might question just how whole-hearted they can be about a cost-cutting exercise. It is, as they say, difficult to get a man to understand something when his salary depends on his not understanding it.

Conclusions

New drugs in development can be “easy” drugs or “difficult” drugs. (You can think of the factors in terms of who / what / where / when / why / how.) The latter can require literally one hundred times more investment than the former. Easy drugs can be made difficult -- no one will stop you -- though the most lucrative blockbuster drugs will have require many-to-most of the difficult factors. As a direct consequence, players up and down the stack are far more used to developing difficult drugs than easy ones. Clinical campaigns that could be fast and cost-effective will slide towards being slow, expensive, and bloated by default.

I don't think that any of these claims are all that unknown, in the industry, but it took me a while to put all of them together. Then again, so what?

First: The currently-dominant model of "pick a target, then ask how much it will cost to develop a drug for" is overrated. Come-what-may, moonshot-bound entrepreneurs warm my heart, but we don't give nearly enough attention to the approach of "ask what low-hanging moons can be hit cheap and fast, then pick an important one among them".

It sounds so much more sexy to raise hundreds of millions to go after a tier-1-importance target than to go after a tier-1.5-importance target for the total cost of a medium-sized Series A round. But I want to live in a world that has more of the former and a lot more of the latter.

Second: We need more support for the lean-and-fast path in new drug development. Without a flag to rally to, fellow-travelers to reassure you that you're not crazy, and experienced advisors to point out the patches of quicksand, founders won't have a path to follow.

Third, this:

A meme image of "Pharma Sector" reaching for "Shiny New Research Approaches", but a wider frame shows that "Pharma Sector" is being held back by the pink monster "Clinical Trials."

Drug discovery is critically important and has promising opportunities that are being unlocked by AI, but it isn't the rate-limiting step in the process of bringing new drugs into the world. Opening new floodgates in drug discovery with [your technology here, possibly including "AI"] won't move the needle on new drug approvals if we don't also fix clinical trials.

Finally: A team that can figure out how to repeatably and reliably identify easy drugs and guide them onto the lean-and-fast development path can unlock huge amounts of social value while building a self-sustaining and economically profitable flywheel. By funding easy drugs and planning their trials the way they should be, we can expand the boundaries of what is commercially viable beyond the traditional focus on old insured Americans.

As a first use-case: treatments for infectious diseases which affect a few Americans and huge numbers of people in lower-income countries aren't commercially viable on the legacy model and so aren't funded except by mega-philanthropies, but if we can bring the costs down, they can be commercially viable on their own terms.

If you're interested in being part of that we—whether you're a founder, a clinician, an investor, or anything else—get in touch!

0 comments

Comments sorted by top scores.