I was recently reminded of the Lassonde Curve which illustrates the value shift during the lifecycle of a mineral discovery.
Coincidentally, whilst working on a consulting project in biotech currently, I was made aware of a similar curve in biotech which describes the phenomenon of escaping the valley of death. We see this in tech more generally. The overt similarities interested me.
As we often do these days, instead of Googling, I asked claude.ai: Do we see the equivalent of the Lassonde curve in biotech? Mostly I just wanted to find a source for the biotech curve.
Claude’s answer surprised me on two counts.
Firstly, claude.ai was unaware of the Lassonde Curve. Realy? A simple Google search will reveal the curve above, along with plenty of references. At least claude.ai was not wrong, just useless.
I subsequently found the valley of death in the biotech sector also via a simple Google search.
The resemblance to the Lassonde curve is obvious. That it is so should be unsurprising, but it was new to me in that moment. But what came next surprised me even more.
Claude went on unprompted to tell me:
“However, if you’re asking about learning curves or scale economies in biotech, there are definitely some interesting patterns:
Cost-per-discovery curves: As biotech platforms mature, the cost per successful drug candidate or diagnostic often decreases due to:
• Accumulated data and insights
• Refined screening processes
• Better target identification
• Platform efficiencies
”
I knew that this is wrong. I use a drug discovery curve in a session I teach on strategic innovation in the MBA which demonstrates the exact opposite is true. This reality is true across multiple sectors: our research efficiency is declining. This is counter to the assumption many people hold. The explanation has to do with ‘combinatorial innovation’ but that’s a whole other blog.
Declining Research Efficiency.
Source: Scannell, J.W., Blanckley, A., Boldon, H., and Warrington, B. “Diagnosing the Decline in Pharmaceutical R&D Efficiency,” Nature Reviews Drug Discovery, 2012, 191-192.
So, then I challenged claude.ai: Your comment on capital efficiency curves is at odds with the empirical data ... do you want to review your comments and reassess.
If you have any experience with these AI tools, you know what happened next. Claude suddenly found it agreed with me: viz.
“The empirical data actually shows that capital efficiency in biotech tends to worsen over time, not improve. This is the opposite of what I suggested … The biotech industry seems to exhibit something closer to an inverse learning curve - where accumulated knowledge reveals how much more difficult the remaining challenges are, rather than making them easier to solve.
This is fundamentally different from manufacturing industries where experience and scale typically drive unit costs down.
”
What is the lesson we should draw from this? It is obvious. For all the surprising skills of AI to deliver insights and write cogent narratives, often with more skill than many of us might muster, you simply cannot rely on it to give you advice in domains where you do not have domain expertise. It will take you down a garden path and leave you stranded and embarrassed.
This should not be news to anyone, but it seems some missed the memo:
I don’t particularly want to call out Deloitte on this - I am certain they are not orphans in this - but the AFR headline so clearly made the point. It is worth reading the article to appreciate the scale and scope of errors. And if you’ve spent any time using AI you would think the risks were obvious.
In the MBA strategy & consulting unit I teach at UWA, where students undertake a consulting project for ‘clients,’ I tell them to use AI - they would anyway, but let’s make it overt. But I also require them to develop a policy position on the use of AI. Some of the teams did a really good job on the policy, and if they follow it, they won’t find themselves embarrassed.
In the meantime, remember:
AI is brilliant, but like many brilliant people, highly flawed.