How to Leverage Domain Expertise — Chris Lovejoy, Notius Labs
Summary
Winning in vertical AI isn't about model sophistication—it's an organizational problem. Chris Lovejoy's framework reveals that 50% of generative AI projects fail because teams lack deep domain expertise; success requires systematically embedding domain experts as oracles, evaluators, or architects rather than hiring them as afterthoughts.
Key Takeaways
- The three common hiring mistakes: not hiring domain experts or hiring them too late, hiring the wrong type of domain expert, and failing to integrate them properly into your organization structure.
- The oracle-evaluator-architect framework maps how to position domain experts: as oracles (judgment sources), evaluators (quality assessors), or architects (system designers). Each role operationalizes expert judgment differently.
- Domain expertise doesn't require hiring specialized credentials—it can be informal expertise already existing in your organization. Empower current team members who perform this function rather than always hiring externally.
- The critical gap isn't model quality—it's operationalizing expert judgment around models. Current foundation models are sufficient; the bottleneck is understanding specific workflows and domain-expert decision-making processes.
- Vertical AI represents a multi-trillion dollar opportunity (replacing labor vs. just SaaS), but requires solving the 'last mile problem'—getting products to understand specific workflow nuances of each customer use case.
Topics
- Domain-Native AI Organization
- Vertical AI Product Strategy
- Oracle-Evaluator-Architect Framework
- AI Quality Judgment and Evaluation
- Domain Expert Hiring and Integration
Transcript Excerpt
[music] >> Okay, so Welcome everybody. Hi, my name is is Chris Lovejoy. And I'm going to talk about how to leverage domain expertise to build better AI products. And the way I believe you can do this is by building what I call a domain native AI organization. So I'm going to talk about what that looks like. >> [snorts] >> Um brief background about me because um this is relevant. So I started out my career as a medical doctor. I trained at the University of Cambridge and then worked in the NHS for several years. And I then uh in 2018 moved into the kind of AI space uh trading and building models and working with various organizations including Tandem uh which is the largest um clinical AI product provider in the in the UK in terms of adoption. >> [snorts] >> Uh also Anterior. I was the firs…