Connecting the Dots with Context Graphs — Stephen Chin, Neo4j
Summary
Context graphs—combining knowledge graphs with LLMs—are officially recognized by Gartner as critical AI infrastructure, addressing the $3 trillion startup opportunity by connecting siloed enterprise data to give AI agents the grounded context needed for accurate business decisions instead of generic responses.
Key Takeaways
- Knowledge graphs solve the 'generic answer problem' in LLMs by providing grounded context—a healthcare example showed graph-powered RAG recommending specific treatments (medication management, smoking cessation) versus vector-only RAG giving generic advice (respiratory therapy).
- Context graphs combine LLM strengths (language, reasoning, creativity) with knowledge graph strengths (context, enrichment, relationship mapping) to enable similarity searches, pattern detection, and data visualization across enterprise systems.
- The 'blue pill vs red pill' framework: choose between siloed data (Slack, disparate systems unable to give good answers) or connected enterprise systems with decision traces and tool call reasoning that escape the knowledge isolation matrix.
- Memory architecture for agentic systems requires three layers—short-term (current conversation/pipeline state), long-term (historical data), and reasoning memory—stored in graphs to build complete decision history that agents can reason over.
- Gartner officially added context graphs to the AI hype cycle; Foundation Capital identified context graphs as core to a $3 trillion startup opportunity, signaling institutional validation of knowledge graphs as essential AI infrastructure.
Topics
- Context Graphs
- Knowledge Graphs RAG
- Agentic Memory Architecture
- Graph-Powered Retrieval Augmented Generation
- Enterprise Knowledge Integration
Transcript Excerpt
Hello and welcome everybody to connecting the dots with context graphs. My name is Stephen Chin. I run the developer relations team at Neo4j and you are in store for the power hour of context and graphs and all of this technology. So I'm the first speaker. We have some other amazing talks after me. So I hope you enjoy all the great content which you're going to see over the next um hour or so. So what I'm going to talk about is a bit about how we've all been feeling with the AI revolution where we are trapped as engineers. We are using AI coding tools or or maybe they're using us. Where our work is being reviewed. Who Who here has their work reviewed by an agent when they check in their PRs? Yes. All of you. So we are we're stuck in this limbo where we have amazing tools, we have amazing c…