Back to Podcast Digest
AI Engineer20m

Why your agents need decision traces, not just documents — Zach Blumenfeld, Neo4j

TL;DR

  • Context graphs go beyond RAG — Zach frames the shift as moving from systems that answer questions correctly with customer data, transactions, and policies to systems that can recommend “accept or reject, and why” using past decision traces and precedents.

  • Graph embeddings make prior decisions searchable — Neo4j embeds not just text but connected decision-trace structures, so an agent can find similar past cases by semantic similarity and graph structure, which Zach says is hard to recover if everything stays buried in documents.

  • The financial-risk demo shows the payoff — In his example, the agent retrieves Jessica’s profile, pulls prior decision traces, runs a hybrid precedent search, and returns a reject recommendation with risk factors instead of a generic summary.

  • A new uvx create-context-graph tool bootstraps the whole stack — Zach shows a one-line command that scaffolds the frontend, backend, graph schema, demo data, and framework integration, with support for Pydantic AI, OpenAI, LangGraph, CrewAI, Strands, and Google ADK.

  • Neo4j’s memory model is three-part: short-term, long-term, and reasoning — The underlying neo4j-agent-memory package stores conversation history, extracted entities that persist over time, and the reasoning traces that make context graphs useful for agent decisions.

  • This is powerful but still early — Zach is candid that writing new decision traces, adding timestamps, and attaching quality or sentiment scores are still evolving parts of the project, even though the code and demos are already open source.

The Breakdown

Past decisions are often trapped inside documents, but Zach Blumenfeld argues agents need decision traces they can actually query — not just facts, but precedents, causal chains, and the “why” behind prior calls. He shows how Neo4j’s context graphs and a new one-line app generator turn that idea into something you can prototype today.

Was This Useful?

Share