top of page

Josh Reini - Donut Kill My Vibe: Enriching RAG with Apache Iceberg™ for Sweet, Structured Retrieval



Josh is a developer advocate at Snowflake for AI and open source. He is also a maintainer of open-source TruLens, a library to systematically track and evaluate LLM based applications.


Josh has delivered tech talks, workshops and courses to thousands of developers at events like AI DevWorld


Donut Kill My Vibe: Enriching RAG with Apache Iceberg™ for Sweet, Structured Retrieval


Unstructured text powers most Retrieval-Augmented Generation (RAG) systems. But when users want something specific, structure matters. See how Apache Iceberg™ can add high-performance, queryable structure to a RAG stack, enabling more accurate, personalized, and grounded responses.


Enter: DonutBot, an AI assistant that maps free-form donut orders—“something sweet and seasonal with sprinkles, <400 calories”—to real items. DonutBot combines semantic vector search over product descriptions with structured filters from Iceberg tables that serve as the donut metadata source of truth. This powers hybrid search that blends fuzzy LLM reasoning with precise constraints. We then use TruLens to evaluate the system, showing gains in groundedness and context relevance, yielding fewer hallucinations and better, data-backed recommendations.


Whether you're building AI for snacks or enterprise search, this talk shows how Iceberg brings structured intelligence to your RAG stack—one donut at a time.



Comments


bottom of page