Agentic systems unlock capabilities that traditional “deterministic” applications simply can’t deliver. But there’s a catch: their probabilistic nature introduces real and often unexpected risks—hallucinations, context drift, prompt degradation, and multi-step workflows that evolve in surprising ways. And you definitely don’t want to discover those in production.

The good news: there is a remedy. We can borrow the most reliable practice from deterministic software—test-driven development—and adapt it to the agentic world. The result is Eval-Driven Development (EDD): a systematic, engineering-first approach to bringing reliability into inherently probabilistic systems.

In this talk, we explore Eval-Driven Agentic Development and how it can transform your agents from unpredictable to reliable - using the (only?) full-fledged Kotlin Eval framework: Dokimos. We’ll dive into techniques, tools, and patterns needed to make evals a first-class citizen of your development process—demonstrating all of these in a real-world application built with AI frameworks like Spring-AI, LanchChain4J, and Koog.

Along the way, you will learn how to:

• Design layered eval suites
• Create golden datasets
• Define rubrics and scoring criteria
• Extract eval signals from agent traces
• Use regression gates to detect degraded behavior after changes
• Build a continuous eval loop

Evaluation-Driven Development is the only path forward for reliable, smart next-generation applications. Let’s learn how to walk it - together!

Urs is a seasoned software engineer, solution architect, conference speaker, and trainer with over 20 years of experience building resilient, scalable, and mission-critical systems, primarily in Kotlin, Scala, and Java.

Besides his job as a consultant, he is also a passionate trainer and author of a wide range of courses, including language courses for Kotlin and Scala, generative AI courses for the JVM platform, architectural trainings on Microservices and Event-Driven Architectures, and recently Agentic Coding.

As a people person by nature, he loves to share knowledge, inspire, and be inspired by peers at meetups and conferences. Urs is a JetBrains-certified Kotlin trainer.