ADaSci Academy

    Debugging Non-Deterministic Agentic Systems

    Modern AI agents fail silently. This course teaches you how to instrument, trace, and monitor agentic systems using distributed telemetry, structured tracing, and AI-native evaluation tools. Move beyond logs and build ob…

    7,581+ enrolled
    3 hours
    Intermediate
    Debugging Non-Deterministic Agentic Systems
    01 — Overview

    About this course

    Modern AI agents fail silently. This course teaches you how to instrument, trace, and monitor agentic systems using distributed telemetry, structured tracing, and AI-native evaluation tools. Move beyond logs and build observable, debuggable, production-ready AI systems with real-world demonstrations.

    02 — Outcomes

    What you'll learn

    ✓
    Why traditional debugging fails for agentic systems
    ✓
    How to instrument LLM agents with structured telemetry
    ✓
    Designing trace pipelines using OpenTelemetry & Prometheus
    ✓
    Debugging silent failures like hallucinations and infinite replans
    ✓
    Using LangSmith for live tracing, evaluation, and reasoning inspection
    03 — Curriculum

    Course content

    4 sections · 10 lectures

    Why Logs Fail When Agents Start Thinking
    42m
    Why Logs Fail When Agents Start Thinking - Slide Deck (PDF)
    0
    Autogen Demo Code
    0
    Designing Observability for Agentic Systems
    37m
    Designing Observability for Agentic Systems - Slide Deck (PDF)
    0
    Open Telemetry Code File
    0
    Prometheus Code File
    0
    Tracing and Evaluating Agent Behavior in Practice
    21m
    Langsmith Code File
    0
    Feedback and Continuous Improvement
    0
    04 — Prerequisites

    Requirements

    • Basic understanding of Python
    • Familiarity with LLMs (OpenAI / LangChain basics)
    • Understanding of APIs and system architecture
    • Interest in AI engineering or production AI systems
    05 — Audience

    Who should take this course

    • AI Engineers building LLM applications Backend / Platform
    • Engineers moving into AI systems
    • MLOps / Observability Engineers
    • Technical Architects designing agentic workflows
    • Developers deploying RAG or multi-agent systems

    Save 50% with Membership

    Get unlimited access to all courses and exclusive member discounts on certifications.

    50% off all courses30% off certificationsExclusive content
    Debugging Non-Deterministic Agentic Systems

    $49.00

    Member Pricing

    FREE with Premium

    50% off with General

    Duration3h
    LevelIntermediate

    $49.00