PromptisePromptise
Docs
GitHub
Promptise - AI Framework LogoPromptise

The foundation layer for agentic intelligence. Build, secure and operate autonomous AI systems with Promptise Foundry.

pip install promptise

[01] Foundry

  • MCPcast
  • The Promptise Agent
  • Reasoning Engine
  • MCP
  • Agent Runtime
  • Prompt Engineering
  • Execution Engine
  • Agent Identity

[02] Resources

  • Documentation
  • GitHub
  • Guides
  • Learning Paths
  • Questions

[03] Company

  • About
  • Terms of Service
  • Privacy Policy
  • Cookie Policy
  • Subprocessors

© 2026 Promptise by Manser Ventures. All rights reserved.

Open source · Python

← Guides> Topic

Observability and debugging

When an agent gives a wrong answer, the cause is usually several steps back: a tool returned something unexpected, the model misread it, and every later step built on the mistake. Observability means recording each model call, tool call, input and output as a connected trace, so you can follow a run step by step instead of guessing from the final answer.

These guides start with tracing an agent's tool calls with OpenTelemetry-compatible spans. The next one uses those traces to diagnose a common failure, an agent that repeats the same step without making progress, and shows how to stop it. The last covers the server side: metrics, logs and health checks for the MCP servers your agents depend on.

[n.01/02]> 9 guides, in order
  1. 01AI Agent Observability: Trace Tool Calls, Tokens and CostTrace every LLM call and tool call your AI agent makes, with tokens, latency and cost, then use the trace to find the exact step that went wrong.Intermediate · 18 minOct 11, 2026
  2. 02AI Agent Stuck in a Loop? How to Detect and Stop ItWhy AI agents get stuck in loops and how to stop them: detect repeated tool calls, cap tool calls per run, and write tool results that end the loop.Intermediate · 18 minOct 18, 2026
  3. 03MCP Server Monitoring: Prometheus, OpenTelemetry and LogsMonitor an MCP server in Python: Prometheus metrics, JSON logs, OpenTelemetry traces and alerts that show which tools are slow, failing or abused.Intermediate · 20 minOct 11, 2026
  4. 04How to Run, Debug and Deploy an AI Agent in PythonRun, debug and deploy a Python AI agent project with one command: a package.json-style manifest, live traces, a terminal UI, JSON logs and an API.Beginner · 15 minOct 18, 2026
  5. 05AI Agent Cost Tracking: Tokens and Cost per Run and UserTrack AI agent token usage and cost per model call, run, user and agent: price tables, cost ledgers, alerts and limits. Runnable code with real output.Intermediate · 16 minOct 18, 2026
  6. 06AI Agent Production Checklist: What to Check Before LaunchAn AI agent production checklist: security, approvals, guardrails, limits, cost, observability, evals, deployment and incident response, with code.Intermediate · 17 minOct 18, 2026
  7. 07Are LLMs Black Boxes? What You Can and Can't InspectAre LLMs black boxes? Why model explanations can hide the real cause, and what you can inspect instead: context, tool calls, counterfactual tests.Intermediate · 5 minOct 18, 2026
  8. 08How to Evaluate AI Agents: Evals, LLM Judges and pass^kHow to evaluate AI agents: write golden and refusal tasks, grade tool calls in code, calibrate an LLM judge, measure pass^k and gate CI on the results.Intermediate · 20 minOct 18, 2026
  9. 09LLM Security Monitoring: Detect Attacks With Audit LogsMonitor LLM apps for attacks: what security events to log, which signals mean trouble, detection rules in Python, and alerting without alert fatigue.Intermediate · 10 minOct 18, 2026
[n.02/02]> go further

In the documentation

  • Observabilitydocs ↗
  • MCP server observabilitydocs ↗
  • Eventsdocs ↗

Other topics

  • Building AI agents in Python→
  • Models and providers→
  • Tools and the Model Context Protocol (MCP)→
  • Memory, context and RAG→
  • Agent reasoning patterns→
  • Multi-agent systems→
  • Guardrails and security→
  • Human approvals (human-in-the-loop)→
  • Cost control and rate limits→
  • Testing and evals→
  • Runtime, triggers and deployment→
  • Frameworks and comparisons→

Build it with Promptise Foundry.

The code in these guides runs on Promptise Foundry, an open-source Python framework for AI agents and MCP servers.

QuickstartAll guides