PromptisePromptise
Docs
GitHub
Promptise - AI Framework LogoPromptise

The foundation layer for agentic intelligence. Build, secure and operate autonomous AI systems with Promptise Foundry.

pip install promptise

[01] Foundry

  • MCPcast
  • The Promptise Agent
  • Reasoning Engine
  • MCP
  • Agent Runtime
  • Prompt Engineering
  • Execution Engine
  • Agent Identity

[02] Resources

  • Documentation
  • GitHub
  • Guides
  • Learning Paths
  • Questions

[03] Company

  • About
  • Terms of Service
  • Privacy Policy
  • Cookie Policy
  • Subprocessors

© 2026 Promptise by Manser Ventures. All rights reserved.

Open source · Python

← Guides> Topic

Models and providers

An agent's model decides how well it picks tools, follows instructions and handles long tasks, and the provider decides cost, latency, data handling and where it runs. Most teams try more than one: a strong hosted model for hard tasks, a cheaper or local one for simple ones, and a fallback when a provider is down.

These guides start with how to choose a model for tool calling and when to route between small and large models. Then they show how to run the same Promptise agent, with the same MCP tools, on each major provider: Anthropic Claude, Google Gemini, Azure OpenAI, OpenRouter and local models through Ollama. Each covers setup, the provider's quirks with tool calling, and a troubleshooting table, so switching providers is a one-line change.

[n.01/02]> 8 guides, in order
  1. 01Best LLM for AI Agents: Test and Switch Models in PythonFind the best LLM for your AI agent with a tool-calling eval, then switch between OpenAI, Anthropic, Azure, Bedrock, Gemini and Ollama in one line.Intermediate · 22 minOct 11, 2026
  2. 02LLM Routing: When to Use a Small vs Large ModelLLM routing explained: rules, LLM routers, learned routers and cascades to send each request to the cheapest model that works. A real router misroute.Intermediate · 7 minOct 18, 2026
  3. 03Claude AI Agent with MCP: Use Anthropic Models in PromptiseBuild a Claude AI agent with MCP tools: set the Anthropic key and model id, use effort instead of temperature, add prompt caching, and fix common errors.Beginner · 11 minOct 18, 2026
  4. 04Gemini AI Agent with MCP: Use Google Models in PromptiseBuild a Gemini AI agent with MCP tools: get an AI Studio key, pick a current model id, set reasoning effort, use Vertex AI on Google Cloud, fix errors.Beginner · 11 minOct 18, 2026
  5. 05Azure OpenAI Agent with MCP: Use Deployments in PromptiseBuild an Azure OpenAI agent with MCP tools: deployment vs model name, endpoint, API version or the v1 API, Entra ID sign-in, and fixes for common errors.Beginner · 12 minOct 18, 2026
  6. 06OpenRouter AI Agent with MCP: Many Models in PromptiseBuild an OpenRouter AI agent with MCP tools: one key for many models, route only to providers that support tools, add attribution headers, and fix errors.Beginner · 11 minOct 18, 2026
  7. 07Ollama AI Agent with MCP: Run Local Models in PromptiseRun an AI agent on a local Ollama model with MCP tools: pick a tool-calling model, set the context length, reach a remote Ollama, and fix common errors.Beginner · 11 minOct 18, 2026
  8. 08LLM Semantic Cache and Model Fallback in PythonReduce LLM API costs with a semantic cache and survive provider outages with model fallback. Real hits, tokens and a simulated outage, in Python.Intermediate · 23 minOct 11, 2026
[n.02/02]> go further

In the documentation

  • Models and providersdocs ↗
  • Model setupdocs ↗
  • Fallback chainsdocs ↗

Other topics

  • Building AI agents in Python→
  • Tools and the Model Context Protocol (MCP)→
  • Memory, context and RAG→
  • Agent reasoning patterns→
  • Multi-agent systems→
  • Guardrails and security→
  • Human approvals (human-in-the-loop)→
  • Observability and debugging→
  • Cost control and rate limits→
  • Testing and evals→
  • Runtime, triggers and deployment→
  • Frameworks and comparisons→

Build it with Promptise Foundry.

The code in these guides runs on Promptise Foundry, an open-source Python framework for AI agents and MCP servers.

QuickstartAll guides