AI Agents
LangSmith is an AI agent and LLM observability platform providing complete visibility into agent behavior. It helps debug agents, identify failures, and track costs and latency.…
Best AI Tools for Monitoring AI models
210 toolsDiscover the best AI tools for Monitoring AI models — from AI Agent Observability and AI Platforms to AI Frameworks, AI Learning, and AI Safety Indexes, this is where data scientists and AI engineers find resources that streamline their workflow: tracking model performance, ensuring compliance, debugging AI behavior, and optimizing model efficiency. Browse 210 AI Tools for Monitoring AI models across AI Apps, AI GitHub Repos, AI Learning, AI Platforms and AI Frameworks and more.
210 tools
AI Agents
Langfuse is an open-source LLM engineering platform designed to help developers build, monitor, and improve AI applications. It offers tracing, prompt management, evaluation, and…
AI Frameworks
Azure Machine Learning provides comprehensive tools to train and deploy machine learning models. It offers quickstarts, tutorials, and MLOps best practices for managing the entire…
AI Platforms
Microsoft Foundry is an AI app and agent factory that accelerates AI-driven, cloud-native development across various industries, enabling organizations to build and scale…
AI Frameworks
MLflow provides comprehensive documentation for both traditional machine learning workflows and modern LLM/agent development. It covers experiment tracking, model registry,…
AI Agents
Braintrust is an AI observability platform designed for building quality AI products. It helps teams trace production, run evaluations, and catch regressions before they impact…
AI Platforms
NVIDIA AI Enterprise is a powerful AI platform that leverages NVIDIA's GPU technology to drive advancements in artificial intelligence, high-performance computing, and more. It is…
AI Agents
LangChain is an AI agent engineering platform that enables developers to build, test, and deploy reliable AI agents. It offers tools for observation, evaluation, and deployment,…
AI Frameworks
Kubeflow documentation provides comprehensive resources for understanding and utilizing the Kubeflow platform. It covers getting started guides, details on subprojects, community…
AI Trend Reports
The AI Safety Index evaluates leading AI companies on safety and security domains. It provides insights into their compliance with safety standards and regulatory frameworks,…
AI Platforms
Clarifai is a leading AI platform for compute orchestration, designed for scale and speed. It streamlines complex AI tasks by dynamically managing compute resources, enabling…
AI Frameworks
Comet's ML platform empowers data science and machine learning teams to track, compare, explain, and optimize models throughout the entire ML lifecycle. It streamlines experiment…
The IBM AI Engineering Professional Certificate on Coursera equips learners with essential AI engineering skills and practical experience. This online program prepares you for…
AI Models
Mistral Large 3 is a state-of-the-art AI model designed for enterprises, enabling customization, fine-tuning, and deployment of AI assistants and agents. It features a sparse…
AI Apps
An open-source AI agent observability and monitoring platform that traces agents in production, surfaces failures, and dispatches coding agents to fix them automatically.
AI Platforms
Mistral AI Studio is an AI production platform that enables users to build, deploy, and govern agentic AI systems while ensuring enterprise privacy and full data ownership. It…
AI GitHub Repos
unslothai/unsloth is a local user interface designed to run and train large language models (LLMs) and diffusion models. It supports various models including Qwen3.8, Kimi K3,…
HoneyHive provides an observability layer for production AI agents, unifying monitoring and evaluation. It enables continuous improvement loops, allowing teams to confidently ship…
AI Apps
LangWatch is an AI agent testing, LLM evaluation, and observability platform. It allows developers to simulate real-world scenarios, prevent regressions, and debug issues by…
AI Frameworks
scikit-learn is an open-source machine learning framework for Python, providing simple and efficient tools for predictive data analysis. It is accessible to everyone and reusable…
AI Platforms
Nebius offers a purpose-built AI cloud designed for rapid scaling and deployment. With custom hardware and built-in MLOps tooling, it provides a reliable infrastructure for AI…
AI Hugging Face
BAAI/bge-small-en-v1.5 is a small-scale embedding model designed for retrieval-augmented language model tasks. It offers competitive performance in various natural language…
Factory provides AI coding agents that automate coding, testing, and deployment processes for startups and enterprises. This platform enhances software development efficiency,…
MLflow is an open-source AI platform designed for agents, LLMs, and ML models. It enables teams to debug, evaluate, monitor, and optimize AI applications efficiently, making it…
AI Learning
Agentic AI MOOC offers a comprehensive course on intelligent task automation and personalization, featuring expert instructors and guest speakers. Students will explore…
AI Hugging Face
ControlNet-v1-1 is an AI model hosted on Hugging Face designed to advance artificial intelligence through open-source collaboration. It aims to provide tools for developers and…
AI Learning
MLOps Zoomcamp is a free online course offered by DataTalks.Club, designed to teach the principles and practices of MLOps. Participants can register to receive notifications about…
AI Learning
Made With ML is a platform designed to help developers learn how to responsibly design, develop, deploy, and iterate on production machine learning applications. Join a community…
Instructor is a multi-language library designed for extracting structured, validated data from large language models (LLMs). It supports over 15 providers and offers features like…
AI Platforms
Comet is the creator of Opik, an end-to-end AI observability platform designed for developers. It offers advanced agent testing, optimization, and monitoring capabilities to…
AI YouTube Channels
Sam Witteveen is a YouTube channel focused on AI, deep learning, and machine learning. With over 11 years of experience, Sam shares insights on Transformers, LLMs, and autonomous…
AI Platforms
ZenML is a unified layer for machine learning and AI, enabling reproducible ML pipelines and agent evaluations. It integrates seamlessly with existing infrastructure, allowing…
AI Platforms
Vast.ai offers high-performance cloud GPUs for rent at low costs. Ideal for AI, machine learning, deep learning, and rendering, it provides flexible pricing, fast setup, and…
AI Platforms
Cerebrium offers serverless GPU infrastructure for real-time AI, enabling sub-second cold starts for voice agents, video models, and LLMs. It provides instant autoscaling,…
AI Learning
Machine Learning Zoomcamp offers a comprehensive, free four-month program designed to teach ML engineering. Participants can register to gain essential skills and knowledge in…
AI Platforms
Union.ai is an AI runtime that operates within your cloud infrastructure, ensuring data privacy. It orchestrates durable AI workflows, real-time applications, and optimizes…
Vega's cyber defense platform leverages the Claude API to enhance threat investigations, achieving 44x faster results while reducing costs by 82%. This case study highlights how…
Teammately is an AI Agent designed for AI Engineers to build reliable AI services. It automates and accelerates AI development by generating prompts, refining AI models, and…
Arize AI offers a unified platform for LLM observability and agent evaluation, designed to improve AI applications from development to production. It provides tools for agent…
AI Agents
Run.ai is a platform that provides AI agents for various applications. It aims to streamline AI development and deployment by offering tools and infrastructure to manage and scale…
AI Agents
CRAB is a comprehensive benchmark framework for evaluating multimodal language model agents. It offers cross-environment support, a graph evaluator, and automated task generation,…
AI Apps
UsageGuard is an enterprise-ready AI development observability platform. It provides a unified API for accessing multiple AI models, offering built-in safeguards, moderation, cost…
AI Apps
Perpetual ML offers a unified, batteries-included ML studio for solo developers and data science teams. It provides tools for auto-training, continual learning, optimal business…
AI Apps
Meteron AI offers an all-in-one toolset for growing AI businesses, handling LLM and generative AI metering, load-balancing, and storage. It frees developers from complex…
AI Apps
Coxwave Align is an analytics engine for Generative AI products, enabling organizations to monitor, analyze, and evaluate LLM-based conversational data. It helps identify…
AI Apps
Hamming AI offers a comprehensive platform for enterprise voice and chat agent QA and production monitoring. It automates scenario generation, replays production calls, and…
AI Apps
EvalsOne was a platform designed for the effortless evaluation of generative AI applications. It provided tools and features to help users assess and understand the performance of…
AI Apps
ClearML's GenAI App Engine accelerates GenAI adoption by enabling one-click LLM deployment, compute cost optimization, and AI performance monitoring within a secure, scalable…
Orq.ai is a generative AI collaboration platform designed to help teams build, ship, and scale AI applications efficiently and securely. It provides a unified environment for…
AI Apps
Langtrace is an open-source observability and evaluation platform designed to help developers transform AI prototypes into enterprise-grade products. It provides insights into AI…
AI Apps
OpenLIT is an open-source platform for AI engineering, providing observability for GenAI and LLM applications. It offers tracing, evaluation, and prompt management, built on…
AI Apps
Klu.ai empowers teams to design, deploy, and optimize Large Language Model (LLM) applications. It offers collaborative prompt design, evaluation workflows, and observability tools…
AI Agents
Coval provides a simulation and evaluation platform for AI voice and chat agents. It helps teams test, monitor, and optimize their AI agents at scale, catching millions of edge…
Cekura provides automated end-to-end testing and observability for conversational AI agents. It simulates pre-production scenarios with diverse personas and monitors live…
AI Apps
VERN OS is an AI governance system that enhances conversational AI by detecting emotional signals and applying behavioral policies in real-time. It ensures AI responses are safer,…
AI Apps
Cyara offers Agentic AI for CX assurance and testing, enabling enterprises to confidently deploy AI agents at scale. It detects hallucinations, validates decisions, and ensures…
AI Apps
SelfMachines offers an ultimate AI development platform focused on observability, interpretability, and hyper-productivity. Its drag-and-drop environment simplifies AI deployment…
AI Apps
Deployo transforms AI models into production-ready applications with an intuitive, cloud-agnostic, and secure infrastructure. It streamlines machine learning workflows, enabling…
AI Apps
Elixir Observability is an AI Ops & QA platform designed for multimodal, audio-first conversational AI agents. It provides automated testing, call review, monitoring, analytics,…
AI Apps
mpathic AI offers a human-centered AI safety platform that analyzes conversational and contextual data. It helps AI builders evaluate, stress-test, and improve human-facing models…
AI Apps
Remyx AI provides decision intelligence for AI teams, helping them determine what to ship next. It analyzes evaluations, experiments, and production outcomes to recommend the most…
AI Apps
Metaflow is an open-source framework designed for building and managing real-life machine learning, AI, and data science projects. It simplifies development, versioning, and…
AI Apps
Robovision provides industrial vision intelligence infrastructure to monitor, control, and standardize vision systems. It ensures outcome assurance as operations scale by reducing…
AI Platforms
Wallaroo.ai is an AI platform that provides tools for deploying, managing, and monitoring machine learning models. It aims to simplify the MLOps lifecycle, enabling teams to bring…
AI Platforms
Seldon Core is an MLOps and LLMOps framework for deploying, managing, and scaling AI systems on Kubernetes. It enables standardized deployment of various model types across…
AI Platforms
SUPERWISE AMP is an Agentic Management Platform for regulated industries, offering complete visibility, real-time guardrails, and policy enforcement. It enables businesses to…
AI Platforms
DKube empowers enterprises to deploy secure, production-ready private AI systems. It enables building AI solutions across on-prem and hybrid environments, ensuring full control,…
AI Platforms
DataRobot Product Documentation provides comprehensive resources for its end-to-end AI platform. Access detailed guides, tutorials, and API documentation for both code-first and…
AI Frameworks
Weights & Biases offers a platform for developing AI models and shipping LLM applications. It provides experiment tracking, evaluation, and observability tools, alongside managed…
AI Frameworks
SHAP (SHapley Additive exPlanations) is a game theoretic approach to explain machine learning model outputs. It connects optimal credit allocation with local explanations using…
LIME is a Python package for generating local, interpretable, and model-agnostic explanations of machine learning model predictions. It helps understand why a model makes a…
AI Frameworks
AI Fairness 360 (AIF360) is an open-source toolkit designed to help researchers and developers detect, understand, and mitigate unwanted bias in machine learning models. It…
AI Frameworks
Fairlearn is an open-source toolkit designed to assess and improve the fairness of AI systems. It provides tools for identifying and mitigating unfairness in machine learning…
AI Frameworks
TensorFlow Extended (TFX) is a Google-production-scale machine learning platform. It provides a configuration framework and shared libraries to integrate common components for…
AI Frameworks
DeepDetect is an AI framework designed for deep learning model deployment and management. It simplifies the process of serving machine learning models, enabling developers to…
AI Frameworks
Cortex provides production infrastructure for machine learning at scale, enabling the deployment, management, and scaling of ML models. It supports serverless, real-time,…
AI Frameworks
Seldon Core 2 is a Kubernetes-native framework for deploying and managing ML and LLM systems at scale. It offers a flexible, modular architecture for on-premise, hybrid, and…
AI Communities
Flyte is an open-source workflow orchestration platform. This community resource hub offers access to events, case studies, blogs, and documentation. Connect with AI and ML…
AI Agents
Enkrypt AI offers a comprehensive platform for AI security and safety, detecting threats, removing vulnerabilities, and monitoring performance. It helps businesses accelerate AI…
AI Agents
Monitaur provides actionable AI governance software for the entire AI lifecycle. It helps organizations define, manage, and automate AI validation to ensure fairness, accuracy,…
AI Agents
AgentOps provides a platform for tracing, debugging, and deploying reliable AI agents. It offers session replay, time travel debugging, and a full data trail of logs and errors,…
AI Agents
Wayfound provides AI agent supervision for business users, enabling enterprise-wide performance monitoring and risk reduction. It ensures AI agents align with goals and policies,…
AI Apps
Cleanlab empowers teams to build safer AI agents by detecting and remediating incorrect responses before they reach users. It ensures AI outputs meet standards for safety,…
AI Apps
GreenNode offers a sovereign, high-performance AI cloud infrastructure designed for Southeast Asia. It ensures data residency within Vietnam and Thailand, providing secure,…
AI Apps
Zenbase is a developer-focused platform that simplifies the creation and deployment of AI applications. It provides tools and infrastructure to help developers build, test, and…
DataRobot's Enterprise AI Suite empowers teams to develop, deliver, and govern AI solutions. It unifies data scientists, developers, and IT professionals with role-tailored tools…
Dynamiq is an operating platform for building, deploying, and monitoring on-premise Generative AI applications. It streamlines development with rapid prototyping, testing,…
AI Apps
PostgresML integrates machine learning and AI capabilities directly into your PostgreSQL database. It simplifies building AI applications by allowing you to index, filter, and…
AI Apps
Raindrop is an observability and monitoring platform for AI agents that captures every production run, automatically detects silent failures like hallucinations and loops, and…
AI Apps
Middleware is a full-stack, OpenTelemetry-native observability platform whose AI SRE agent, OpsAI, detects, diagnoses, and helps resolve production issues across infrastructure,…
AI Apps
Phare is a European uptime monitoring and incident management platform that combines website and API monitoring, alerts, AI-assisted incidents, analytics, and status pages in one…
AI Apps
HookWatch is a webhook debugging, monitoring, and recovery platform that captures every delivery, shows the exact request and failure reason, groups repeated failures into…
AI Apps
TraceRoot is an open-source observability and self-improving layer for AI agents that detects production failures, root-causes them against your source code and GitHub history,…
AI Apps
Currai is AI agent monitoring and product analytics for chat and voice agents that turns real conversations into intents, user stories, policy violations, and errors, catching…
AI Apps
Olivares AI is a self-hosted, vendor-neutral platform to integrate, manage, and secure the AI agents, models, and MCP servers running on your own infrastructure across Claude,…
AI Apps
Chirpz AI is an applied AI lab focused on agent engineering. Its product, PandaProbe, is an open-source platform for tracing, evaluating, and monitoring AI agents so teams can…
AI Apps
An open-source, OpenAI-compatible API gateway that routes requests across 200+ models from 40+ providers through one endpoint, with real-time cost and latency analytics, caching,…
abliteration.ai offers an OpenAI-compatible unrestricted AI API and Policy Gateway for enterprise teams. It enables AI red teaming, cybersecurity, and ML research while enforcing…
AI Apps
ApiFlux is an AI router that connects to multiple models like Claude, GPT, and Gemini using a single API key. It offers automatic failover, transparent pricing, and is designed…
AI Apps
Kaopu API is a unified AI API gateway and admin dashboard that provides access to a wide range of AI models. It is designed for developers, offering features like one-click…
AI Apps
OnAPI is a unified AI API gateway and admin dashboard that simplifies the integration and management of various AI models. It provides a streamlined interface for developers to…
AI Apps
EvalCore provides snapshot testing for AI behavior, allowing you to record how your LLM app behaves and replay it in CI on every change. It ensures that any modifications do not…
AI Apps
Aurikо is an AI control plane for LLM inference, offering a model gateway, intelligent routing, observability, and FinOps in a single platform. It enables users to optimize costs…
RunInfra is a chat-native AI model optimization platform that benchmarks GPUs, optimizes kernels, and deploys production APIs. It allows teams to build and deploy AI applications…
OpenAI Compatible AI API Gateway provides unified access to over 50 AI models, enabling teams to efficiently manage multi-model routing, failover, and billing. Migration is quick,…
AI Apps
Spanly is an observability platform designed for Model Context Protocol (MCP) servers. It enables SaaS engineering teams to monitor and debug their MCP servers in real-time,…
Dedoctive is a neuro-symbolic AI platform that provides auditable AI for defensible decisions. It grounds outputs in trusted evidence and source-level provenance, ensuring…
AI Apps
CodeGateway is a jurisdiction-aware multi-model AI Gateway that aggregates Claude, GPT, and Gemini. It offers smart routing, usage analytics, and cost optimization, built on the…
AI Apps
OfoxAI offers access to over 100 AI models, including GPT-5.5, Claude Opus 4.8, and Gemini 3.5 Flash, through a single API. It provides real-time pricing and is compatible with…
2KEN provides a unified AI API gateway with a single API key for various AI models like GPT, Claude, and Gemini. It offers lower costs, stable routing, and usage insights, making…
AI Apps
Reka AI develops multimodal models for video, image, audio, and text, catering to enterprises in security, media, and defense. The platform emphasizes efficiency and offers…
AI Platforms
Labelbox is an AI platform that provides data solutions for AI teams, enabling them to build, evaluate, and deploy models efficiently. It offers a comprehensive data engine for…
AI Apps
Opik is an open-source AI observability platform that assists developers in testing, shipping, and continuously improving agentic systems. It provides tools for evaluating and…
Portkey is a comprehensive toolkit for developing, testing, and deploying production-ready prompts across 1600+ AI models. It enables teams to manage AI interactions efficiently,…
AI Apps
Arize Phoenix is an open-source AI development platform designed for agent development and evaluation. It provides tools for tracing, measuring, and improving AI agent quality,…
AI Apps
W&B Weave enhances observability for production agents, enabling them to learn and improve from real-world experiences. This tool helps maintain reliability and performance in AI…
AI Apps
Orq.ai is a comprehensive platform designed for building, deploying, and managing AI applications. It offers a secure environment for developing and monitoring generative AI…
AI Apps
Adaline is an observability and evals platform designed for self-improving AI agents. It transforms production traces into actionable behaviors, evaluations, synthetic datasets,…
AI Apps
Basalt captures customer behavior to enhance AI agents through automated learning from user interactions. It provides daily updates to improve agent performance based on real…
AI Apps
Supervisely is a comprehensive platform for annotating images, videos, and other datasets, enabling collaboration and training of neural networks. It offers advanced tools for…
Lightly's Computer Vision Suite enhances machine learning models by pretraining on your data and curating vision data for fine-tuning. It streamlines the process from data…
AI Apps
CVAT is a data annotation platform designed for vision AI, enabling teams to convert raw images, videos, and 3D data into model-ready datasets. It offers AI-assisted annotation,…
AI Apps
Dynatrace is an AI-powered observability platform that helps organizations innovate faster and operate more efficiently. It transforms complex digital ecosystems into powerful…
AI Apps
Harness is a unified AI software delivery platform designed to enhance DevOps, testing, application security, and cost optimization. It enables teams to ship code faster and more…
AI Apps
Discover Microsoft Azure Copilot, your AI companion for cloud management. It enhances operations with seamless migration, automated deployment, resource optimization, and…
Traversal is an AI SRE platform that triages alerts, identifies root causes, and resolves incidents at petabyte scale, enabling teams to fix issues in minutes. Trusted by major…
Cleric is an AI tool that prevents production incidents by verifying code changes under real traffic, investigating failures, and ensuring recovery. It helps teams uncover issues…
AI YouTube Channels
AI Engineer is a YouTube channel transforming high signal in-person events into free learning opportunities for AI professionals worldwide. It fosters a community of engineers,…
AI Models
Claude Fable 5 is a cutting-edge AI model designed for complex, long-running tasks in coding and knowledge work. It offers advanced capabilities with robust safeguards for…
AI Trend Reports
The State of AI Report 2025 is an independent annual publication analyzing AI research, industry trends, geopolitics, and safety. Authored by Nathan Benaich, it offers insights…
AI Apps
BuseyBench is a unique AI benchmark gallery that tests how various AI models generate SVG portraits of Gary Busey. It provides a visual, inspectable, and humorous way to evaluate…
AI YouTube Channels
LangChain's YouTube channel offers insights into building intelligent agents using their open, model-agnostic harnesses. With over 202,000 subscribers, it provides resources for…
AI YouTube Channels
AssemblyAI's YouTube channel offers insights into the latest AI innovations, tutorials, and educational content on Machine Learning and Deep Learning. Ideal for developers looking…
AI YouTube Channels
Andreas Kretz's YouTube channel focuses on Data Engineering and AI Engineering. It provides insights into modern data systems, tools, and architectures, offering practical…
AI YouTube Channels
Boston Dynamics' YouTube channel showcases their innovative robots designed to enrich lives. With engaging content on robots like Atlas, Spot, and Stretch, viewers can explore the…
AI Conferences
AI Con USA 2027 is a premier conference for AI and machine learning professionals, researchers, and enthusiasts. Held in Seattle and online, it offers a dynamic environment for…
AI Conferences
AI DevWorld 2027 is the largest AI and machine learning developer conference, co-located with DeveloperWeek. It takes place from February 9-11, 2027, in Santa Clara, CA, offering…
AI Conferences
Big Data & AI World London 2027 is a leading event for data and AI professionals. Held at Excel London, it offers insights into AI strategies, data governance, and model…
AI Conferences
The Gartner Data & Analytics Summit 2027 in Orlando is a premier conference for data and analytics leaders. It offers insights into AI-driven strategies, data management,…
AI Conferences
The AI Summit Australia 2027 is a premier event for AI adoption, offering insights into cutting-edge breakthroughs and real-world applications. It connects enterprise leaders with…
AI Conferences
MLDS 2027 is India's largest agentic AI conference for developers, held in Bengaluru and Hyderabad. It features over 100 speakers and 3,000 attendees, offering deep technical…
AI Conferences
AI World: Data Centers 2027 focuses on sustainable AI infrastructure, bringing together leaders in energy storage, power conversion, and thermal management. The event explores…
AI Conferences
Data Innovation Summit APAC 2027 is a leading event in data, AI, and advanced analytics. Held in Singapore, it brings together experts and innovators to discuss AI-driven…
AI Podcasts
Data Skeptic AI Podcast covers the latest news in artificial intelligence, from breakthroughs to industry leaders. Stay informed on AI developments with episodes updated daily,…
AI Podcasts
Beyond the Pilot: Enterprise AI in Action is a podcast where top business executives discuss the real-world applications of AI after the proof of concept stage. Presented by…
6 days ago
Agents of Dev Podcast explores the evolution of software development in the AI era. Hosted by Mitch Ashley and Brad Shimmin, it delves into industry trends, vendor strategies, and…
6 days ago
Agentic DevOps is a podcast exploring the intersection of AI Agents, LLMs, and MCP tools with DevOps and platform engineering. Hosted by Bret Fisher, it offers insights into using…
6 days ago
Robotics Industry Insider: AI & Automation News is a daily podcast offering the latest updates and insights in AI, robotics, and automation. Ideal for industry professionals and…
AI Podcasts
AI Safety Fundamentals is a podcast dedicated to exploring the critical aspects of artificial intelligence safety. It provides insights into the challenges and solutions in…
AI Influencers
Clement Delangue is the Co-founder and CEO of Hugging Face, a company focused on teaching computers to understand human language. He is an influential figure in the AI community,…
Built a better way of Monitoring AI models?
This page is where people come to find AI for Monitoring AI models. Listing is free and editor-reviewed — get your tool in front of the audience already searching for it.