OpenTelemetry-native observability for logs, metrics, traces, infrastructure, and AI applications.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Freemium
Open-source AI proxy for agent orchestration, LLM routing, guardrails, and OpenTelemetry observability.
FreeOpen-source language model modification for refusal suppression, shorter responses, and reduced sycophancy.
FreeOpen-source LLM reinforcement learning framework connecting Megatron training with SGLang rollout.
FreeOpen-source framework for foundation model training, data preparation, evaluation, and reproducible experiments.
FreeOpen-source KV cache management for reusable, persistent caching across LLM inference engines and storage backends.
FreeOpen-source incremental data engine that keeps context fresh for AI agents and LLM applications.
FreeOpen-source LLM inference and serving with PagedAttention, distributed execution and an OpenAI-compatible API.
FreeOpen-source framework for creating, customizing, and deploying speech recognition, text-to-speech, and speech LLMs.
FreeA free local plugin that sandboxes coding-agent tool output and retrieves relevant results through SQLite search.
FreeWeb scraping, crawling, search and monitoring API for engineering teams building AI applications.
FreemiumUnified AI model gateway with API access, automatic routing, usage analytics, and output compensation.
FreemiumMulti-model AI research focused on task routing, source-grounded responses, and automated output evaluation.
FreemiumConfidential AI chat, coding, and API access with encryption that protects data during processing.
FreemiumOpen-source toolkit for building multimodal AI agents and LLM-powered web applications.
FreemiumPrem AI provides private enterprise agents and encrypted GPU infrastructure for sovereign AI.
FreemiumAnalytics for LLM chatbots, with conversation monitoring, cohort analysis and auto-generated action items.
FreemiumLLM evaluation, production monitoring, and expert annotation in a shared AI quality workspace.
FreemiumEvaluate AI models on real workflows and track when new releases improve performance or cost.
PaidOpen-source AI gateway and Python SDK for calling LLM providers through a unified OpenAI-compatible interface.
FreeBuild and deploy AI agents that automate enterprise workflows across connected apps, data, and systems.
PaidAI research and Claude models for summarization, browser use, agentic coding, and knowledge work.
FreemiumDiscover, host and collaborate on machine learning models, datasets and applications.
FreemiumCompany-wide AI chat, agents, workflows and governance with access to multiple AI models.
PaidUnified model access, routing, monitoring, and governance for enterprise AI applications.
FreemiumBloombergGPT is a finance-focused large language model trained to support financial natural language processing tasks.
FreemiumAn AI lab presenting personal assistance, investment research, and environments for agent development.
FreemiumServerless cloud infrastructure for AI inference, model training, agent sandboxes, and compute-heavy applications.
FreemiumBuild in-app AI agents with generative UI, shared state, automatic learning, and product analytics.
FreemiumAI data infrastructure for unstructured data, multimodal pipelines, model deployment, and human feedback.
FreemiumComputer World Models designed to generate, perceive, and interact with working software entirely from pixels.
FreemiumUnified AI development, training, and inference across a global network of GPU cloud providers.
Freemium



































