Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

206tools listed

Pricing mix

  • 102 Free
  • 85 Freemium
  • 19 Paid

85 tools match

  • Allen Institute for AI

    www.allenai.org

    Open AI models, scientific discovery tools, environmental modeling, and embodied AI research.

    Freemium
  • Aizzy

    www.aizzy.ai

    A privacy-first web interface for routing paid AI models, browsing in Ghost Mode, and keeping chats on-device.

    Freemium
  • AIToolBox.org

    www.aitoolbox.org

    AI tools for business image and text generation, customization, and hosting.

    Freemium
  • Coasty

    www.coasty.ai

    Computer-use environments, agent trajectories and outcome evaluation for frontier-model research.

    Freemium
  • ZeroShot

    www.tryzeroshot.com

    Coding-agent session monitoring with reusable skills, session handoffs, and convention-based PR reviews.

    Freemium
  • Open WebUI

    www.openwebui.com

    A self-hosted AI interface for local and cloud models, Python extensions, and community tools.

    Freemium
  • Muapi

    www.muapi.ai

    Generate AI images and videos in a web studio, or access generative-media models through a unified API.

    Freemium
  • Langtail

    www.langtale.ai

    Collaborative prompt management, testing, deployment, and AI security for product teams.

    Freemium
  • Hillock

    www.github.com

    Local neuro-symbolic memory for offline AI, with verified fact retrieval and an OpenAI-compatible API.

    Freemium
  • Meilisearch

    www.github.com

    Meilisearch provides full-text, semantic, and hybrid search through an API, with managed and self-hosted deployment.

    Freemium
  • Monty

    www.github.com

    Rust-based Python sandbox for running AI-generated code with controlled access to host functions and mounts.

    Freemium
  • claude-supermemory

    www.github.com

    Persistent memory for Claude Code with automatic recall, conversation capture, and shared repository context.

    Freemium
  • OpenViking

    www.github.com

    Open-source context database that organizes AI agent knowledge, memory, and skills in a virtual filesystem.

    Freemium
  • Hindsight

    www.github.com

    Open-source agent memory with retain, recall and reflect tools, self-hosted deployment and managed cloud access.

    Freemium
  • Crawl4AI

    www.github.com

    Open-source web crawling and extraction for AI, with Python, Docker, CLI and hosted API access.

    Freemium
  • SigNoz

    www.github.com

    OpenTelemetry-native observability for logs, metrics, traces, infrastructure, and AI applications.

    Freemium
  • Olostep Web Data API

    www.olostep.com

    Web scraping, crawling, search and monitoring API for engineering teams building AI applications.

    Freemium
  • ZenMux

    www.zenmux.ai

    Unified AI model gateway with API access, automatic routing, usage analytics, and output compensation.

    Freemium
  • ChatBetter

    www.chatbetter.com

    Multi-model AI research focused on task routing, source-grounded responses, and automated output evaluation.

    Freemium
  • Privatemode AI

    www.privatemode.ai

    Confidential AI chat, coding, and API access with encryption that protects data during processing.

    Freemium
  • Scoopika

    www.scoopika.com

    Open-source toolkit for building multimodal AI agents and LLM-powered web applications.

    Freemium
  • AIProxy

    www.aiproxy.pro

    Secure AI API keys, monitor requests, and control usage in Swift apps.

    Freemium
  • Prem AI

    www.premai.io

    Prem AI provides private enterprise agents and encrypted GPU infrastructure for sovereign AI.

    Freemium
  • Align AI

    www.tryalign.ai

    Analytics for LLM chatbots, with conversation monitoring, cohort analysis and auto-generated action items.

    Freemium
  • Confident AI

    www.confident-ai.com

    LLM evaluation, production monitoring, and expert annotation in a shared AI quality workspace.

    Freemium
  • Anthropic

    www.anthropic.com

    AI research and Claude models for summarization, browser use, agentic coding, and knowledge work.

    Freemium
  • Hugging Face

    www.huggingface.co

    Discover, host and collaborate on machine learning models, datasets and applications.

    Freemium
  • TrueFoundry AI Gateway

    www.truefoundry.com

    Unified model access, routing, monitoring, and governance for enterprise AI applications.

    Freemium
  • BloombergGPT

    www.gpt3demo.com

    BloombergGPT is a finance-focused large language model trained to support financial natural language processing tasks.

    Freemium
  • Babel Cloud

    www.babel.cloud

    An AI lab presenting personal assistance, investment research, and environments for agent development.

    Freemium
  • Modal

    www.modal.com

    Serverless cloud infrastructure for AI inference, model training, agent sandboxes, and compute-heavy applications.

    Freemium
  • CopilotKit Intelligence

    www.copilotkit.ai

    Build in-app AI agents with generative UI, shared state, automatic learning, and product analytics.

    Freemium
  • Dataloop

    www.dataloop.ai

    AI data infrastructure for unstructured data, multimodal pipelines, model deployment, and human feedback.

    Freemium
  • Layerbrain

    www.layerbrain.com

    Computer World Models designed to generate, perceive, and interact with working software entirely from pixels.

    Freemium
  • Unified AI development, training, and inference across a global network of GPU cloud providers.

    Freemium
  • Deepgram ASR

    www.deepgram.com

    Speech-to-text APIs, text-to-speech, and voice agents for real-time voice applications.

    Freemium