Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

206tools listed

Pricing mix

  • 102 Free
  • 85 Freemium
  • 19 Paid

104 tools match

  • Securiti

    Discover sensitive data, monitor access, and enforce least privilege across clouds, SaaS, and AI applications.

    Data & Analytics
    Freemium
  • SmartBird

    Dedicated, fully managed AI infrastructure designed around your workloads

    LLM Infrastructure
    Paid
  • ClearGPT

    Deploy and monitor enterprise LLM apps with managed compute, traffic routing, and access controls.

    AI Agents & MCP
    Freemium
  • Promptfoo

    Open-source LLM evaluation and security testing for AI applications, agents, and workflows.

    Code & Development
    Freemium
  • VModel

    Run pre-trained AI models and deploy custom models through a unified REST API.

    Image & Video
    Paid
  • Tafi Avatar

    Licensed, structured 3D datasets for generating labeled AI training data

    Design & Creativity
    Freemium
  • Granica

    Enterprise AI infrastructure for data cost reduction, tabular models and agent state

    Data & Analytics
    Paid
  • Prodia

    Inference API for generative video and image models

    Image & Video
    Paid
  • LLMStack

    Build and share generative AI apps using model chaining and your own data

    Productivity & Automation
    Freemium
  • Neverinstall

    Private cloud, virtual desktops and GPU infrastructure on owned servers or cloud environments.

    LLM Infrastructure
    Paid
  • Katonic AI Platform

    Build, deploy, and govern enterprise AI agents on private infrastructure with no-code, visual, and code-based tools.

    Productivity & Automation
    Freemium
  • Cerebrium

    Serverless GPU infrastructure for deploying and scaling voice agents, LLMs, video models, and custom AI workloads.

    Code & Development
    Paid
  • StableCode

    AI coding models for instruction-based code generation and single-line or multiline autocomplete.

    Code & Development
    Freemium
  • Kaba

    Manage devices, model sessions, group policies and sensitive-content approvals across a private mesh.

    LLM Infrastructure
    Freemium
  • Vespa

    Vector, text and structured search with machine-learned ranking for search, RAG and recommendation applications.

    Data & Analytics
    Freemium
  • Gretel.ai

    The supplied page describes NVIDIA tools for generating synthetic data for AI agents and language models.

    Data & Analytics
    Freemium
  • Floneum

    Build language model workflows visually and extend them with sandboxed WebAssembly plugins.

    Code & Development
    Freemium
  • Prediction Guard

    Self-hosted AI agent control plane with runtime policies, compatible APIs, and enterprise governance.

    AI Agents & MCP
    Paid
  • NExTNet

    AI ontology infrastructure for enterprise knowledge discovery, source tracing, and permission-controlled answers.

    Research & Analysis
    Freemium
  • Nvidia Launchpad AI

    Explore NVIDIA AI models, application blueprints, synthetic datasets, and DGX Spark playbooks.

    Code & Development
    Freemium
  • micro1 Intelligence

    Expert human data, real-world training environments, and contextual evaluations for AI models and agents.

    Research & Analysis
    Freemium
  • Marvin

    Marvin turns unstructured input into Python values and runs language-model tasks with tools.

    Code & Development
    Freemium
  • Pump

    Cloud and AI inference cost management with pooled commitments, model routing, budgets, and spend reporting.

    Business & Finance
    Freemium
  • ZBrain

    Enterprise agentic AI governance with runtime policy enforcement, agent development and audit trails.

    Productivity & Automation
    Paid
  • PaLM 2

    Google language model for multilingual text, reasoning and code generation

    Writing & Content
    Freemium
  • Lettria

    Ontology-powered knowledge graphs and traceable enterprise AI answers for business and technical teams.

    Research & Analysis
    Freemium
  • Prompt Genie

    Save tokens in AI chats and coding agents with prompt optimization, Smart Paste and repeat-file context reuse.

    Code & Development
    Freemium
  • AI Playground by Vercel

    A playground page with documentation, provider navigation, history and browser-data recovery.

    LLM Infrastructure
    Freemium
  • Amazon Bedrock

    Amazon Bedrock provides foundation models, customization tools, and agent infrastructure for production AI applications.

    Productivity & Automation
    Paid
  • Remyx

    Evaluate pull request changes against team-approved criteria and preserve evidence for code review.

    Code & Development
    Freemium
  • LMQL

    A programming language for LLM prompting with types, templates, constraints and Python control flow.

    Code & Development
    Freemium
  • Lightning AI

    Build, train and deploy specialized AI models with cloud GPUs, development Studios and enterprise infrastructure.

    Code & Development
    Freemium
  • Gradio

    Build and share machine learning web interfaces in Python without writing frontend code.

    Code & Development
    Freemium
  • Inworld AI

    Speech APIs and open-model inference for developers building consumer AI applications.

    Audio & Speech
    Paid
  • UBIAI

    Fine-tune domain-specific AI models with data labeling, synthetic training data, evaluation, and deployment tools.

    Data & Analytics
    Freemium
  • PromptLayer

    Prompt management, LLM evaluations, and agent observability for engineering teams and domain experts.

    Code & Development
    Freemium