Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

206tools listed

Pricing mix

  • 102 Free
  • 85 Freemium
  • 19 Paid

104 tools match

  • Securiti

    www.securiti.ai

    Discover sensitive data, monitor access, and enforce least privilege across clouds, SaaS, and AI applications.

    Freemium
  • SmartBird

    www.smartbird.ai

    Dedicated, fully managed AI infrastructure designed around your workloads

    Paid
  • ClearGPT

    www.cleargpt.ai

    Deploy and monitor enterprise LLM apps with managed compute, traffic routing, and access controls.

    Freemium
  • Promptfoo

    www.promptfoo.dev

    Open-source LLM evaluation and security testing for AI applications, agents, and workflows.

    Freemium
  • VModel

    www.vmodel.ai

    Run pre-trained AI models and deploy custom models through a unified REST API.

    Paid
  • Tafi Avatar

    www.maketafi.com

    Licensed, structured 3D datasets for generating labeled AI training data

    Freemium
  • Granica

    www.granica.ai

    Enterprise AI infrastructure for data cost reduction, tabular models and agent state

    Paid
  • Prodia

    www.prodia.com

    Inference API for generative video and image models

    Paid
  • LLMStack

    www.llmstack.ai

    Build and share generative AI apps using model chaining and your own data

    Freemium
  • Neverinstall

    www.neverinstall.com

    Private cloud, virtual desktops and GPU infrastructure on owned servers or cloud environments.

    Paid
  • Katonic AI Platform

    www.katonic.ai

    Build, deploy, and govern enterprise AI agents on private infrastructure with no-code, visual, and code-based tools.

    Freemium
  • Cerebrium

    www.cerebrium.ai

    Serverless GPU infrastructure for deploying and scaling voice agents, LLMs, video models, and custom AI workloads.

    Paid
  • StableCode

    www.stability.ai

    AI coding models for instruction-based code generation and single-line or multiline autocomplete.

    Freemium
  • Kaba

    www.kaba.ai

    Manage devices, model sessions, group policies and sensitive-content approvals across a private mesh.

    Freemium
  • Vespa

    www.vespa.ai

    Vector, text and structured search with machine-learned ranking for search, RAG and recommendation applications.

    Freemium
  • Gretel.ai

    www.gretel.ai

    The supplied page describes NVIDIA tools for generating synthetic data for AI agents and language models.

    Freemium
  • Floneum

    www.floneum.com

    Build language model workflows visually and extend them with sandboxed WebAssembly plugins.

    Freemium
  • Prediction Guard

    www.predictionguard.com

    Self-hosted AI agent control plane with runtime policies, compatible APIs, and enterprise governance.

    Paid
  • NExTNet

    www.nextnetinc.com

    AI ontology infrastructure for enterprise knowledge discovery, source tracing, and permission-controlled answers.

    Freemium
  • Nvidia Launchpad AI

    www.nvidia.com

    Explore NVIDIA AI models, application blueprints, synthetic datasets, and DGX Spark playbooks.

    Freemium
  • micro1 Intelligence

    www.micro1.ai

    Expert human data, real-world training environments, and contextual evaluations for AI models and agents.

    Freemium
  • Marvin

    www.askmarvin.ai

    Marvin turns unstructured input into Python values and runs language-model tasks with tools.

    Freemium
  • Pump

    www.pump.co

    Cloud and AI inference cost management with pooled commitments, model routing, budgets, and spend reporting.

    Freemium
  • ZBrain

    www.zbrain.ai

    Enterprise agentic AI governance with runtime policy enforcement, agent development and audit trails.

    Paid
  • PaLM 2

    www.ai.google

    Google language model for multilingual text, reasoning and code generation

    Freemium
  • Lettria

    www.lettria.com

    Ontology-powered knowledge graphs and traceable enterprise AI answers for business and technical teams.

    Freemium
  • Prompt Genie

    www.prompt-genie.com

    Save tokens in AI chats and coding agents with prompt optimization, Smart Paste and repeat-file context reuse.

    Freemium
  • A playground page with documentation, provider navigation, history and browser-data recovery.

    Freemium
  • Amazon Bedrock

    aws.amazon.com

    Amazon Bedrock provides foundation models, customization tools, and agent infrastructure for production AI applications.

    Paid
  • Remyx

    www.remyx.ai

    Evaluate pull request changes against team-approved criteria and preserve evidence for code review.

    Freemium
  • LMQL

    www.lmql.ai

    A programming language for LLM prompting with types, templates, constraints and Python control flow.

    Freemium
  • Lightning AI

    www.lightning.ai

    Build, train and deploy specialized AI models with cloud GPUs, development Studios and enterprise infrastructure.

    Freemium
  • Gradio

    www.gradio.app

    Build and share machine learning web interfaces in Python without writing frontend code.

    Freemium
  • Inworld AI

    www.inworld.ai

    Speech APIs and open-model inference for developers building consumer AI applications.

    Paid
  • UBIAI

    www.ubiai.tools

    Fine-tune domain-specific AI models with data labeling, synthetic training data, evaluation, and deployment tools.

    Freemium
  • PromptLayer

    www.promptlayer.com

    Prompt management, LLM evaluations, and agent observability for engineering teams and domain experts.

    Freemium