An open-source Python library for controlling language model output with grammars, regex and JSON schemas.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Free
A locally installed interface for LLM chat, image generation, and text-to-speech models.
FreeOpen-source RAG engine for document understanding, agentic retrieval, and structured knowledge compilation.
FreeOpen-source sandbox service for AI agents with MicroVM isolation, E2B SDK compatibility, and snapshot management.
FreeOpen-source distributed LLM inference serving with intelligent routing and production operations on Kubernetes.
FreeAn open-source runtime that isolates AI agents and enforces policies for files, networks, processes, and credentials.
FreeLocal-first AI memory with verbatim conversation storage, semantic search, CLI access and MCP integration.
FreeOpen-source OCR and document parsing that converts PDFs and images into structured Markdown and JSON for AI workflows.
FreeFind local LLMs that fit your CPU, RAM, GPU, and VRAM, with hardware detection and performance estimates.
FreeRun Claude Code's autonomous coding workflow with DeepSeek, OpenRouter, Fireworks AI, or Anthropic backends.
FreeOpen-source LLM and vision-language model inference in C/C++ for local and cloud hardware.
FreeOn-demand model switching for local AI servers with OpenAI and Anthropic API compatibility.
FreeA portable, single-file memory layer for AI agents with offline retrieval and long-term memory.
FreeOpen-source LLM API management and key redistribution through a unified OpenAI-compatible interface.
FreeAn archived, open-source inference library for running Mistral models through Python and command-line tools.
FreeSelf-hosted AI gateway for model routing, API access control, usage tracking, and cost accounting.
FreeOpen-source multimodal models for image understanding and text-to-image generation
FreeOpen-source transformer training examples and GPU-optimized building blocks for distributed model training.
FreeOpen-source text-to-text transformer library for training, fine-tuning, and evaluating NLP models.
FreeOpen-source prompt generation, testing and ELO ranking in Google Colab or local Jupyter notebooks.
FreeGraph database for knowledge graphs, GraphRAG, and agent memory, with OpenCypher queries and Redis client access.
FreeLocal-first permission policies, one-time approvals, and redacted audit logs for MCP tool calls.
FreeOpen-source inference engine for local LLMs, tool calling, speech recognition and speech synthesis
FreeOpen-source model optimization library for quantization, pruning, distillation and faster inference.
FreeOpen-source proxy server for accessing CLI models through OpenAI, Gemini, Claude, Codex, and Grok-compatible APIs.
FreeOpen-source inference engine that tunes local models for your hardware and connects them to coding agents.
FreeOpen-source infrastructure for improving agent model weights, prompts, rules, and skills from feedback.
FreeOpen-source Python library for loading, streaming, and preprocessing machine learning datasets.
FreeOpen-source inference and serving framework for large language, vision-language, and diffusion models.
Free



































