The supplied URL returns a page-not-found notice and directs AI agents to /llms.txt.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Freemium
An open-source TypeScript toolkit for building AI applications and agents with streaming and multi-provider support.
FreeEvaluate LLM-powered apps with test suites, multiple evaluation strategies, a CLI, and quality reports.
FreemiumBuild, deploy, and govern AI applications and agents with models, databases, developer tools, and security services.
FreemiumS3-compatible cloud object storage for AI workloads, applications, archives, and secure computer backup.
FreemiumOpen AI models, scientific discovery tools, environmental modeling, and embodied AI research.
FreemiumA privacy-first web interface for routing paid AI models, browsing in Ghost Mode, and keeping chats on-device.
FreemiumA local gateway for choosing models, sharing subscriptions and masking secrets across coding agents.
FreeComputer-use environments, agent trajectories and outcome evaluation for frontier-model research.
FreemiumAn open-source programming language for AI agents with typed outputs, concurrency and built-in observability.
FreeCoding-agent session monitoring with reusable skills, session handoffs, and convention-based PR reviews.
FreemiumA self-hosted AI interface for local and cloud models, Python extensions, and community tools.
FreemiumGenerate AI images and videos in a web studio, or access generative-media models through a unified API.
FreemiumCollaborative prompt management, testing, deployment, and AI security for product teams.
FreemiumOpen-source LLM inference and local serving for Apple silicon Macs using Metal megakernels and DSpark decoding.
FreeOpen-source AI accelerator with hardware design, a compiler, a simulator and profiling tools in one repository.
FreeOpen-source agentic reinforcement learning post-training with SGLang rollout and Megatron training.
FreeBuild Neo4j knowledge graphs from documents, videos and web pages, then query the data through chat.
FreeCompile notes, documents, and transcripts into a self-hosted Markdown wiki with cited answers and MCP access.
FreeOpen-source tokenization library for encoding and decoding text in research and production.
FreeOpen-source LLM inference with multimodal models, local coding agents, compatible APIs, and Python and Rust SDKs.
FreeOpen-source AI gateway for model routing, SDK compatibility, request tracing and cost control.
FreeLocal neuro-symbolic memory for offline AI, with verified fact retrieval and an OpenAI-compatible API.
FreemiumAudit Claude Code token usage, diagnose limits, and trace context overhead from local session logs.
FreeOpen-source Kubernetes orchestration for stateful sandboxes, AI agent runtimes, and reinforcement learning workloads.
FreeOpen-source optimization of prompts, code, agent architectures, and configurations using LLM reflection.
FreeRun Qwen Mixture-of-Experts models locally on Macs and iPhones by streaming expert weights from storage.
FreeOpen-source AI red teaming with agent, skill, MCP, infrastructure and LLM security scanners.
FreeDesktop account management, API protocol conversion, and request routing for AI services.
FreeOpen-source PyTorch distributed training and fine-tuning for language and vision-language models
FreeOpen-source AI gateway for enterprise model routing, access control, usage attribution, and cost governance.
FreePack repositories into AI-friendly files with token counts, configurable exclusions, and optional code compression.
FreeOpen-source context graphs, knowledge graphs, deterministic reasoning, and decision provenance for AI systems.
Free



































