A LLaMA-based research chatbot trained on user-shared conversations to handle multi-turn dialogue.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Free
Manage and verify AI models, run them offline on a CPU, and serve responses locally.
FreePrivate cloud, virtual desktops and GPU infrastructure on owned servers or cloud environments.
PaidServerless GPU infrastructure for deploying and scaling voice agents, LLMs, video models, and custom AI workloads.
PaidSelf-hosted AI agent control plane with runtime policies, compatible APIs, and enterprise governance.
PaidA cross-platform tensor library for running large machine learning models on commodity hardware.
FreeEnterprise agentic AI governance with runtime policy enforcement, agent development and audit trails.
PaidAmazon Bedrock provides foundation models, customization tools, and agent infrastructure for production AI applications.
PaidSpeech APIs and open-model inference for developers building consumer AI applications.
PaidPre-trained English embeddings and text classifiers for Node.js, with a focus on serverless cold-start performance.
FreeAn open-source TypeScript toolkit for building AI applications and agents with streaming and multi-provider support.
FreeA local gateway for choosing models, sharing subscriptions and masking secrets across coding agents.
FreeAn open-source programming language for AI agents with typed outputs, concurrency and built-in observability.
FreeOpen-source LLM inference and local serving for Apple silicon Macs using Metal megakernels and DSpark decoding.
FreeOpen-source AI accelerator with hardware design, a compiler, a simulator and profiling tools in one repository.
FreeOpen-source agentic reinforcement learning post-training with SGLang rollout and Megatron training.
FreeBuild Neo4j knowledge graphs from documents, videos and web pages, then query the data through chat.
FreeCompile notes, documents, and transcripts into a self-hosted Markdown wiki with cited answers and MCP access.
FreeOpen-source tokenization library for encoding and decoding text in research and production.
FreeOpen-source LLM inference with multimodal models, local coding agents, compatible APIs, and Python and Rust SDKs.
FreeOpen-source AI gateway for model routing, SDK compatibility, request tracing and cost control.
FreeAudit Claude Code token usage, diagnose limits, and trace context overhead from local session logs.
FreeOpen-source Kubernetes orchestration for stateful sandboxes, AI agent runtimes, and reinforcement learning workloads.
FreeOpen-source optimization of prompts, code, agent architectures, and configurations using LLM reflection.
FreeRun Qwen Mixture-of-Experts models locally on Macs and iPhones by streaming expert weights from storage.
FreeOpen-source AI red teaming with agent, skill, MCP, infrastructure and LLM security scanners.
FreeDesktop account management, API protocol conversion, and request routing for AI services.
FreeOpen-source PyTorch distributed training and fine-tuning for language and vision-language models
FreeOpen-source AI gateway for enterprise model routing, access control, usage attribution, and cost governance.
Free



































