#llm

Canvas Chat

A branching, canvas-based chat interface for comparing responses across Claude, GPT, Gemini, and other LLMs.

Switchyard

A free, open-source traffic router for AI apps that lets you send requests to different AI models based on rules (cost, load, task type) while keeping the same OpenAI/Anthropic-style API your code already uses.

llmfit

A free command-line tool that tells you which local AI models your computer can actually run — before you spend an hour downloading one that just crashes or crawls.

OpenKB

A free, open-source command-line tool that reads your documents (PDFs, Word files, spreadsheets...) and turns them into a linked wiki you can browse in Obsidian, using AI instead of manual note-taking.

Swift AI SDK

An open-source Swift package giving Apple-platform developers one unified interface to a dozen+ AI providers.

LangGraph for Swift

A free, open-source Swift library that brings LangGraph's stateful, multi-step AI agent pattern natively to iOS and macOS development, without needing a separate Python backend.

USPlus.ai

A platform for building your own AI assistants (called "agents") that can use any major AI model, remember context between conversations, and plug into over a thousand other apps and services — aimed at businesses that want a custom AI worker without hiri

Hubo

Gets a second AI agent to argue with the one that just wrote your code, back and forth, until they agree it's actually good — instead of one agent grading its own homework.

ActionRail

Double-checks what an AI agent is about to do against your real, live data before letting it happen — so it can't confidently take an action based on outdated or wrong information.

Semble

An open-source code search library that lets AI coding agents find relevant code using far fewer tokens than grep.

Nativ

A free Mac app that runs AI chatbots like Llama or Mistral directly on your own computer, with no account, no monthly fee, and no data leaving your machine — instead of sending every message to a company's servers.

Morph

API that instantly merges AI-generated code edits into your actual files, so coding agents can make changes without rewriting whole files.

Fireworks AI

Cloud inference platform for running and fine-tuning open-source language models fast, without owning any GPUs.

Amberflo

Real-time usage metering and billing platform that tracks AI/API costs and turns them into invoices, budgets and cost controls.

PromptLayer

Collaboration platform for AI teams to manage, test and monitor the prompts that power their LLM applications.

promptfoo

Open-source LLM eval and red teaming: test prompts, compare models, catch jailbreaks and data leaks locally and in CI.

Mastra

TypeScript framework for AI agents and workflows: typed tools, graph orchestration, memory, RAG and 90+ model providers.

Helicone

Open-source AI gateway and LLM observability: one API for 100+ models, cost and latency tracking, prompt management.

CrewAI

Python framework for role-based multi-agent teams: Crews plus event-driven Flows, from MIT open source to enterprise suite.

Braintrust

AI eval and observability platform: tracing, LLM and human scoring, quality gates. Used by Vercel, Notion and Replit.