Flow — Prompt Hub & LLM Gateway
Version, test, and roll out prompts centrally. Route requests to OpenAI, Anthropic, Google Gemini, and AWS Bedrock through one OpenAI-compatible API. Automatic failover, semantic caching, and cost tracking.
Distributed tracing, prompt hub & LLM gateway, and federated data warehouse — in one platform, written in Rust.