Flow — LLM Gateway
Route requests to OpenAI, Anthropic, Google Gemini, and AWS Bedrock through one OpenAI-compatible API. Automatic failover, semantic caching, prompt management, and cost tracking.
Distributed tracing, LLM gateway, and federated data warehouse — in one platform, written in Rust.