**Show HN: Llmbridge, a C++ LLM gateway with sub-millisecond overhead** > A sub

**Show HN: Llmbridge, a C++ LLM gateway with sub-millisecond overhead**

> A sub-millisecond, drop-in OpenAI-compatible LLM gateway in C++ - kottos-ai/llmbridge llmbridge A sub-millisecond, drop-in OpenAI-compatible LLM gateway in C++. Microsecond translation overhead, dependency-free default build (TLS uses OpenSSL), p99 < 1 ms at 1,000 RPS. What it does llmbridge is a sub-millisecond LLM gateway . It sits between your app and a model provider: clients speak the OpenAI API to it, and it tr...

**来源信息**
- **来源**：Hacker News：AI 热帖
- **分类**：论文
- **发布时间**：2026-09-15 21:23（北京时间）
- **原文**：[打开原文](https://github.com/kottos-ai/llmbridge)