Skip to content

GPROXY v2

A single-crate Rust LLM gateway for native servers and edge workers, with operation-oriented protocol transforms and an embedded console.

Introduction

Read what changed in v2, why the rewrite is a single crate, and how a request moves through the pipeline.

Getting Started

Install the binary, import a development snapshot, open the embedded console, and send the first OpenAI-compatible request.

Guides

Configure providers, routes, users, quotas, rewrite rules, Claude cache hints, agent compatibility, and observability.

Reference

Check environment variables, config import/export shape, routing behavior, pricing, storage backends, shutdown semantics, and SDK boundaries.