Skip to content

GPROXY v2

One gateway for multiple LLM providers, with protocol conversion, access control, usage accounting, and an embedded console.

Introduction

See what GPROXY does, which API formats it accepts, and how it chooses an upstream.

Getting Started

Choose a prebuilt download, install it, open the embedded console, and send the first OpenAI-compatible request.

Guides

Configure providers, models, users, quotas, rewrite rules, prompt caching, and observability.

Reference

Look up environment variables, routing behavior, pricing, storage backends, shutdown behavior, and the Rust SDK.