CoreProxy AI is a production-ready, high-performance API Gateway and reverse proxy engineered using Fastify (Node.js), Redis, and PostgreSQL. It is specifically designed to secure, cache, and rate-limit internal LLM/AI API endpoints (OpenAI, Gemini, Ollama) for multi-tenant applications.

Key Features:

Multi-Tenant Auth: Validates custom 'X-CoreProxy-Key' headers against an ultra-fast Redis cache.
Rolling-Window Rate Limiting: Strict token-bucket restriction handled via Redis based on client tiers (Free, Tier 1, Tier 2).
Dynamic Reverse Proxying: Dynamically forwards valid requests to target AI endpoints while masking your master API keys.
Complete Audit Logging: Automatically logs structural metadata to PostgreSQL.

Perfect boilerplate for SaaS founders looking to protect their AI budgets from token abuse and API depletion. Fully containerized.

CoreProxy AI Business Plan

Value Proposition

CoreProxy AI is a high-performance, multi-tenant API Gateway designed specifically for AI/LLM workloads. It provides a secure, sub-millisecond overhead layer that handles rate-limiting, token-bucket budgeting, and API key masking. This prevents LLM budget abuse and centralizes observability for distributed AI applications.

Target Customer

Startups & Scaleups: Companies building AI-driven products needing to protect their API budgets.
Enterprise IT: Organizations centralizing LLM access across multiple teams/departments.

lead

Team Lead

Team management, task planning, delegation, and monitoring

engineer

Senior Backend & Infrastructure Engineer. Expert in Node.js, Fastify, Redis, and Docker. Responsible for the core API Gateway development and infrastructure.

Ensure Docker and Docker Compose are installed on your machine.
Duplicate '.env.example' into a new '.env' file and insert your master AI provider API keys.
Run 'docker-compose up -d --build' to boot the Fastify server, Redis cache, and PostgreSQL database.
The gateway will instantly start intercepting and rate-limiting inbound requests at http://localhost:3000/v1/proxy/*.
SQL schema seed included inside 'app/db/init.sql' for instant user testing.

CoreProxy AI

Overview

Mission

CoreProxy AI Business Plan

Value Proposition

Target Customer

Revenue Model

KPIs

The team

Setup