Lamatic · Raman-12321 · Oct 26, 2025 · Oct 27, 2025 · Oct 27, 2025 · Oct 27, 2025
diff --git a/.github/pull_request_template.md b/.github/pull_request_template.md
@@ -1,35 +1,14 @@
-## Description
-<!-- Provide a brief description of the changes in this PR -->
+**Description:** (required)
+- Detailed change 1
+- Detailed change 2
 
-## Motivation
-<!-- Provide a brief motivation of why the changes in this PR are needed -->
+**Tests Run/Test cases added:** (required)
+- [ ] Description of test case
 
-## Type of Change
+**Type of Change:**
 <!-- Put an 'x' in the boxes that apply -->
 - [ ] Bug fix (non-breaking change which fixes an issue)
 - [ ] New feature (non-breaking change which adds functionality)
 - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
 - [ ] Documentation update
-- [ ] Refactoring (no functional changes)
-
-## How Has This Been Tested?
-<!-- Describe the tests you ran to verify your changes -->
-- [ ] Unit Tests
-- [ ] Integration Tests
-- [ ] Manual Testing
-
-## Screenshots (if applicable)
-<!-- Add screenshots to help explain your changes -->
-
-## Checklist
-<!-- Put an 'x' in the boxes that apply -->
-- [ ] My code follows the style guidelines of this project
-- [ ] I have performed a self-review of my own code
-- [ ] I have commented my code, particularly in hard-to-understand areas
-- [ ] I have made corresponding changes to the documentation
-- [ ] My changes generate no new warnings
-- [ ] I have added tests that prove my fix is effective or that my feature works
-- [ ] New and existing unit tests pass locally with my changes
-
-## Related Issues
-<!-- Link related issues below. Insert the issue link or reference -->
+- [ ] Refactoring (no functional changes)
diff --git a/.gitignore b/.gitignore
@@ -1,3 +1,6 @@
+# Local configuration file
+conf.json
+
 # Logs
 logs
 *.log
@@ -142,3 +145,5 @@ build
 plugins/**/.creds.json
 plugins/**/creds.json
 plugins/**/.parameters.json
+src/handlers/tests/.creds.json
+.cursor/
diff --git a/CLAUDE.md b/CLAUDE.md
@@ -0,0 +1,92 @@
+# CLAUDE.md
+
+This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
+
+## Project Overview
+
+This is the **Portkey AI Gateway** - a fast, reliable AI gateway that routes requests to 250+ LLMs with sub-1ms latency. It's built with Hono framework for TypeScript/JavaScript and can be deployed to multiple environments including Cloudflare Workers, Node.js servers, and Docker containers.
+
+## Development Commands
+
+### Core Development
+- `npm run dev` - Start development server using Wrangler (Cloudflare Workers)
+- `npm run dev:node` - Start development server using Node.js
+- `npm run build` - Build the project for production
+- `npm run build-plugins` - Build the plugin system
+
+### Testing
+- `npm run test:gateway` - Run tests for the main gateway code (src/)
+- `npm run test:plugins` - Run tests for plugins
+- `jest src/` - Run specific gateway tests
+- `jest plugins/` - Run specific plugin tests
+
+### Code Quality
+- `npm run format` - Format code with Prettier
+- `npm run format:check` - Check code formatting
+- `npm run pretty` - Alternative format command
+
+### Deployment
+- `npm run deploy` - Deploy to Cloudflare Workers
+- `npm run start:node` - Start production Node.js server
+
+## Architecture
+
+### Core Components
+
+**Main Application (`src/index.ts`)**
+- Hono-based HTTP server with middleware pipeline
+- Handles multiple AI provider integrations
+- Routes: `/v1/chat/completions`, `/v1/completions`, `/v1/embeddings`, etc.
+
+**Provider System (`src/providers/`)**
+- Modular provider implementations (OpenAI, Anthropic, Azure, etc.)
+- Each provider has standardized interface: `api.ts`, `chatComplete.ts`, `embed.ts`
+- Provider configs define supported features and transformations
+
+**Middleware Pipeline**
+- `requestValidator` - Validates incoming requests
+- `hooks` - Pre/post request hooks
+- `memoryCache` - Response caching
+- `logger` - Request/response logging
+- `portkey` - Core Portkey-specific middleware for routing, guardrails, etc.
+
+**Plugin System (`plugins/`)**
+- Guardrail plugins for content filtering, PII detection, etc.
+- Each plugin has `manifest.json` defining capabilities
+- Plugins are built separately with `npm run build-plugins`
+
+### Key Concepts
+
+**Configs** - JSON configurations that define:
+- Provider routing and fallbacks
+- Load balancing strategies
+- Guardrails and content filtering
+- Caching and retry policies
+
+**Handlers** - Route-specific request processors in `src/handlers/`
+- Each AI API endpoint has dedicated handler
+- Stream handling for real-time responses
+- WebSocket support for realtime APIs
+
+## File Structure
+
+- `src/providers/` - AI provider integrations
+- `src/handlers/` - API endpoint handlers
+- `src/middlewares/` - Request/response middleware
+- `plugins/` - Guardrail and validation plugins
+- `cookbook/` - Example integrations and use cases
+- `conf.json` - Runtime configuration
+
+## Testing Strategy
+
+Tests are organized by component:
+- `src/tests/` - Core gateway functionality tests
+- `src/handlers/__tests__/` - Handler-specific tests
+- `plugins/*/**.test.ts` - Plugin tests
+- Test timeout: 30 seconds (configured in jest.config.js)
+
+## Configuration
+
+The gateway uses `conf.json` for runtime configuration. Sample config available in `conf_sample.json`.
+
+Key environment variables and configuration handled through Hono's adapter system for multi-environment deployment.
diff --git a/Dockerfile b/Dockerfile
@@ -9,7 +9,7 @@ COPY package*.json ./
 COPY patches ./
 
 # Upgrade system packages
-RUN apk update && apk upgrade --no-cache
+RUN apk upgrade --no-cache
 
 # Upgrade npm to version 10.9.2
 RUN npm install -g npm@10.9.2
@@ -29,7 +29,7 @@ RUN npm run build \
 FROM node:20-alpine
 
 # Upgrade system packages
-RUN apk update && apk upgrade --no-cache
+RUN apk upgrade --no-cache
 
 # Upgrade npm to version 10.9.2
 RUN npm install -g npm@10.9.2

diff --git a/README.md b/README.md
@@ -5,8 +5,8 @@
 
 <div align="center">
 
-<a href="https://portkey.sh/report-github"><img src="https://raw.githubusercontent.com/siddharthsambharia-portkey/Portkey-Product-Images/refs/heads/main/LLM%20Report%20Campaign%20Frame.png"></img></a>
-<br>
+🆕 **[Portkey Models](https://github.com/Portkey-AI/models)** - Open-source LLM pricing for 2,300+ models across 40+ providers. [Explore →](https://portkey.ai/models)
+
 
 # AI Gateway
 #### Route to 250+ LLMs with 1 fast & friendly API
@@ -41,7 +41,8 @@ The [**AI Gateway**](https://portkey.wiki/gh-10) is designed for fast, reliable
 - Scale AI apps with **[load balancing](https://portkey.wiki/gh-13)** and **[conditional routing](https://portkey.wiki/gh-14)**
 - Protect your AI deployments with **[guardrails](https://portkey.wiki/gh-15)**
 - Go beyond text with **[multi-modal capabilities](https://portkey.wiki/gh-16)**
-- Finally, explore **[agentic workflow](https://portkey.wiki/gh-17)** integrations
+- Explore **[agentic workflow](https://portkey.wiki/gh-17)** integrations
+- Manage MCP servers with enterprise auth & observability using **[MCP Gateway](https://portkey.ai/docs/product/mcp-gateway)**
 
 <br><br>
 
@@ -163,38 +164,24 @@ You can do a lot more stuff with configs in your AI gateway. [Jump to examples
 
 The LLM Gateway's [enterprise version](https://portkey.wiki/gh-86) offers advanced capabilities for **org management**, **governance**, **security** and [more](https://portkey.wiki/gh-87) out of the box. [View Feature Comparison →](https://portkey.wiki/gh-32)
 
-The enterprise deployment architecture for supported platforms is available here - [**Enterprise Private Cloud Deployments**](https://portkey.wiki/gh-33)
+The enterprise deployment architecture for supported platforms is available here - [**Enterprise Private Cloud Deployments**](https://portkey.ai/docs/self-hosting/hybrid-deployments/architecture)
 
 <a href="https://portkey.sh/demo-13"><img src="https://portkey.ai/blog/content/images/2024/08/Get-API-Key--5-.png" height=50 alt="Book an enterprise AI gateway demo" /></a><br/>
 
-
 <br>
 
-<hr>
-
-### AI Engineering Hours
-
-Join weekly community calls every Friday (8 AM PT) to kickstart your AI Gateway implementation! [Happening every Friday](https://portkey.wiki/gh-35)
-
-<a href="https://portkey.wiki/gh-35"><img width="500" src="https://github.com/user-attachments/assets/c2885699-f197-4289-b819-21eb839fbae1" /></a>
-
-Minutes of Meetings [published here](https://portkey.wiki/gh-36).
-
+## MCP Gateway
 
-<hr>
+[MCP Gateway](https://portkey.ai/docs/product/mcp-gateway) provides a centralized control plane for managing MCP (Model Context Protocol) servers across your organization.
 
-### LLMs in Prod'25
+- **Authentication** — Single auth layer at the gateway. Users authenticate once; your MCP servers receive verified requests
+- **Access Control** — Control which teams and users can access which servers and tools. Revoke access instantly
+- **Observability** — Every tool call logged with full context: who called what, parameters, response, latency
+- **Identity Forwarding** — Forward user identity (email, team, roles) to MCP servers automatically
 
-Insights from analyzing 2 trillion+ tokens, across 90+ regions and 650+ teams in production. What to expect from this report:
-- Trends shaping AI adoption and LLM provider growth.
-- Benchmarks to optimize speed, cost and reliability.
-- Strategies to scale production-grade AI systems.
-
-<a href="https://portkey.sh/report-github"><img width="500" src="https://raw.githubusercontent.com/siddharthsambharia-portkey/Portkey-Product-Images/refs/heads/main/LLM%20Report%20Campaign%20Image.png" /></a>
-
-<a href="https://portkey.sh/report-github">**Get the Report**</a>
-<hr>
+Works with Claude Desktop, Cursor, VS Code, and any MCP-compatible client. [Get started →](https://portkey.ai/docs/product/mcp-gateway/quickstart)
 
+<br>
 
 ## Core Features
 ### Reliable Routing
@@ -227,6 +214,13 @@ Insights from analyzing 2 trillion+ tokens, across 90+ regions and 650+ teams in
 
 <br>
 
+## Portkey Models
+Open-source LLM pricing database for 40+ providers - used by the Gateway for cost tracking.
+
+[GitHub](https://github.com/Portkey-AI/models) | [Model Explorer](https://portkey.ai/models)
+
+<br>
+
 ## Cookbooks
 
 ### ☄️ Trending
@@ -283,6 +277,7 @@ Gateway seamlessly integrates with popular agent frameworks. [Read the documenta
 | [Llama Index](https://portkey.wiki/gh-97)             | ✅     | ✅          | ✅      | ✅   | ✅            | ✅                |
 | [Control Flow](https://portkey.wiki/gh-98) | ✅     | ✅          | ✅      | ✅   | ✅            | ✅                |
 | [Build Your Own Agents](https://portkey.wiki/gh-99) | ✅     | ✅          | ✅      | ✅   | ✅            | ✅                |
+| <img src="https://io.net/favicon.ico" width=35> | [IO Intelligence](https://io.net/intelligence) | ✅ | ✅ |
 
 <br>
 

diff --git a/conf.example.json b/conf.example.json
@@ -0,0 +1,48 @@
+{
+  "plugins_enabled": [
+    "default",
+    "portkey",
+    "aporia",
+    "sydelabs",
+    "pillar",
+    "patronus",
+    "pangea",
+    "promptsecurity",
+    "panw-prisma-airs",
+    "walledai"
+  ],
+  "credentials": {
+    "portkey": {
+      "apiKey": "..."
+    }
+  },
+  "cache": false,
+  "integrations": [
+    {
+      "provider": "anthropic",
+      "slug": "dev_team_anthropic",
+      "credentials": {
+        "apiKey": "sk-ant-"
+      },
+      "rate_limits": [
+        {
+          "type": "requests",
+          "unit": "rph",
+          "value": 3
+        },
+        {
+          "type": "tokens",
+          "unit": "rph",
+          "value": 3000
+        }
+      ],
+      "models": [
+        {
+          "slug": "claude-3-7-sonnet-20250219",
+          "status": "active",
+          "pricing_config": null
+        }
+      ]
+    }
+  ]
+}
diff --git a/conf.json b/conf.json
@@ -2,13 +2,15 @@
   "plugins_enabled": [
     "default",
     "portkey",
+    "qualifire",
     "aporia",
     "sydelabs",
     "pillar",
     "patronus",
     "pangea",
     "promptsecurity",
-    "panw-prisma-airs"
+    "panw-prisma-airs",
+    "walledai"
   ],
   "credentials": {
     "portkey": {

diff --git a/conf_sample.json b/conf_sample.json