Sluice
Sluice
Cross-product vendor rate limit broker for cooperative quota sharing across Ontopix services.
Sluice is a cross-product vendor rate limit broker at Ontopix. It provides SDK-first cooperative rate limiting backed by DynamoDB, so multiple products (audit-service, stats-service, etc.) can share vendor quotas (OpenAI, ElevenLabs, Anthropic, Google) without exhausting each other's capacity.
Who is this for?
Product teams at Ontopix that call third-party vendor APIs from their services. If your service makes calls to a vendor with shared quotas, you need Sluice.
Status
The development is progressing and solid.
The initial implementation is working, and stress tests shows promising results.
Pending:
- Ensure stress tests results are realistic to production
- Ensure the SDK API is solid, clean and usable.
Documentation
| Page | Description |
|---|---|
| Mission & Concepts | Why Sluice exists, design philosophy, and key concepts |
| Architecture | Token bucket algorithm, DynamoDB schema, lease lifecycle, reconciler |
| Python SDK Reference | Installation, configuration, acquire(), slot(), penalize() |
| TypeScript SDK Reference | Installation, configuration, acquire(), slot(), penalize() |
| Go SDK Reference | Installation, configuration, Acquire(), WithSlot(), Penalize() |
| SDK Parity | Cross-language contract tests and feature matrix |
| How-Tos | Common patterns: inline retry, SQS requeue, multi-dimension acquire |
| Operations | Environment setup, sandbox, deployment, reconciler monitoring |
| Stress Testing | Methodology, invariants, and results for cross-language stress tests |