Tollgate v0.2.3: What Long-Context Pricing Does to a Spend Cap
Some models bill the whole request at a higher rate above a size threshold. What that does to a spend cap, and what changed in Tollgate between v0.1.1 and v0.2.3.
Tag
Tollgate
Tollgate: Open-Source Hard Limits for LLM Spend
7 minutes
Tollgate is an open-source AI gateway and spend-control proxy. It prices every LLM request by token, reserves budget before the call, and …