For each customer you can view full usage and billing details. This allows you to view and share important details and bill customers or internal departments based on different use. One use case we use it for in another of our SaaS application is each feature we allocate to a unique customer id (a hack, but go with me). Then we can see billing based on a feature by feature basis and tune the prompts to reduce cost where we were “a bit chatty” for the feature.
Forecasting
When viewing the current month, we also project what the end of month cost might be if current trends continue. This helps contact key customers early for upselling and upgrading if they are increasing their usage of your agents.
Future Work
We are looking to automatically add billing feature for LLM use. Our first integration will probably be Stripe subscriptions and their usage meters. We are still designing that out and welcome feedback.
We also have the Public API that allows you to get all of these call details. That’s available now, but NEEDS more testing, so let us know if you can help
Team LLMAsAService
Leave a Reply