llmasaservice.io

2024-04-04 Product Update

FEATURE UPDATES

1. Conversations: You will now be able to see the conversations that your customers have had with your agents. We default conversations to ON, but if you don’t want to capture these, turn it off in your agent UI settings. Our goal is that you can see how customers are using your Agents, and respond quickly to hot leads and call to action requests.

Some features: 

– List of all conversations grouped by recency

– Auto generated summaries and titles (so you don’t need to read the entire conversation)

– Indicator icons: If users interact with any of the buttons in your agent, you get an indicator. These include, clicking call to action, a suggestion, copy to the clipboard, hit thumbs-up/down, email or save.

– Conversation intelligence (beta): A panel on the right that does a deeper dive on the conversations and pulls out company, individual, sentiment, and BANT analysis.

Figure 1

2. Summary Emails: We worked hard on an email format that captures a lot of insight into LLM use. To generate a summary email, click on the “Send Summary Email” in the control panel on the home page. (see later, we are going to allow you to schedule these “soon”)

Some features:

– Call/Token totals: Keep track of the high level quantities

– Rolled up costs and savings total and vendors: Keep track of operating costs

– Customer use and cost: Find active customers and those overusing tokens

– Conversations: Summary of conversations

Figure 2: Example email

3. Model Explorer and Recommender: We launched a free tool for you to understand the differences between models. We are working at making this the way you add services, because at the moment it’s hard for us to stay up to date on new models and pricing. It’s very fast moving. Navigate to: https://llmasaservice.io/models/

4. New Models Tested: It’s been a busy month. We tested Google Gemini 2.5, Anthropic Claude Sonnet 3.7, And Open AIs 03-mini and o1. We are working to improve how we give feedback on the thinking models, but they work. 

COMING NEXT MONTH

We are busy improving. Some key features to expect soon:

– Scheduling of the summary emails

– Fixing light theme (we added it back)

– Public API improvements (adding conversations)

– Incorporating the model explorer into the application to help make pricing and model names easier to manage.

HELP AND SUPPORT

Just a reminder to keep our support resources at hand:

Email: mailto:support@llmasaservice.io

KB: https://help.llmasaservice.io

Schedule a free support call: https://freebusy.io/predictabilityatscale-chris-and-troy

Want to give us feedback?  Just email us anytime (we sent this email)

And again, if you don’t want these monthly updates, just reply STOP.

Regards,

Troy and Chris

Team LLM as a Service

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>