Is there a way to view anonymized usage analytics for agents I've created?

Q&A
, ,
1

Hi team,
As an agent creator, I’d like to understand how my published agents are being used - without exposing any user PII.

What I’m looking for:

1. Unique visitor count - anonymized, no alias needed - just a number

2. Time spent per session - how long users interact with the agent per visit

3. Total sessions - how many times the agent has been invoked

Why this matters:

- Measure adoption and identify if users are finding value

- Make data-driven improvements to the agent

- Justify continued investment in agent development to leadership

Question:

Is this currently available anywhere (Arena console, admin panel, or API)? If not, would love to see this as a feature for agent owners.

Thank you!

2

Hi @rajrdhi and welcome to the Quick Community!

The short answer is that there is no way for agent creators to see their own usage analytics today. The metrics exist, but they’re locked behind the admin-only Amazon Quick Usage Metrics dashboard. If you can get your admin involved, they’ll find an Agent filter that shows total conversations, queries, active users, and feedback trends. That covers your unique visitors and total sessions ask. Docs here: Using the Amazon Quick analytics dashboard.

Time spent per session isn’t surfaced anywhere today, even for admins. The closest proxy is average queries per conversation.

For a fully custom and anonymized setup, your admin can configure CloudWatch Logs delivery with log type CHAT_LOGS. Each event includes an agent_id field, so you could build your own reporting filtered to your agent, strip PII with CloudWatch masking policies, and derive session duration from timestamps.

This has come up in several prior threads, so you’re not alone in asking about this. Since you’ve already tagged it as a feature request, I’d leave it attached to help increase visibility for the Quick Team.

3

Thanks so much, Jacob - this is really helpful!

Thanks Jacob - really appreciate the detailed breakdown!

Good to know the metrics are there behind the admin dashboard, and the CloudWatch CHAT_LOGS route is a solid pointer for an anonymized setup. I’ll check with my leadership to get the right access in place.

Thanks again for taking the time - super helpful!

Ice Age Possum: Thank You!