Winning Variant Dashboard Demo

Kirk Morales

Explore the Winning Variant dashboard demo, featuring A/B test monitoring for LLM chat engines. Understand experiment health, cohorts, key business metrics, and detailed results for your business.

Transcript

00:00

Hi, I'm Kirk at Winning Variant, here to show you a quick demo of what the Winning Variant dashboard could look like for your business.

00:06

At the top we have a list of active A B tests.

00:09

This one in particular is testing different LLMs for a product recommendation chat engine.

00:15

So we can see high level description, hypotheses, sample, etc.

00:19

at the very top we have health diagnostics for the experiment to make sure that it's running smoothly.

00:24

we can see that we have two different cohorts here.

00:26

The first was a canary deployment to make sure there wasn't any degradation by introducing this new version.

00:31

And then we rolled out to a full 5050 test.

00:34

Underneath that we can see high level metrics.

00:36

So we can see how is this experiment and the different variants within it impacting sales returns, chargebacks and churn.

00:42

And then if we want to get into the nitty gritty below, we have the raw numbers and lift percentages.

00:49

Of course, all of this can also be queried directly from the underlying tables and views.

00:54

And this would be 100% customized for your business inside of your existing BI tool.

Winning Variant Dashboard Demo