Kirk Morales
Winning Variant Dashboard Demo
Winning Variant Dashboard Demo
Kirk Morales
Explore the Winning Variant dashboard demo, featuring A/B test monitoring for LLM chat engines. Understand experiment health, cohorts, key business metrics, and detailed results for your business.
Transcript
00:00
Hi, I'm Kirk at Winning Variant, here to show you a quick demo of what the Winning Variant dashboard could look like for your business.
00:06
At the top we have a list of active A B tests.
00:09
This one in particular is testing different LLMs for a product recommendation chat engine.
00:15
So we can see high level description, hypotheses, sample, etc.
00:19
at the very top we have health diagnostics for the experiment to make sure that it's running smoothly.
00:24
we can see that we have two different cohorts here.
00:26
The first was a canary deployment to make sure there wasn't any degradation by introducing this new version.
00:31
And then we rolled out to a full 5050 test.
00:34
Underneath that we can see high level metrics.
00:36
So we can see how is this experiment and the different variants within it impacting sales returns, chargebacks and churn.
00:42
And then if we want to get into the nitty gritty below, we have the raw numbers and lift percentages.
00:49
Of course, all of this can also be queried directly from the underlying tables and views.
00:54
And this would be 100% customized for your business inside of your existing BI tool.