A/B testing compares a control and a test version of a scenario to measure the real effect of a change on the metrics that matter.
How to use the term
What to read alongside
This term is worth reading together with the neighbouring concepts in its section and the Gravity AI launch scenarios it belongs to.
Glossary section
What it takes for an AI scenario to work outside the demo: quality measurement, experiments, operations and control over the economics.
What it is
A/B testing compares a control and a test version of a scenario to measure the real effect of a change on the metrics that matter.
Example in ecommerce
It is how you check whether the AI assistant adds to search conversion or add-to-cart against the shopper's current path.
Business impact
Gives you the facts to scale a pilot, instead of team intuition or one-off anecdotes.
A fit for terms about search by meaning, the architecture behind the results and product discovery.
Shows how AI terms turn into a real decision flow inside the product page.
Collects the product scenarios in one place and is the starting point for a demo.
We will show which scenario to start with, how to tie it to metrics and where measurable results come fastest.