Quantitative UX Research · Feedback Driven Optimization

What Analytics Couldn't Tell Us: Pairing Exit Intercepts with Behavioral Data at Topshop

RoleAnalyst / Optimization Specialist
TeamQubit · Topshop
TimelineA/B/n Testing Cycle

Overview

How intercept survey feedback and behavioral analytics were triangulated to find a hidden conversion lever, and how a four variant experiment turned it into measurable revenue.

Role

Analyst / Optimization Specialist

Team

Qubit · Topshop

Methods

Exit Intercepts, Funnel analysis, and A/B/n testing

Outcome

+5.8% conversion uplift

01: The Problem

Numbers tell you the scale of a problem. Feedback tells you how to deal with it.

Topshop's search bar sat on every user's path to purchase, but it was underperforming. We knew something was wrong from the behavioral data alone: search adoption was low relative to comparable retailers, and sessions that never touched search converted at a fraction of those that did.

What the quantitative data couldn't tell us was why. Was it discoverability? Usability? Result quality? Pushing a sitewide redesign on a guess would have burned IT resources on an unvalidated hypothesis. We needed the user's voice before touching the interface.

02: The Analysis

Triangulating intercept feedback with behavioral data

Qualitative Signal: Exit Intercepts

Using Qubit's Visitor Opinion exit feedback tool, which was an on site intercept survey triggered as users left, we captured open ended feedback at the moment of abandonment. A recurring theme emerged: users struggled to both find and use the search bar. It read as a low contrast text element with no visual affordance signaling "type here".

Quantitative Signal: Analytics

Qubit's behavioral analytics quantified the stakes: visitors who used search converted roughly 10 times higher than those who did not. Search was not a convenience feature; it was the single highest intent behavior on the site, and friction there was directly suppressing revenue.

The intercept feedback gave us the diagnostic; the analytics gave us the business case. Neither alone would have justified the work, but together they made it the obvious next test.

03: The Decision

Test the hypotheses, do not ship the guess

The feedback pointed at two candidate fixes: visibility (the field did not look like an input) and affordance copy (the placeholder did not invite action). Rather than allocating expensive IT resources to push a full sitewide change based on either hypothesis, we designed four search variations testing both dimensions: changes in copy, and the addition of a border to the search box.

The test was split evenly across all users, with the existing design as control, so any change would carry statistical evidence into the IT prioritization conversation, not opinion.

H1

Visual affordance to border

H2

Invitation to copy change

H3

Combined effect

04: The Execution

Four variants, one control, evenly split

Explore the test cells below. Each variant isolates or combines the two hypotheses so the winning treatment could be attributed to a specific mechanism, not just the new one.

MY BAG  0 item(s): £0.00
TOPSHOP
Welcome to Topshop, Sign in or register
Search
BAGS & ACCESSORIES|MAKE-UP|SALE & OFFERS|WE LOVE
[MOCK CATALOG BANNER PLAYBACK]

Variant D (Winner)

Dark border around the search field with concise 'Search' placeholder text. The crisp visual boundary provided strong input affordance, making the search bar immediately recognizable. Rolled out sitewide after reaching statistical significance.

WINNER: +5.8% CONVERSIONS
Illustrative reconstruction of the test cells, not actual Topshop UI. Traffic split evenly across all cells; run to statistical significance before rollout.

05: The Impact

Evidence, not opinion, went to the roadmap

+5.8%

conversion uplift from the winning search design.

10 times

higher conversion rate for search users, the metric that prioritized the work.

9 to 11%

cumulative uplift once the same feedback method was applied to product pages.

The winning variant shipped sitewide with a quantified business case attached. Just as importantly, the method stuck: the same intercept feedback to hypothesis to controlled test loop was applied to a series of product page micro changes, size selectors, delivery tabs, confirmation popups, and add to bag buttons, which together added between 9 and 11% uplift in conversion rate, without committing IT resources to anything unproven.

What this project taught me

Intercepts earn their place at the moment of intent

Intercept feedback captured intent, not general attitude. Targeting logic, who sees the survey, when, and how often, determined whether the signal was usable at all.

Triangulation is what makes feedback actionable

Qualitative feedback without behavioral data is a mystery. Joining them turned a vague complaint into a prioritized, sized, testable hypothesis.

Small tests protect big resources

The business case required to settle an argument should always run before engineering commits. Evidence travels further with stakeholders than any deck of opinions.

Case study conducted with Qubit for Arcadia Group. Metrics as publicly reported.