What Loyalty Surveys Reveal When You Look Past the Surface
How Survey Design Shapes Strategy More Than Most Teams Realize
Survey Decoder is a content series from Nomadics where we examine real world customer surveys. We call out what is working, what is not, and where sharper design can unlock better insight. The goal is to separate signal from noise and show how survey design can either sharpen strategy or quietly undermine it.
In this edition, we reviewed a recent customer experience survey from a major US airline and its co-branded credit card partner. The stated intent was to understand card usage, benefit awareness, and loyalty drivers. In practice, the survey captured activity but missed decision logic.
What This Survey Was Trying to Learn
Reading the survey from an outside in perspective, three core questions were clearly driving the design.
1. Why cardholders do not consistently use the airline credit card when booking flights or travel.
Is it lack of awareness, stronger rewards elsewhere, habit, or forgetting at the moment of purchase.
2. whether benefits are understood and actually used.
Free checked bags, status progress, or inflight credits only matter if people remember them at the right time.
3. how the airline credit card competes within a crowded travel wallet.
Not just which other cards customers carry, but where this card sits in the decision hierarchy.
These are the right questions. The problem is that the survey rarely gets close enough to the moments where those decisions are actually made.
A Note on Visibility and Scope
One important qualifier. We do not have visibility into whether this survey uses conditional logic, advanced segmentation, or adaptive question paths behind the scenes.
It is possible that some respondents received different questions based on tenure, usage, or spend behavior. Survey Decoder focuses on what is observable from the respondent experience. The critique is about how insight surfaces to decision makers, not how data may be structured internally.
Where This Survey Falls Short
It measures outcomes but not causes
The survey captures frequency and awareness, but stops short of understanding why behavior occurs. Knowing that card usage is low does not explain what intervention would change it.
Surveys that stop at measurement tend to produce reporting rather than strategy.
“Measurement without causality produces reporting, not strategy.”
It treats competition as static rather than situational
Asking which other cards customers carry establishes context, but it does not reveal how decisions shift by situation. Travel spend is highly contextual. Surveys that do not anchor questions to recent choices miss this entirely.
Without situational insight, it is difficult to design effective displacement strategies.
It tests incentives instead of behavior design
Limited time offers are explored, but the survey does not test progress, milestones, or earned momentum. These mechanics consistently outperform generic incentives because they align with how people actually change behavior.
Research from Deloitte shows that milestone based and gamified loyalty structures materially increase engagement in travel and hospitality by making rewards feel tangible and earned.
Sharpening the Questions
INSTEAD OF ASKING
ASK
How often do you use this airline credit card?
The last time you booked a flight, what made you choose a different payment option?
Are you aware of your card benefits?
Which benefits have you used in the last six months and which felt most valuable and why?
Would a limited time offer increase card usage?
If booking two flights with this card unlocked a travel benefit, how likely would you be to participate?
When surveys are poorly designed, the risk is not bad data. The risk is false confidence.
Leaders believe they understand the problem when they do not. Investment follows the wrong signals. Teams optimize messaging instead of fixing experience.
Well designed surveys do the opposite. They reduce guesswork, clarify tradeoffs, and point directly to interventions that matter.
The Bigger Picture
Survey Decoder is not about tearing brands down. It is about raising the bar for how organizations listen.
Some surveys get this right. Many do not. Each edition will highlight both when it matters.
At Nomadics, we believe better questions lead to better decisions. This series exists to make that visible.
Sources & Further Reading
Frederick Reichheld, “The One Number You Need to Grow,” Harvard Business Review (2003)
Introduced Net Promoter Score and its relationship to loyalty and growth. Useful context for understanding where advocacy metrics add value — and where they don’t.
https://hbr.org/2003/12/the-one-number-you-need-to-grow
Bain & Company — Loyalty Is About Behavior, Not Attitudes
Explains the difference between stated satisfaction and actual repeat behavior, a central tension in interpreting survey results.
https://www.bain.com/insights/loyalty-is-about-behavior-not-attitudes/
McKinsey & Company — From Touchpoints to Journeys
Shows why evaluating isolated survey moments often misrepresents overall experience performance. Reinforces the importance of journey-level analysis.
https://www.mckinsey.com/capabilities/operations/our-insights/from-touchpoints-to-journeys
Nielsen Norman Group — Survey Design and Response Bias
Demonstrates how question wording, ordering, and structure influence responses and distort insight if not carefully designed.
https://www.nngroup.com/articles/survey-design/
