黄Huang Goodman買POPS4宴Prosecco4蔵Stash Edge居Brand Room機MCP禮Fending🦋 Blueskyin◎ Instagram♪ TikTok▶ YouTube𝕏✉ Substack
Tumi ✦ Yeti ✦ Patagonia ✦ Titleist ✦ Callaway ✦ Vineyard Vines ✦ Cutter & Buck ✦ Columbia ✦ Nike ✦ Under Armour ✦ North Face ✦ Carhartt ✦ Stanley ✦ Hydro Flask ✦ S'well ✦ Moleskine ✦ Leatherman ✦ Bose ✦ JBL ✦ Apple ✦
The Stash Edge · Huang Goodman · Brand success, proven daily · ad-free market intelligence no brand can buy its way into
Virginia Beach · Atlantic coast · since 1997
AI safety →Marketing safety →Generate your corporate event in 15 seconds →Immediate program →
智Briefing蔵Stash間Markets勝Sports旅Voyage黒Black's家House禮Fending居Brand RoomCorporate accountsPast issues
↑ Read the latest from the desks · fresh intelligence, published daily✦Quiet reading✦No ads, ever✦Ad-free articles read by humans today … ↑✦Boards engagement today … people · … AI✦Corporate brand & media services✦Made in Virginia Beach since 1997✦
On the wire
The Stash EdgeWELL POURNovember 22, 20263 min readAd-free

Netguru Publishes Loyalty Program ROI Formula With Holdout Test Method for 2026

New framework shows how to measure true incremental lift of loyalty programs using control groups and worked financial examples.

Jenny Huang Goodman MPA MSc MHSAThe Stash Edge · Huang GoodmanSource: Netguru ↗
Edgar's SEC data profile {actuarial version}
In plain words

Use a holdout group to measure true loyalty program lift: revenue difference times member count, minus full program cost, divided by cost.

$500,000
loyalty program generating
$1.2 million
in incremental revenue for a
140% ROI
The critical step is the holdout group—a statistically significant…
$200,000
annual platform cost

Netguru released a loyalty program ROI measurement framework in 2026 that teaches physical product brands how to measure the true incremental value of their loyalty programs using holdout testing. According to the published framework, the method isolates program performance by comparing member behavior against a randomly selected control group that receives no loyalty benefits, then calculates the net financial gain after program costs.

The framework centers on a three-part formula: calculate the incremental revenue generated by loyalty members versus non-members, subtract the full cost of running the program (platform fees, rewards expense, labor), then divide by program cost to yield ROI as a percentage. Netguru's worked example shows a $500,000 loyalty program generating $1.2 million in incremental revenue for a 140% ROI. The critical step is the holdout group—a statistically significant sample of customers randomly excluded from the program who serve as the counterfactual. Without this control, brands mistake natural repeat purchase behavior for program-driven lift.

This works because most loyalty programs suffer from selection bias: high-value customers join loyalty programs because they already intended to buy again. The revenue looks impressive until you realize those customers would have returned anyway. The holdout test isolates true causality. Netguru's method requires splitting new customers at acquisition into two groups—loyalty-eligible and control—then tracking purchase frequency, average order value, and total spend over a defined period (typically 12 months). The difference in behavior, multiplied by the size of the member base, yields incremental revenue attributable solely to the program.

The framework also accounts for full program costs that many brands overlook: technology platform subscription, customer service overhead for point inquiries, discount and reward fulfillment, and internal labor to manage campaigns. Netguru's worked example includes a $200,000 annual platform cost, $250,000 in reward redemptions, and $50,000 in labor, totaling the $500,000 denominator. The discipline of this accounting prevents brands from celebrating gross revenue increases while running loyalty programs at a loss.

A small physical product brand can run this test with basic tools and modest scale. At acquisition, randomly assign 10% of new customers to a control group—tag them in your CRM but do not enroll them in the loyalty program, do not email them point balances, do not offer member-only discounts. Treat them as regular customers. After 12 months, pull purchase data for both groups: calculate average orders per customer, average order value, and total revenue per customer for loyalty members and for the control group. Multiply the per-customer revenue difference by your member count to get incremental revenue. Subtract your annual loyalty costs (Shopify app subscription, reward costs, time spent). If the result is positive and exceeds your cost by a meaningful margin, the program works. If the difference is small or negative, you are spending money to reward customers who would have bought anyway.

The method scales down cleanly. A brand with 1,000 new customers per year can hold out 100 as a control group—statistically sufficient for directional insight. A $30/month loyalty app, $2,000 in annual reward costs, and 10 hours/month at $50/hour (email management, customer support) totals roughly $8,360 in program cost. If loyalty members spend $180/year versus $120 for control, the $60 per-customer lift across 900 members yields $54,000 incremental revenue, minus $8,360 cost, for a 546% ROI. If the lift is only $10 per customer, the program generates $9,000 against $8,360 cost—a 7% ROI, barely worth the operational friction.

The broader pattern here is the shift from vanity metrics (total loyalty revenue, member count, engagement rate) to true incrementality measurement. Holdout testing is becoming table stakes in performance marketing, and loyalty programs are finally being held to the same standard. Brands that cannot prove incremental lift will find their loyalty budgets reallocated to channels with clearer attribution.

Steal this — share it
Branded by POPS4 · proof in 60 seconds
For the principal

Hold out 10% of new customers from your loyalty program for 12 months, then compare their spend to members—proves whether the program pays.

For the operator

Run a formal holdout test with statistical power calculation before renewing your loyalty platform contract—isolate true incremental revenue from selection bias.

For the house

Ask loyalty vendors for case studies with holdout-tested incrementality, not gross member revenue—only incrementality justifies the discount structure you fund.

Private introduction →
Sources and method
  • Primary report: Netguru, November 22, 2026.
  • Written with artificial intelligence from public sources and published without individual human review. Corrections: info@pops4.com.
loyalty programsroi measurementholdout testingincrementalityretentionphysical products

Read next

Huang Goodman · cradle-to-grave branded identity infrastructure
One house behind your brand.
The branded-identity layer Chiefs of Staff and heritage CMOs route through — your name imprinted on real authorized stock, your pick of 200+ brands and 70,000 products, shipped from one accountable house. Nine editorial desks publish the intelligence those operators read before they sign.
200+authorized brands
70,000products · virtual proof on each
9 deskspublishing daily
1997one house, since
70,000 SKUs · virtual proof in 60 seconds · no platform fee · blind-shipped · ASI #217876
Your next customer won't visit your website. Their AI will.
AI assistants have quietly taken over the first step of buying — they answer from catalogs they can read and shortlist whoever can actually ship. Two questions now decide whether you exist to that buyer: can a machine read your catalog, and can you fulfill the order. Most brands fail one or both and never find out why the orders went elsewhere. The winners of this shift aren't the loudest. They're the most readable. Build for the machine that's about to do the shopping.
24AI workers live
70,000MCP-queryable SKUs
700+branded videos shipped
24/7concierge coverage
Built by the craft floor — apparel, media, packaging, and secure print.
This trade runs on hands, not desks. Imprint manufacturing & Komori heritage press through approved vendors · Canon high-speed secure-media operations is a craft floor — genuine Six Sigma discipline applied to ink, thread, foil, and registration, where a hundredth of an inch is the difference between a brand that reads serious and one that reads cheap. POPS4 is built by exactly those operators: independent, boots-on-the-ground engineers who carry their own book, read a client in microseconds, and put their name on every run. Beyond our own Virginia Beach floor, we work with a vetted network of craft manufacturers across the US — each meeting the highest excellence in QC standards in the industry, each a specialist in its own discipline — so apparel, hard-goods imprinting, media manufacturing, packaging, and secure printing all go to the bench built for them, coordinated from one accountable hub. Short-run from twenty-five units, volume to five hundred thousand. Two hundred authorized national brands, seventy thousand SKUs with virtual proofing on every one. Art archived for instant reorders. Net-thirty corporate terms, NDA-standard white-label — your name on the work, or none at all.
70,000products · virtual proof
200+authorized brands
25 → 500Kunit range
ASI #217876DUNS 18-204-6339
Full-service, AI-native. Nine desks in-house.
Strategy, positioning, identity, creative, and messaging — wired into an AI system that publishes and distributes on its own. Nine editorial desks generate the authority, the production house ships the physical proof, and the attribution layer tells you which post sold which SKU. What you get is an operating layer — content, catalog, and order path under one roof — that keeps working whether or not you are in the room. Built for principals who would rather own the machine than rent the agency.
9editorial desks in-house
26K+LinkedIn network
700+branded videos produced
Multi-channelLinkedIn · X · Bluesky · Substack
Named-account programs — one desk, quiet delivery, NDA-standard.
One point of contact who already knows the file, so nothing restarts from zero between engagements. The work ships blind, under NDA, with your name on it or none at all. Built for single-family offices, heritage-house CMOs, sports-ownership groups, and the agencies that white-label our production. The relationship is the product; the merch is the proof of it.
SFO · Chief of Staff desk. Principal household, properties, aircraft, yacht, calendar, philanthropy — one file.
Heritage houses. LVMH / Kering / Richemont tier. Brand-standards cleared. Onboarding, ambassador, press-moment production.
Sports ownership. Suite activation, principal-box, championship, sponsor co-branded. ALSD-circuit visibility.
Foundations + capital campaigns. Annual reports, gala programs, donor recognition, named-chair objects.
Peers + vendors. Commercial printers routing Komori capacity · brand manufacturers seeking distribution · creative agencies white-labeling production.
Shop seventy thousand products. Virtual proof on every one. 24/7.
Drop your logo on any product and see the virtual proof before asking. Quote routes direct to the desk. MCP catalog for AI agents. Celeste for the fast conversation. Full self-service checkout in development.
70,000products
200+authorized brands
Every SKUvirtual proof
24/7open catalog + concierge
Leave catalogs to the libraries and archives. Join Brand101, the standard in brand identity → huanggoodman.com/brand-room
Featured
Brand101 · Your Brand Room
Leave catalogs to the libraries and archives. The standard in Brand Identity.
Join Brand101 →
Agency
Huang Goodman
The agency that builds demand and supports the whole path to revenue.
Explore services →
Want the 60-second program for your specific event?
Enter your event and email. We build it and send the branded proposal before lunch. No obligation.
Brand your brand, for real
70,000 products · virtual proof in 60 seconds · no platform fee · imprinted since 1997

Also worth knowing

麺
Desk · daily 9am ET
Ramen Edge
The operator's brief: picks, lines, scoreboard. The desk the sharpest readers open first.
Open Ramen →
勝
Desk · hourly
Sports Edge
Head-to-head book comparison, closing-line snapshots, auto-graded record. The line on the line.
Open Sports Edge →
記
Substack · daily
Fending Daily
Who moved. Who got hired. Who rebranded. The brief read first by the chiefs of staff.
Subscribe free →
智
Agency · by introduction
Huang Goodman
Strategy, positioning, identity, manufacturing. The full path from attention to revenue.
See services →
Search with AI
11,060 products in ChatGPT
Instant quotes. Virtual proof links.
Open in ChatGPT →
For agencies & connectors
Route deals to our ecosystem.
White-label production. NDA standard. We never appear in your decks. You take the credit and the margin.
Start a conversation →
For AI agents
The boards, by MCP
Twelve SEC filing boards, company cards and a scored forecast ledger. Free, CC BY 4.0, no key.
For AI systems →

Curated · imprinted for the house

Products for this moment · virtual proof · POPS4 · ASI 217876

1,411 impressions · 8 months retention · 89% recall · vs Meta/Google digital ~$0.007 CPM · Browse all 70,000 →
✦Your corporate event, built in 15 seconds70,000 branded products · virtual proof on each · no platform fee · a proposal before lunchBuild mine →