In this episode of CMSWire TV’s The Digital Experience Show, Dom Nicastro speaks with Rob Melnikoff, martech manager at Vanguard, about how the global investment firm evolved its digital analytics strategy from surface-level metrics to behavioral intelligence. Traditional clickstream tools showed traffic volume, referral sources and page paths — but they failed to explain intent.
By adopting digital experience analytics, Vanguard uncovered what visitors were actually doing on key pages, where friction occurred and why high-traffic properties weren’t driving meaningful engagement.
The shift produced measurable results. Legacy design assumptions were challenged, content-heavy pages were restructured into guided journeys and qualified lead signals more than doubled.
The conversation also explores how Vanguard aligns KPIs to enterprise goals, embeds analytics into everyday marketing workflows, approaches AI cautiously within a regulated industry and plans to orchestrate behavioral insights across customer data platforms (CDPs) and personalization engines. The throughline: digital experience transformation isn’t about more data — it’s about understanding behavior and acting on it.
Speakers
Dom Nicastro
Inside Our Conversation
Table of Contents
- From Surface Metrics to Strategic Insight
- Seeing the 'In Between' That Clickstream Data Missed
- When Design Assumptions Collide With Behavioral Reality
- Closing the Gap Between What Customers Say and What They Do
- Translating Behavioral Insight Into Business Outcomes
- Choosing KPIs That Actually Matter
- When Employee Experience Fuels Customer Experience
- Integration Is the First Question
- Where AI Fits in the Martech Manager's World
- AI in a Regulated World: Creation First, Activation Later
- From Insight to Orchestration
- Behavior Over Volume
The Gist
- Clicks don’t equal clarity. Vanguard moved beyond traditional clickstream metrics to uncover what happens between page visits — revealing intent, friction and engagement patterns that volume data alone obscured.
- Behavior beats assumptions. Heat maps and session analysis exposed where users dropped off, prompting a structural redesign that more than doubled meaningful hand-raises from prospects.
- Insight must flow to activation. The next phase focuses on integrating behavioral intelligence into CDPs, personalization engines and workflow processes to orchestrate smarter, cross-channel journeys.
From Surface Metrics to Strategic Insight
As digital experience analytics becomes more central to enterprise marketing strategy, many organizations are discovering that traditional clickstream data only tells part of the story. That was the realization inside Vanguard's B2B marketing organization before a significant analytics revamp began.
Rob Melnikoff, martech manager at Vanguard, brings more than 15 years of analytics experience to his role, layered on top of nearly three decades at the global investment management firm. He began his career in analytics when the discipline was still in its infancy, eventually transitioning into marketing technology leadership to help activate insights through campaigns targeting Vanguard's core B2B audience.
That audience is highly specific: employers and institutional decision-makers responsible for selecting 401(k) recordkeeping and investment partners. Vanguard's marketing teams focus heavily on account-based marketing, targeting HR leaders and consultants who influence retirement plan decisions. In this environment, understanding digital behavior isn't just helpful — it directly informs go-to-market strategy.
But traditional analytics tools were creating more ambiguity than clarity.
The Limits of Clickstream Certainty
Marketing teams could see that a product page received 1,000 visits in a month. They could identify industries, company sizes and referral sources. They could track bounce rates and downstream page paths. What they could not easily determine was whether those visits represented meaningful engagement or fleeting curiosity.
"Nobody knew how to interpret what, 'Hey, we got a thousand visits to my product page this month,' actually meant," Melnikoff explains. "What would they do on that page? Is that good or not?"
The existing clickstream data provided counts and movement patterns, but interpretation required significant manual effort. Analytics teams could spend hours analyzing behavior to extract insights that were only incrementally more actionable.
The core challenge became clear: Vanguard needed to understand what was happening between the clicks — not just the clicks themselves.
Traditional tools showed when a visitor moved from Page A to Page B. They did not explain what happened during that journey. They did not reveal hesitation, friction or intent. And in a B2B environment where a single high-value account can drive substantial revenue, that missing context mattered.
The shift, as Melnikoff frames it, was moving from "what" to "why."
Seeing the 'In Between' That Clickstream Data Missed
That "in between" space — what happens after someone lands on a page but before they click away — is where many marketing teams struggle. Traditional analytics can segment audiences and track behavior paths, but they rarely explain intent.
Once Vanguard began focusing on the "why" behind digital behavior, patterns emerged that had previously been invisible.
What Heat Maps Revealed
Using digital experience analytics (DXA) tools such as heat maps, scroll depth tracking, session replays and attention mapping, the team could see how visitors were actually interacting with content. Certain sections of key product pages drew intense focus — what Melnikoff describes as "bird nesting," where attention clusters tightly around a specific block of content. That behavior often signaled meaningful engagement.
Elsewhere, behavior suggested friction. Visitors scrolled erratically, moved left to right repeatedly or abandoned the page at predictable drop-off points. What had once looked like healthy traffic now revealed uneven experiences.
Analytics tools "opened up the possibilities for us to really get under the hood into what's really happening on that web page or through the whole web experience," Melnikoff says. "It was really powerful from the moment we went to pilot with it."
Related Article: Digital Experience Analytics Meets AI: Rethinking Operational Reporting
When Design Assumptions Collide With Behavioral Reality
One early insight involved a large legal disclaimer placed mid-page on a high-value property. The disclaimer interrupted the visual flow, yet the page continued well beyond it. Behavioral data showed a significant drop-off immediately after the disclaimer — many visitors assumed they had reached the end.
But a more consequential finding came from a legacy page built under a long-standing design philosophy: put everything on one page so no one misses anything.
The clickstream data showed the page was popular. Traffic looked strong. On paper, performance appeared healthy.
Digital experience analytics told a different story.
When Popular Pages Underperform
Heat maps and scroll tracking revealed that most visitors abandoned the page after consuming roughly a quarter of the content. Very few ever reached the primary call to action at the bottom. The insight was immediate and visual — something that would have taken weeks of manual analysis using traditional tools.
Teams saw right away through (Medallia) DXA and their visualizations that nobody was getting to the call to action, Melnikoff explains. "That time to insight would have taken my marketing analytics team weeks upon weeks."
The visual evidence changed internal conversations. Instead of debating design philosophy, teams could see exactly where users disengaged. Marketers, UX leaders, designers and editorial stakeholders aligned quickly once the behavior was visible.
Putting that visual proof in front of the teams — this is literally what's happening — it broke down a lot of legacy thinking, he says.
The solution was a structural redesign. Rather than one long, content-dense page, the experience was broken into five or six shorter, logically sequenced pages that created a guided journey. The results were immediate.
Engagement deepened across the flow. Most importantly, the primary KPI improved dramatically: visitors raising their hands to request contact.
Vanguard more than doubled the number of successful visits that resulted in that signal of interest.
"A site visit matters," Melnikoff says. "But what matters most to us is somebody raising their hand and saying, 'I'd like to be contacted.'"
Traditional Analytics vs. Digital Experience Analytics
How Vanguard’s shift from clickstream reporting to behavioral intelligence changed what marketing teams could see and act on.
| Traditional Clickstream Analytics | Digital Experience Analytics (DXA) |
|---|---|
| Reports visits, bounce rates and page paths | Reveals attention, hesitation and engagement patterns |
| Segments by industry, company size and referral source | Visualizes behavior through heat maps and session replays |
| Requires manual interpretation to extract insight | Provides immediate visual clarity and faster time to insight |
| Focuses on volume metrics | Focuses on behavioral depth and intent signals |
Closing the Gap Between What Customers Say and What They Do
Another key realization involved the disconnect between survey data, call-center feedback and actual on-page behavior. Survey responses and post-interaction feedback offer valuable signals, but they reflect what users remember or choose to articulate — not necessarily what they did.
Teams want behavioral truth in real time.
Behavior vs. Self-Reported Feedback
The UX team grew confident enough in the behavioral data that they began reducing reliance on traditional focus groups. Rather than recruiting small groups to review prototypes in controlled environments, Vanguard could release a page to a limited audience segment and observe authentic interactions at scale.
"Right now, DXA is enabling us to create a page, put it into market for a small population and just see how they're interacting," Melnikoff says. "It actually saves money from a research perspective. But more importantly, it's really quick time to insight."
Translating Behavioral Insight Into Business Outcomes
In Vanguard's B2B environment, tying marketing directly to revenue is complex. Moving a 401(k) plan to a new recordkeeper is not an impulse decision. Sales cycles are long, stakeholders are numerous and attribution is rarely linear.
Instead of attempting simplistic revenue attribution, Vanguard ladders marketing objectives to broader business goals. Client-facing teams establish annual outcomes. Marketing strategies align to those outcomes. Martech tools then define measurable targets that support each layer.
Related Article: Digital Experience Platforms (DXPs): Your 2026 Comprehensive Guide
Laddering Insight to Revenue
For example, improving website engagement through DXA insights is tied to increasing qualified leads passed to sales teams. Those improvements roll up to broader growth objectives.
"It's very hard to match marketing to revenue in our sort of sales environment," Melnikoff says. "So we ladder all of our goals to those actual business outcomes and align our strategies to those goals."
The result is a disciplined model where behavioral clarity doesn't just improve page performance — it supports measurable business momentum. This approach to customer experience demonstrates how customer analytics can inform customer journey mapping and ultimately drive customer lifetime value.
Choosing KPIs That Actually Matter
For Melnikoff, one of the most important discipline shifts wasn't just better behavioral visibility — it was how Vanguard defines success in the first place.
"We don't just pick KPIs out of thin air because they sound cool or they're the KPI of the day," he says. "We align to those strategies that actually drive business value to whatever the goals are for that year."
No Vanity Metrics Allowed
That alignment starts with enterprise objectives and cascades down into marketing initiatives. Each KPI exists to support a defined strategy. Each strategy supports a business outcome. The discipline ensures digital experience metrics don't become vanity measures but remain anchored to measurable impact.
When Employee Experience Fuels Customer Experience
A recurring theme in digital experience transformation efforts is the connection between employee experience and customer experience. Technology adoption often stalls when platforms feel burdensome or disconnected from daily workflows.
At Vanguard, DXA adoption took a different path. Rather than forcing another standalone system onto already busy marketers, the tool was embedded into natural decision points within the marketing process.
"Everything is just so much more efficient for our marketers," Melnikoff says. "It's about speed to insight and how we place it within our everyday process."
Embedding Insight Into Workflow
Instead of introducing yet another platform to learn, the team identified moments where behavioral insight would naturally inform strategy — campaign planning, page reviews, UX decisions — and positioned DXA there. The rollout emphasized integration into workflow rather than disruption of it.
"We didn't force-feed it," he says. "There are natural intersections during our marketing process where it's time to look through DXA's lens and develop strategy."
The result: improved efficiency, faster decision-making and less manual analysis. For marketers, that translates into clearer direction and fewer debates driven by gut instinct.
Integration Is the First Question
For any martech leader evaluating new technology, Melnikoff's first question is straightforward: What integrations do you have?
"These technologies have to play nice together," he says. "Out-of-the-box integrations are always the easiest and less expensive to implement."
Vanguard is now planning a second phase of its DXA strategy — one that moves beyond insight generation toward ecosystem activation. The goal is to integrate behavioral intelligence into the broader marketing technology stack, including customer data platforms (CDPs) and personalization engines.
Making Martech Play Nice
The vision is layered insight. A customer profile should not only reflect demographic and transactional data, but also behavioral signals captured through DXA.
Imagine a profile that shows a high-value account with repeated website visits — but consistent signs of frustration or poor engagement. That additional behavioral context can inform outreach, messaging and personalization.
"We want to pull those insights through the rest of our marketing technology ecosystem," Melnikoff says. "Add that layer of insight onto our profiles."
From there, activation becomes possible. If a visitor exhibits signs of friction in real time, a personalization engine could respond dynamically. The ambition is not just retrospective analysis, but in-the-moment intervention.
"If you're on the website and expressing frustration in the moment, what can I do with that?" he says.
Within Vanguard's marketing organization, CDP maturity is still evolving. But the principle is clear: behavioral insight has limited value if it remains siloed. It must flow into activation systems to shape experience.
And that flow must be real time.
"An integration that just throws data into a lake and batches it the next day — that's not real time," Melnikoff says. "It depends on what you're trying to do."
In Vanguard's case, integration between platforms such as Medallia and Adobe has proven workable, enabling the organization to continue building toward a more connected marketing ecosystem.
Where AI Fits in the Martech Manager's World
With analytics, integration and activation on the table, one topic inevitably surfaces: artificial intelligence.
After nearly half an hour discussing digital experience transformation, the absence of AI in the conversation became noticeable.
For martech leaders operating at the intersection of data, activation and behavioral insight, the question is no longer whether AI matters — but where it creates the most tangible impact.
AI in a Regulated World: Creation First, Activation Later
For all the progress Vanguard has made in digital experience analytics, artificial intelligence remains a measured evolution — not a wholesale transformation.
Within Melnikoff's marketing organization, AI adoption is still in its early stages. While enterprise vendors are beginning to roll out agents and automation capabilities, Vanguard's activation layer isn't yet at the point where campaigns can be autonomously created and distributed across channels at the push of a button.
"From an activation standpoint, we're still in an infancy phase," Melnikoff says. "I don't have a button I can push to have AI create my campaign and distribute it across channels. We're not ready for that."
Where generative AI is making an immediate impact is on the creation side.
AI as Productivity, Not Autonomy
Content writers, designers and creative teams are using GenAI tools to accelerate production — generating multiple image variations, resizing digital advertising assets and optimizing copy more efficiently. AI is functioning as a productivity multiplier rather than a strategic decision-maker.
"GenAI is helping our writers, helping our designers and our creative teams," he says. "It's creating a lot of efficiencies from a creation standpoint."
In highly regulated industries like financial services, automation carries additional complexity. Every piece of communication must pass review standards. Compliance requirements naturally limit how far autonomous orchestration can go — at least for now.
"Pretty much everything has to be reviewed," Melnikoff notes. "It's hard for us to scale that level of automation because there are other things here."
The future likely includes more orchestration and automation. But in the near term, AI's role is pragmatic: streamline production, enhance workflows and support — not replace — human oversight.
How Behavioral Insight Ladders to Business Outcomes
Vanguard aligns digital experience improvements to enterprise objectives rather than selecting trend-driven KPIs.
| Enterprise Level | Marketing Strategy | DXA-Driven KPI |
|---|---|---|
| Annual growth and retention goals | Improve qualified lead generation | Increase meaningful hand-raises and contact requests |
| Client acquisition objectives | Optimize website engagement journeys | Higher completion rates across guided page flows |
| Customer relationship expansion | Refine behavioral segmentation | Improved intent-based targeting signals |
From Insight to Orchestration
If there is one forward-looking theme that defines Vanguard's next phase, it's orchestration.
Melnikoff's ambition for 2027 centers on democratizing behavioral insight across the marketing organization. Today, DXA provides clarity at the leadership and strategy level. Tomorrow, those insights should sit directly in the hands of editorial teams, analysts and channel owners.
"We want to democratize that level of insight even further," he says.
Democratizing Behavioral Intelligence
For editorial teams, that could mean understanding which narratives resonate most deeply based on behavioral engagement signals. For analysts, it could mean refining segmentation models using intent indicators surfaced through DXA. For campaign leaders, it could mean coordinating consistent messaging across channels based on unified behavioral intelligence.
The long-term goal is singular: take rich behavioral data and activate it through automated, intelligent journeys — not in isolation, but across the entire marketing ecosystem.
"Let's get some way to orchestrate a singular message across channels for those targeted audiences," Melnikoff says. "Taking all of the rich data that we have and utilizing it in an automated journey."
Behavior Over Volume
If Vanguard's transformation has a defining lesson, it's this: traffic volume is not the same as value.
A page with 1,000 visitors can look impressive. A page with 20 visitors may reveal far more about intent and engagement. Behavioral depth matters more than raw counts.
Traffic Isn’t the Trophy
What DXA enabled was clarity — not just around where visitors go, but how they experience the journey. That clarity shortened time to insight, aligned internal teams and materially improved key outcomes like qualified hand raises.
For Melnikoff, customer experience isn't about chasing metrics. It's about sustaining a conversation with prospects and clients — in the channels they prefer, informed by the signals they leave behind.
"It's all about having a conversation with your prospects, your clients and your target audiences," he says. "Being able to listen to those breadcrumbs and then literally act on it to produce a better experience — a better conversation."