According to the a new Forrester Wave report, online testing technology is undergoing a rapid evolution where it is becoming a core competency of digital marketers, while leading online testing platform providers are starting to follow the lead of digital marketing vendors by offering functionality that support multiple channels and create consumer profiles.


Online testing is turning into a core digital marketing competency because of the valuable support it can offer optimization efforts. Advanced online testing solutions evaluate customer experiences against a control group using statistical data to help marketers determine how to provide an optimal customer experience.

In the report, Forrester Wave Online Testing Platforms Q1 13, Forrester identifies several “next generation” capabilities provided by mature online testing technology providers. These include distributed access to support a wide range of users who may not be technical experts (such as marketers) as well as to support the rigors of online testing activities, sophisticated multichannel testing capabilities, the ability to collect, store and distribute visitor data at a granular level, advanced testing scenarios that encompass multiple pages, domains and sophisticated success metrics, automated core testing processes and analytics and integrated suites of optimization tools.

Forrester identifies seven online testing vendors as standouts in the field. In order of rank, they are Maxymiser, Adobe, Autonomy, SiteSpect, Webtrends, Monetate and Optimizely. Following are summaries of Forrester’s review of each vendor, divided into the “Leader” and “Strong Performer” categories.

The Leaders - Maxymiser, Adobe, Autonomy, SiteSpect

Maxymiser receives top honors among all online testing vendors from Forrester due to its “consistently strong capabilities across all categories of online testing functionality.” In particular, Forrester singles out Maxymiser’s reporting and analysis functionality, as well as mobile and social testing. Furthermore, Maxymiser receives credit for focusing on the US market to the point of relocating executive management to New York despite being a UK-based company.

Forrester says users who need a balance of professional services and advanced technology will most benefit from Maxymiser, but cautions the vendor must “execute on its vision for comprehensive optimization and visitor data management” to maintain its category lead.