Are you basing your online marketing plans on the latest benchmark study? What on earth for?
A.G. Lafley and Roger Martin explain why this is foolish in Playing to Win:
Every industry has tools and practices that become widespread and generic. Some organizations define strategy as benchmarking against competition and then doing the same set of activities but more effectively. Sameness isn’t strategy. It is a recipe for mediocrity.
Benchmark studies can be interesting sources of inspiration and ideas. But they’re not a how-to manual, and you certainly shouldn’t measure yourself against them. You should be doing what’s best for your audience, not aping what your competitors are doing with theirs.
As Flint McLaughlin puts it, “best practices on the internet are typically pooled ignorance.”
A/B split testing is done even when they don’t even have traffic (or conversions)
Tests are not based on a hypothesis
Test data is not sent to Google Analytics
Precious time and traffic are wasted on stupid tests
They give up after the first test fails
They don’t understand false positives
They’re running multiple tests at the same time with overlapping traffic
They’re ignoring small gains
They’re not running tests at all times
In my experience, the first, fourth, and tenth mistakes are easiest to make. I’ve made them myself in my impatience to get a result, my desire to just “try something,” or my desire for a big lift.
But cutting corners to get a big lift as quickly as possible doesn’t teach you anything you can use in the future—and learning is the most valuable takeaway from any test.
Upworthy succeeds in driving piles of traffic not because because it uses some sophisticated new technology.
Upworthy succeeds because it recognizes that its readers are human beings, not abstract “traffic” or “eyeballs.” This is an old technique applied to the web.
Upworthy has mastered the dark viral arts with a unique blend of A/B technology and lily-white earnestness. The staff scours the Web for “stuff that matters,” writes multiple headlines for a test audience, selects the top-performer, and blasts it out on social media. It’s a deceptively simple plan that’s devouring the Internet, one Facebook Newsfeed at a time. The site nearly surpassed 50 million unique visitors in October, which suggests traffic comparable to giants like Time.com, and Fox News. …
What’s the “secret”? An entertaining slideshow of Upworthy’s headline-writing strategies last year repeatedly references the “curiosity gap.” The idea is both to share just enough that readers know what they’re clicking and to withhold just enough to compel the click.
With me, however, there were fewer paths that could lead to the mother lode: my laptop, email, bank, social media accounts, and home. Once in, though, his team found few firewalls protecting my data, and mostly in the form of a pastiche of passwords and log-in credentials. These, I quickly learned, were not secure.