Posts Tagged ‘Measurement’

[Ad Age] It’s New Media, But You Can Measure ROI Using Old Tools

Thursday, March 8th, 2012

This is a cross-post of an article originally published here on AdAge.com

What would happen if you submitted a marketing plan without a bullet-proof measurement strategy? You’d see a suddenly surly CFO fire it back to you in a body bag. He or she wants to see evidence that you’re making a sound investment for the business. A CFO won’t make decisions without reliable metrics based on time-tested performance indicators.

So why do so many sane, rational marketers think they’ll get a pass when it comes to social media?

Since social media first stormed into town and changed the rules of marketing, some of the savviest marketers have believed that they needed to change the rules of measurement to quantify its impact on business. On the surface, it makes some sense. “Social” was a new conversational media that marketers couldn’t control. Peers, not marketers, were a primary influence on brand perceptions and purchase decisions. A brand could create positive buzz by doing something outrageous online or by pushing out viral videos and hope they took off like the next subservient chicken. How do you apply traditional measurement metrics to that?

Marketers said it was the “engagement era” and traditional marketing measurements practices were no longer sufficient. New measurements were needed and it wasn’t long before metrics on conversations, engagement, influence, fans, followers and “likes” were the ROI justifications on every marketer’s media plan.

Social marketing has come a long way since then. Brands are effectively cultivating communities, engaging with advocates and developing shareable experiences to influence product sales. Social is a serious marketing focus — it requires investment in resources and partners to do the job.

The problem is that CFOs aren’t impressed with engagement. Likes, and the like, represent value, but not ROI. ROI is a financial metric and it must be stated in dollars and cents. There’s no column on the balance sheet for likes. Likes are the new click-through rates –- an abstract statistic that really makes sense only to the resident digital-media guru.

Engagement is a wonderful thing and it should be measured, but for marketers it’s simply a means to an end. Marketers using social media to promote a product need to track how their efforts are driving people into the store to buy it. What gets measured gets funded. If you think social is driving sales for your business, you’d better start measuring it in a way that CFOs care about so you can do more of it.

Correlating social to sales and revenue isn’t easy. Neither are radio and TV, but they are evaluated every day by the most sophisticated brands in the world using measurement practices that have been proven over decades. Two of these practices, Matched Panel Tests and Market Mix Modeling are perfect for determining the sales and ROI of social for consumer products sold at retail.

The Matched Panel Test concept is simple. Two similar U.S. markets are selected and people living in one of the markets are exposed to a social-media program. A measurement firm like SymphonyIRI measures sales of the product in the market and removes the influencing variables to isolate the sales lift caused by the social marketing. This type of test can be applied to many different types of social-media programs, provided the marketer has some geographic control over where the program will run.

Some emerging practices incorporate retailer loyalty cards into Matched Panel Tests and analyze purchases right down to the individual household level. This can give you a precise view of ROI, as well as a wealth of insights on who buys your products, what else they bought at the same time and if they’ve returned to buy it again.

Another time-tested method is Market Mix Modeling, considered by some to be the gold standard in media measurement. It’s usually conducted annually by firms like Nielsen to determine the financial impact each marketing activity has on sales. With the right level of data granularity, social marketing can be picked up in the model for an apples-to-apples comparison alongside every other marketing tactic.

Based on BzzAgent’s experience using these practices over several years for some of the biggest CPG companies, we’ve seen that social marketing is highly cost effective. On average, it generates a return of $1.50 for every dollar spent. In some cases, the ROI from social marketing has been the most effective component of a brand’s media mix.

With these practices, your social-measurement strategy can be exceptional, not an exception to the rule. Trusted measurement companies such as Nielsen, SymphonyIRI, dunnhumby (BzzAgent’s parent) and others are applying the same sophisticated analysis to social that is being used on all other media investments. Not only does this prove you can measure the business impact of social marketing in financial terms, it proves that when it’s done right, social can be a very profitable sales channel. And that’s something that will make even the most hardened CFO smile.

Looking for the ROI of Social? It’s $1.50

Monday, January 23rd, 2012

For every $1 spent, social marketing returns an average of $1.50. That’s what we found after analyzing results from all the Market Mix Modeling (MMM) studies conducted on BzzAgent social marketing campaigns for several of the world’s leading CPG companies.

(Here’s the press release on the study)

The MMM studies were conducted on 21 campaigns by top measurement firms including Nielsen, Genpact and Foresight ROI between 2009 and 2011. We’d love to be able to discuss the companies involved, but as you can imagine, they hold their ROI cards pretty close to the vest. They are valued clients and we respect that. We can say that they are all large CPG companies, including 3 of the top 10, with products sold at retail nationally.

An average ROI of $1.50 for social marketing is great validation about the financial impact social can make on a business. In some cases, the studies have shown that the ROI has been as effective as anything in the brand’s marketing mix. It’s important to look at ROI in the big picture. We know that ROI analysis practices can differ in every company.  So a lower ROI may still represent a very successful campaign when evaluated in the context of the overall marketing plan.  The great thing is that sophisticated analysis like MMM enables you to do that.

If you are not familiar with MMM, it’s considered the gold standard in media measurement. Some of the biggest marketers in the world use it to quantify the drivers of business performance across all marketing channels and activities.  It is a comprehensive process led by specialty measurement firms and it is usually conducted once a year.

What does this all mean? Two things:

1. Social ROI Can Be Measured Accurately.  Social marketing can be measured using the same sophisticated analysis used on all other media investments. Marketers don’t need to make up new metrics or rely on inexact assessments of influence and engagement to evaluate business impact.  Social can be measured apples-to-apples with other media in the marketing mix.

2. Social is an Effective Sales Channel.  We’ve always known that social media has a tremendous influence on our purchase decisions, but its actual business impact has been unclear.  When social marketing is focused on product attributes, with the right targeting, cultivation and measurement practices, it can be a highly effective sales channel for brands.

Social media is used many different ways in an organization. Each department has their own communication goals, so their metrics of success should reflect that.  If you are in marketing and looking to support the sales effort of the company, then social media can be an effective tool for driving sales.  With the right practices, it can be managed and measured the same way you evaluate marketing investments in every other media format.   As we’ve seen from this data, often its social media that comes out on top.

3 Ways to Put ROI in Your New Year’s Resolutions

Monday, December 19th, 2011

This is a cross-post from our blog here on iMediaConnection.

Every marketer using social media to generate new business should have ROI high on their New Year’s resolutions list this year. Social media has grown up and it’s time for its measurement practices to do the same. We’ve been measuring success based on fuzzy metrics of engagement and influence long enough.  Calculations like return on engagement, return on trust and viral coefficient are great for showing value. But value is not the same as units sold, revenue and ROI.  Business impact is a financial metric, and it must be reported in financial terms.

Data on purchase intent does not cut it in statistical models. The analysis must accurately measure isolated campaign impact with valid and industry-proven methodologies.  Measurement at this level is sophisticated and must be conducted by someone without a horse in the race.  Actual purchase data can be collected from retail loyalty cards and third-party measurement firms to provide the validation needed.

Measurement firms have taken proven analytic testing processes and applied them to a digital medium. Since these are proven methodologies, they give marketers confidence in the results that they are going to see.  Here are three ways to measure the sales and ROI of your social shopper marketing program.

1. Loyalty Card Matched Panel Tests

Measuring sales based on actual household purchases made with retail loyalty shopper cards closes the loop and provides data on your sales and ROI.  This household-level view of purchases provides a robust understanding of consumer purchase behavior. Companies like BzzAgent’s parent company dunnhumby manage shopper card programs for many of the world’s largest retailers. When card holders involved in a social marketing program make a purchase, marketers can connect the dots back to their social media activities. This not only measures purchases made by the customer, but it quantifies the influence they had on others around them.

Studies of purchases from households exposed to the social marketing campaign are compared with a control group of households not exposed to it. If the footprint of the retailer is significant enough, tracking social media sales with loyalty card transactions will be an excellent representation of your sales impact and ROI.

2. Matched Market Analysis

Matched Market Analysis looks are store level transactions. Analytic companies like SymphonyIRI use a two-celled test and control approach to measure sales lift between two geographic markets. For a social media campaign, two markets with similar characteristics are selected. People living in one market are exposed to a social media campaign and people in the other market are not.

With this level of detail, measurement firms apply statistical techniques to match store-to-store sales data to isolate the sales impact of the social media effort. Even though social media sharing occurs nationally, there is a sufficient concentration of people in the individual’s local area. Some variables can’t be controlled in the test. One of them is price and promotion. For example, if coupons are tripled at Massachusetts supermarkets but not in Los Angeles, the measurement firms adjust the data for this variable.

3. Market Mix Modeling

Market Mix Modeling (MMM) allows marketers to look at the big picture of a brand’s marketing.  Firms like Nielsen analyze media effectiveness across channels to evaluate every element of the marketing mix.  The analysis is able to distinguish sales volume from marketing compared to just being on the shelf. The results demonstrate the sales volume and ROI from each media channel. MMM studies are usually conducted annually to keep a pulse on the changing trends in marketing and media effectiveness.

With the right data collection practices, social marketing data can be analyzed in these models.  Since social is typically a smaller media investment, it can be obscured by the large footprint of television or other media. Keys to getting social media to register in a MMM study include variation and granularity of the impressions over time. Discussion data must include weekly impression volume on a market level.

The results have been impressive. BzzAgent analyzed the social marketing ROI from a variety of MMM studies and found that for every dollar spent, social marketing returned an average ROI of $1.56. That’s on average.  For some products, the ROI reached as high as $4.19.

A Resolution That’s Easy to Keep

Studies show that people who explicitly make resolutions are 10 times more likely to attain their goals than those who don’t.  Start the year off right. Resolve to evolve your social marketing measurement practices in 2012 and you’ll develop a habit that can change your business.

3 Reasons Businesses Aren’t Measuring Social

Saturday, October 22nd, 2011

Despite a growing focus on social media practices in marketing, a majority of companies are unable to measure what’s going on around them.  According to Adobe/Econsultancy’s Quarterly Digital Intelligence Briefing, only 31% of companies are measuring social media engagement, and 55% said that it’s “very difficult” to execute.

The report cites 3 challenges to measuring social media accurately:

1. Too many sources – Social conversations happen in a lot of different places.  Once upon a time, it was all about blogs and message boards.  Now you’ve got several massive social networks and a number of new venues such as Quora to monitor as well.

2. Inaccurate Data – Privacy controls prevent full monitoring of customer conversations. Additionally, the viral nature of sharing creates challenges for accurate measurement of consumer voices.

3. Internet Slang – Not only does internet jargon keep evolving, different web communities have adopted their own dialects and standards for informal communication. Developing the tools to monitor these changes and keep track of new linguistics require human expertise and expensive software.

But are these the right things to be measuring in the first place?

Companies are placing too much emphasis on brand monitoring and reputational issues such as brand health when they should be focusing on business objectives like sales and ROI. Creating and maintaining a good reputation is certainly important to the success of the business, but that must be measured against hard data about conversions and sales through different campaigns.

.

BzzAgent Featured in SymphonyIRI Case Study

Friday, September 23rd, 2011

Why is this woman so happy? She knows that thousands of women just like her in a BzzAgent program helped increase sales for a new hair care product line by 17%.

This is the topic of a new case study published by the measurement firm SymphonyIRI. The case study “Sales Shine with Social Marketing presents the story of a recent BzzAgent social marketing program that was measured by SymphonyIRI’s Matched Market Analysis.

This is a great example of how social marketing can impact sales results. Over 10,000 women from BzzAgent’s consumer network sampled the new line of hair care products. We provided them with the product, information about its benefits and samples to share. Guided activities encouraged them to get the word out in-person and online across their social networks.

To measure the sales impact attributable to the campaign,  SymphonyIRI conducted a Matched Market Analysis to compare the sales impact between two selected geographic markets. Here’s what they found:

SymphonyIRI Group determined the BzzCampaign was highly effective at driving sales. When analyzed during a 13-week period, the analysis markets saw a volume sales lift of 17%.

Check out the entire case study. It can be downloaded (and shared) here: HairCare DMS Success Story

It’s Time to Take the Moneyball Approach to Social Media Marketing

Thursday, July 21st, 2011

I loved Michael Lewis’ book Moneyball when it came out back in 2003. Not just because I’m a baseball fan, but because it is a fascinating look at how breaking old thinking and applying new metrics can improve efficiency and generate better results.

Moneyball was written about baseball. It shows how the Oakland A’s took an analytic approach (see sabermetrics) to evaluate players when everyone else was going off hunches and generalized stats. The A’s were a small market team with a limited budget. To compete, they had to be smarter. They stopped thinking about buying players and focused on buying runs. By making decisions based on organizational productivity, they built a winning team at a fraction of the cost.

Some have called this the best book on marketing that’s not about marketing. I’m one of them. Articles and posts applied the principles of the book to the concept of “Moneyball Marketing” where new technologies enable marketers to be smarter about their media planning and optimization. At the time the book came out, paid search was changing digital media and the new science of marketing was becoming just as important as the art.

Now its 8 years later and a feature film about the book is coming out next month. (see the trailer, it looks real good) Everyone is talking about Moneyball again, but a lot has changed in that time. Most baseball teams now have sabermetric analysts on staff and marketing departments are driven by ROI analysis.

But why don’t more companies take the same approach to marketing in social media?

There are a million ways marketers can spend a lot of time and money in social media. New platforms and tools are popping up, existing ones are evolving and there are communities on just about every niche topic. Consumers are just as varied. Many follow brands quietly, other are looking for freebies, while some can be valuable and influential advocates for your brand.

Without reliable analysis, how do you determine where to spend your time and money? A lot of companies do it based on their gut, personal comfort levels and general metrics without a lot of meaning. The fact is tools and practices are in place for measuring advocacy, sales volume and ROI.

These are the Moneyball metrics of social media marketing. Improving these metrics for your brand improve your marketing efficiency and generate more sales wins.

Creating credible Brand Advocates and other Buzz

Thursday, June 30th, 2011

This is a cross post of an article appearing here on the Better Business Banter blog.

I recently spoke with Dave Balter, serial entrepreneur, CEO of BzzAgent, and radical agent of change in loyalty marketing. We focused on the characteristics of loyalty based marketing, the Net Promoter Score, and how to establish trust with customers.

For those who dont know, BzzAgent is a social marketing company that accelerates word of mouth to drive sales. Powered by a network of over 800,000 people, BzzAgent creates measurable business results for marketers through an influential advocate network, a powerful engagement platform, and a proven analytics approach. BzzAgent has been at the vanguard of word of mouth marketing since 2001, running more than 1,500 programs for global companies including Unilever, Wrigley, L’Oreal, and Michelin. They were recently aquired by Dunhumby, a division of Tesco, for close to $60MM to reinforce their social media marketing and analytics.

Here are some highlights of our conversation:

1.a BzzAgent focuses on a set of BzzAgents who are opinion makers and brand advocates in almost every social demographic. What are the characteristics and behaviors that you believe make a successful BzzAgent that best encourage product trial?

Dave: Our network has expanded to north of 800,000 individuals across the US, UK and Canada, and over the course of 2,500 programs, we’ve noticed some interesting trends.

We tend to find advocates aren’t classified by demographic data (or geographic!) but rather by personality type and what I’d call “product consciousness”. On the personality type front, we’ve done a number of studies on the subject, and we’ve found that advocates tend to be people who communicate for fun or altruism. One interesting data point is that advocates tend to share opinions about products and services as a way to relax (think of sharing with friends at a book club or over drinks). [Check out BzzAgent’s whitepaper on the characteristics of Brand Advocates]

On the “product consciousness” front, an advocate is someone who will pro-actively speak or share their opinion about a brand. In order for that to be authentic, the individual needs to have recognized their relationship with the product or service. In essence, they need to be aware of how much they like the product, which is often through very specific experiences that creates the willingness to share. Often an advocates will share their experience, not general information about a product or service!

1.b. Do these characteristics change depending on what type of product or social group you are targeting?

Dave: There are products that are likely to generate proactive sharing, and others that are reactive. For example, you might feel comfortable just telling a friend out-of-the-blue about a great new soda or a fragrance or even a cool digital service, which is an example of proactive sharing. It wouldn’t feel abnormal to the recipient of their friend talked with them about these products.

Reactive sharing often has to do with products or services that we don’t talk about as openly. That might be what credit card you use and why, or your insurance or highly personal products like feminine hygiene or an anti-anxiety drug. Sharing in these cases tends to happen once someone has sought out an opinion, but it may feel awkward to share about these products without being asked about first.

2. BzzAgent focuses a lot on measuring ROI of the campaigns it manages, especially around the # of conversations, new trials, and coupon usage. Do you ever go back and look at long term behavior and brand “stickiness” long after the campaign has finished?

Dave: We’ve focused on the ROI of social marketing for many years, and in the past few years we’ve seen some major breakthroughs. Specifically, we’ve been measuring programs using third-party Market Mix Models from companies like Nielsen and SymphonyIRI, which uses regression analysis to prove which marketing vehicles are driving what return – as well as Matched Market Panels, which compares return across an active market vs. a market without a program running. We’re proud to say the results are really dramatic – social marketing can be measured all the way to sales.

The future of measurement for social marketing will be to tie social to shopper marketing – in essence, measuring results via in-store purchase behavior. We recently were acquired by dunnhumby and you’ll see some significant evolutions of our models based on our ability to measure individual shopper behavior.

With all that said, yes we do go back to look at overall long-term brand behavior. This is valuable information about the value of an advocate over time, which can be immensely beneficial to a brand. That said, we really focus on more direct ROI as the key measurement for our programs. [Check out more whitepapers on how BzzAgent calculates the value of word of mouth, traditional advertising communications, and social media ROI]

3. A lot of companies focused on customer loyalty leverage the Net Promoter Score (NPS) in addition to customer satisfaction. What are your thoughts on NPS as a reliable measure of customer loyalty and what other measures do you look at to determine the health of a brand among consumers?

Dave: Truthfully, we think that NPS is an interesting metric, but is often misused and rarely provides enough deep insight to help companies engage and activate brand advocates. I’m a big fan of the concept, but think it’s best served as a way to evaluate whether your employees are happy or what your clients think of you than a measurement of brand advocacy.

4. One of the Principles of BzzAgent that you and your team established is “Making marketing a better place for marketers and consumers”. Where do you think the concepts of customer relevance, value and integrity break down in today’s more traditional marketing process?

Dave: We do see a landscape shift here, in most cases for the better, but there are still some abusive tactics going on. To the better, I think companies have started to really invest in their consumers by talking with them more directly via social media and engaging more quickly and efficiently. The days of the complaint letter are long over. Companies are recognizing the need to listen more often and more closely. Think Best Buy’s Twelpforce as a good example of the benefit to the consumer (better customer service) and to the company (solving problems more efficiently).

I still see quite a bit of abuse though – I’m particularly concerned with the continued attempts to place ads in every single place possible. We’ve got ads on taxi tops and at urinals and laser-displayed on the sides of buildings. Recently I noticed a company that was trying to embed ads into your apparel. For consumers, there just isn’t anything valuable about this – I don’t really believe the argument that this helps each of us become more informed. We’re now in a marketplace where the consumer gets informed by using the tools at their disposal (google, review sites, asking peers!, etc.). Marketers need choices that allow them to market in ways that the customer respects.

5. Are there any brands that you believe are doing a great job in engaging their customer and driving loyalty? What do you think they do that is so successful?

Dave: Well, any BzzAgent clients, of course!

Seriously, I’m a big fan of brands that embed loyalty right into their product. For my daughter’s 6th Birthday, I took her to the American Girl Doll Store, which could be one of the most impressive cases of creation of loyalty I’ve seen. These folks make the process of buying a doll an event to be remembered from the way they display the choices, to the way the staff is trained to share in the joy of the event (they gave my daughter a birthday sticker and the everyone on the staff went out of their way to wish her a happy birthday). Each doll comes with a special tag that allows you to create a digital version of your doll – a wonderful tactic to engage beyond the first experience…and maybe help parents spend just a little bit more with them! With a reservation, you can have a meal in the store, where they provide mini seats for the newly purchased doll, complete with mini teacup and saucer, crown and all sorts of other knick-knacks.

I think the code American Girl has cracked is the idea that it’s not just about the product, but about everything you do around it that counts.

6. Twitter seems to be the last big social media platform to arrive on the scene that filled an unmet need for a significant audience, coupling short content with the opportunity for celebrity or anonymity as followed and followee. What are some new or undiscovered social media approaches and companies that you think promise to be disruptors in the years ahead?

Dave: I’m paying a lot of attention to the reputation management space right now. I’m involved with a company called Smarterer (http://www.smarterer.com) which allows people to get scores on their digital, social and technical skills. Of course, people can then put their scores in places that matter. About.me is another in a similar vein where you can create your online bio in a way that really represents who you are. My sense is that part of the future will be people’s ability to really articulate who they are more effectively across any of the social media or digital platforms that comes along.

BzzAgent’s Sausage Fest at the School of WOM

Monday, May 2nd, 2011

WOMMA’s School of WOM event is next week in Chicago and it’s going to be one big sausage fest.  That’s because BzzAgent is throwing a party with some of the best tasting sausage, German beer and entertainment in the city.

If you are attending the School of WOM event, stick around the Swissotel after the sessions on the 10th for a taste of Oktoberfest in the spring. We’ll have hands-on sausage making demonstrations, a hopping beer hall, and just about all the German food you can eat.  Rumor has it there will even be a dancing exhibition that everyone will be tweeting about.

We aren’t just there for fun and games though – BzzAgent will also be leading an educational session with our friends from Symphony IRI.  The session, “The Naked Truth About Social Media ROI”, is an expansion of our popular ROI ebook.   J.P. Beauchamp, SVP, Consumer & Shopper Marketing at SymphonyIRI Group will join our own Malcolm Faulds and Steve McLaughlin for this new session on how CPG companies and large brands are using measurement practices like matched market testing and market mix modeling to measure social media sales.

Check out the event site and circle May 11th at 10:30 am on your agenda so you don’t miss this class.  Extra credit will be given to anyone showing up in their lederhosen from the party the night before.

Who says school can’t be this much fun?

New Webinar: Measuring Social Media ROI

Monday, January 31st, 2011

Lets talk ROI.  Social media is more influential than any other type of marketing and we’ve got a ton of experience measuring the sales impact and ROI for clients.  We’ll be sharing our insights and discussing case studies from these programs in a new webinar on Feb 10th.

So if you are struggling with the best way to measure the ROI of your social media marketing, or if you just want to see some better results, join us on the 10th.  Even if you are skeptical about how social media ROI can be measured, lets talk about it.  We’ll have our best marketing and measurement people on the line to talk about it in great detail.

Free Webinar: The Naked Truth About Social Media ROI
Thursday, February 10 at 2pm EST
Reserve your place today at: https://www2.gotomeeting.com/register/628826539

We want this to be a lively and interactive session so bring your questions.  Got something specific you’d like us to address, post is here.

Driving Starbucks Sales with Social Marketing

Wednesday, December 15th, 2010

BzzAgent worked with Kraft and Starbucks to promote their Pike Place Roast blend in grocery store. The program was such a “venti” success, we created this video case study:

BzzAgent’s program with Starbucks is featured in the Forrester Research report “Three Ways To Find, Create, And Energize Advocates” as an example of how brand advocacy in social media can drive business results. Forrester subscribers can get the reports here on their site.  You can also see Augie Ray’s summary of the report on his blog.

This was a fun project for a bunch of latte lovers like us. We tapped our Agent network to identify thousands of people who buy coffee in the grocery store and consume it at home. In addition, we identified Twitter users with high influence scores and who have tweeted about coffee at least 10 times in the last 60 days.

They all received samples of the product, training on our code of conduct and activities that encouraged them to share their experiences across the web. As you saw in the video, the 8,000 people in the program started a robust dialog on Twitter, Facebook, YouTube, blogs and on Amazon that reached over 1.5 million people. Share of voice online shot up and over 120,000 new customers were created.