• Skip to primary navigation
  • Skip to main content
  • Skip to footer
  • 020 3330 7010
  • marketing@allresponsemedia.com
  • E-mail
  • Facebook
  • Instagram
  • LinkedIn
  • Twitter
  • YouTube
ARM logo

All Response Media

  • Home
  • About ARM
    • About ARM
    • Meet the Team
  • Our Services
    • TV
    • Digital
      • PPC
      • SEO
      • CRO
      • Social Media
      • Programmatic
    • Offline Media
      • TV
      • TV Execution
      • Press
      • Radio
      • Inserts
      • Door to Door Advertising and Opportunity | All Response Media
      • Outdoor
      • DRTV
    • Analytics
    • ARMalytics®
  • Success Stories
    • Client Success Stories
    • TV Star Competition UK
    • TV Star Competition NL
    • Our Work With Startups
  • Content Hub
  • Careers
  • Contact Us
You are here: Home / Strategy / Tackling effectiveness measurement post-pandemic

Tackling effectiveness measurement post-pandemic

16th June 2022 by Ed Feast

The DMA’s recent claim (that the 23% dip in marketing effectiveness is due to a failure to promote a coherent approach to measurement), assumes a causal link between the number of metrics reported (170 different metrics across 852 individual campaigns) and the overall success of the campaigns. 

The research is the second iteration of the DMA’s Intelligent marketing Databank, the first of which was released in 2021, taking entries to the DMA awards, much in the same way that the IPA does. 

The DMA’s paper concludes that the strong performance at the start of the pandemic, compared to a 23% decline in the late pandemic period, was due to a lack of focus on performance, brand, and business metrics, and lays the blame at the feet of what they term ‘vanity metrics.’ 

Below are some examples of the effects within each category. 

To argue a causal link, they would have to show a significant shift in the inclusion of each of the categories in the entries. This data is outlined below. 

At absolute best, they could argue a slight change in business effects and brand effects (I’d like to see 2017-2020 split out by year as well). But assuming that the delivery metrics are at fault for a 23% drop in effectiveness is a bit of a stretch. 

All Response Media viewpoint

 

Here’s what I think. At the start of the pandemic, people went bonkers for buying stuff. TV advertising was super cheap and people were sat at home bored wanting to spend the cash that they weren’t spending in the pub and on transport and kids’ clubs or filling their houses with stuff they probably didn’t need. 

That’s a much more likely reason for an increase in effectiveness at the early stages of the pandemic; for many categories, it was like shooting fish in a barrel. 

The other problem with this is that by criticising the campaign delivery effects, and calling them ‘vanity metrics’, they’re clashing swords with the dark lord of penetration*, Byron Sharp. If you’ve read ‘How Brands Grow’, you’ll know that metrics like reach and frequency of all category buyers is super important when it comes to winning market share. Particularly light category buyers. So these metrics should definitely be included.  

They’re also super easy to measure and therefore include on award entries, which is probably why they’re included in so many. It beefs up the entry and makes it look more scientific. 

In short, the range of metrics doesn’t matter at all. What does matter, is that you select metrics which are aligned to the commercial success of your business. 

If you know that increasing earned media value correlates with increasing monthly sales, then go for it. If a CPC reduction and increase in interest lift makes you loads of money, then go for it. Metrics should be specific to a business, which is why there are so many, and they should be linked to commercial success, proven through regression analysis, or MMM. 

*Credit: Mark Ritson 

Ed Feast
Director of Planning

Veronika Hulikova, Senior Econometrician, provides insight into measurement at ARM:

TV campaign measurement can range from methods using granular data at a second level through to weekly/monthly level data used more commonly with Marketing Mix Models. This allows for client teams to optimise campaigns using different variables, such as day part and spot length, through ARMalytics. This approach is also best used when addressing direct response TV campaigns with reliable KPIs such as New Visitors or Sales driven by TV campaigns.

To answer wider questions, we apply econometric methods that look at a more holistic overall effect to the same KPIs. This approach allows us to capture wider effects of campaigns that are not visible at such a granular level.

Using the same KPIs across all analysis gives us the ability to compare the effectiveness of multiple TV points. Starting from a granular level immediately after a spot, then at a daily level for the duration of the whole campaign, to even understanding the changes that occur over years.

Innovation is key when addressing media measurement as we are constantly able to gather more data and use new machine learning methods. The effectiveness of measurement ultimately depends on choosing the right methods for the questions that are being asked as well as using reliable KPIs that come from a clean dataset.

Veronika Hulikova
Senior Econometrician

FEATURED READS

Marketing effectiveness in the digital era

Could combining OOH and mobile be the way to go?

How much do you know about the ‘60/40’ advertising budget split? 

To find out more please get contact marketing@allresponsemedia.com to arrange a consultation.  
Speak to one of our experts

Subscribe For More

Newsletter Signup

Footer

ARM logo

The Leading Performance Media Agency

Building businesses and brands by providing clients with an Unfair Competitive Advantage.
ARMalytics®

Get In Touch

London: Sutton Yard, 65 Goswell Road, EC1V 7EN
Phone: +44 (0) 20 3330 7000

Leeds: Marshalls Mill, Marshall Street, LS11 9YJ
Phone: +44 (0) 20 3330 8050

Amsterdam: Koivistokade 3, 1013 AC
Phone: +31 6 3761 9020

marketing@allresponsemedia.com

Privacy Policy | Cookie Policy | Modern Slavery Policy

  • E-mail
  • Facebook
  • Instagram
  • LinkedIn
  • Twitter
  • YouTube

Our Newsletter

Subscribe to receive exclusive media insights straight to your inbox. We respect your privacy.

Newsletter Signup

We are using cookies to give you the best experience on our website.

You can find out more about which cookies we are using or switch them off in settings.

ARM logo
Powered by  GDPR Cookie Compliance
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies

These cookies are essential to provide you with services available through our website and to enable you to use certain features of our website.

If you disable this cookie, we cannot provide you certain services on our website and we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

Analytical and Performance Cookies

These cookies are used to collect information to analyse the traffic to our website and how visitors are using our website.

For example, these cookies may track things such as how long you spend on the website or the pages you visit which helps us to understand how we can improve our website for you.

The information collected through these tracking and performance cookies do not identify any individual visitor.

Please enable Strictly Necessary Cookies first so that we can save your preferences!

Advertising and Targeting Cookies

These cookies are used to show advertising that is likely to be of interest to you based on your browsing habits.

These cookies, as served by our content and/or advertising providers, may combine information they collected from our website with other information they have independently collected relating to your web browser's activities across their network of websites.

If you choose to remove or disable these targeting or advertising cookies, you will still see adverts but they may not be relevant to you.

Please enable Strictly Necessary Cookies first so that we can save your preferences!

Cookie Policy

More information about our Privacy Policy and Cookie Policy