SocialA guide to testing your paid social ads to enhance ROI

A guide to testing your paid social ads to enhance ROI

While display and paid search ads have their place in every digital marketing strategy, social media advertising is often an overlooked paid channel.

While display and paid search ads have their place in every digital marketing strategy, social media advertising is often an overlooked paid channel.

Paid search is great at capturing user intent, but is a poor channel for proactive targeting customers, feeding the top of the funnel

before the user has the purchasing intent. With click through rates from Facebook ads more than eight times better than paid search, there is definitely an opportunity to move some of your advertising spend onto social but it is important to utilise ad testing in order to maximise your ROI.


This post is split into three sections; the theory behind advert testing; the specific elements which can be tested along with which ones deliver the greatest benefit and; a useful list of actionable insights we’ve developed from personal experience.

We’ll focus mainly on Facebook as it is the by far the biggest platform, and it provides the most elements which can be tested.

What is a paid social test?

Split testing is the main competence utilised in paid social advertising which allows you to measure the ROI from your campaigns.

Split testing compares two versions of an ad or campaign, with only a single element changed between them. This allows you to measure the performance of the opposing elements and keep the one which is working.

To properly determine a winning element, it needs to achieve statistical significance i.e. the probability that the relationship between variables is caused by something other than random chance and will be repeated.

This is an important concept to understand. If we flip a coin twice and it lands on heads both, we cannot assume that the likelihood of heads being 100%, as the sample size is too small; we know that the odds of this happening is 1 in 4. At which point are we confident with the result we get? What’s the probability of getting no tails should the coin be fair?

In this example it is at 25%, when significance is normally assumed at 5% or less, so we can see that this is not a significant test, we would need 5 consecutive heads in order to prove significance because only 3% of experiments on a fair coin will yield the results we see.

Statistical significance is complicated to work out when sampling size varies between testing pots, so I would just go ahead and use this tool to make it easier.

Which elements can be tested?

Now we have the theory, let’s expand a bit on the actual elements we should be testing on social media platforms.

There are a large number of elements which can and should be tested; imagery, titles, copy, ad type, bidding, target audience, etc. If we want to test three images with three titles, three different bits of copy with three different ad types that’s already 81 separate adverts which need to be created (3 to the power of 4).

You will also need to pump enough budget into each advert to achieve statistical significance. We would recommend starting small with only a few tests at once.

The below list is in ascending order by impact to ROI of change:


  1. Image – Image testing provides the greatest potential gains. You’ve got loads of variations you can test here; ad image vs text overlay; featuring a human vs not; close up vs wide shot.



  1. Headline – A whole blogpost can go into how to craft the perfect headline but the fundamentals of this article will still ring true. No matter how carefully you have crafted your headline, it could still fall flat on its face. You need to be testing always; test punctuation, call to action, industry ‘lingo’, capitalisation, branding vs non branding, specifics vs generalities, are you expressing urgency?



  1. Placement – On Facebook you can choose between Facebook news feed, mobile news feed or right hand column, as well as Instagram and the Facebook network. We tend to see the best results from the desktop news feed followed by mobile, but that is not to say your audience may respond better on Instagram, or there might not be potential in the right hand column.



  1. Landing Page – I have seen enough ad campaigns fall flat on their face through poor landing pages which do not match the messaging on the advert. Without a custom landing page, users will be left confused as to why they landed on the page and they’ll probably bounce quickly, killing your ROI. Your headline, imagery and call to action all must sing in tune with your ads.


  1. Post Text – Most people don’t get as far as reading the post text so this is one of the less important elements to test. You still want to make sure it ads value to your ad but I wouldn’t hide any important information in here that will entice clicks – try to expand on your headline here.



  1. The Call-to-Action Button – This element is pretty low on your priorities to begin with but it may be useful once other elements in your testing have been exhausted.



Ad Targeting:

  1. Country/ location – If you’re using multinational targeting it is definitely worth splitting it down by country. Your adverts will probably need to reflect the changes here too though, so it isn’t the easiest element to test. Remember, you’ve also got the opportunity to break down your targeting by people living in the location, or people recently in the location – though these aren’t always the best options to test.


  1. Gender – Splitting by gender is the second most important targeting option here. If your product is gender neutral you will want to create gender-specific versions of your advert, testing different designs on both.
  1. Interests – Interest targeting is one of the most important skills to master. We’d recommend trying to identify shoulder niches to lower your CPC here. Whilst you might be pushing a baby product for example, every marketer out there will be targeting ‘mummy’ and ‘baby’ interest groups. Think outside the box – Mums will babies tend to be at home during the day and may follow daytime TV interests. There will be less competition for these interests which can lower your CPC.


  1. Age – Another straightforward one. We’d recommend sorting different ad sets to split your users by age bands.
  1. Custom audiences – As with interest targeting, custom audiences allow you to build a targeting group based upon visits to your website (or specific pages) as well as your email list. You can do some really advanced stuff with custom audiences, such as splitting your website visitors by conversion action (or abandons from cart), website visits in the past 3, 10 or 30 days, or perhaps the last time they visited. Besides testing, interest and custom audience targeting are the other main competencies of social advertising which are probably deserving of a blog post in itself.
  1. Other demographics – The following targeting options probably have less potential benefits than the previous so we wouldn’t go down this route unless you are confident with your tests on the previous elements. Try to focus on different relationship statuses and tailor your adverts accordingly. To go back to the previous example, it may be worth tailoring your baby product adverts at newlyweds.



  1. Ad Type – This is an important element to test. The downside is that it can only be done at campaign level so your adverts may actually end up competing against each other which will inflate the CPC. The potential benefits do outweigh this though so push on. There are many options here; testing clicks to website vs boosted post vs conversion ad is always a good place to start it your goal is conversions. You can add in the new lead gen ad here too if you are looking for… you guessed it; leads!


  1. Bidding strategies – These bidding options are an advanced feature and are probably best left alone if you are just starting out. We’ve got four options here; CPM (the amount you’re bidding is the maximum you want to pay for 1000 impressions), CPC (you will only pay when a user clicks on the ad), oCPM (this one only displays your adverts for the people most likely to convert) and CPA (only bidding on the maximum you want to pay for a specific action). There are limitations to some of these bidding strategies, such as CPA can’t be used to promote external website campaigns. If you are running a conversion ad we would recommend you stick with oCPM but the other options might be viable depending on your goal.


Actionable insights for testing social advertisements

Exclude useless experiments

Use common sense to exclude unnecessary elements. If your service area is limited to a certain town, or your product is only suitable for women, you can exclude locations and genders immediately.

It is also worth noting here that Facebook provides you with a report on the location, gender and ad placement so it is probably worth skipping these over with your first test, you can then rule out some of these in further tests.

Define macro experiments

With initial tests you shouldn’t be focusing on subtle differences such as capitalisation or the colour of the background of an image. Test big differences. Use a photograph compared to a cartoon image. Use a personal headline compared to a click bait one.

Start small and reallocate budget once a winner is found

Don’t go all in allocating a 50/50 split of your total budget into your first test. For every winning budget there has to be a loser, and you will be losing money every time you commit to a test. This is necessary but the alternative is worse; would you rather waste 50% of your budget or 100%?

Be conservative with your budget, set aside a smaller piece to begin to test with. Once you have a winning advert you need to allocate your resources into it, but don’t forget to save some of the budget for further testing.

Create Personas

This step is incredibly important and should be completed before you even begin a single advert. Create a number of different customer personas based upon your expectations.

You will then be able to feed this information into the design and targeting of your adverts. Your tests will then be able to feed back into your initial assumptions to create a more realistic persona.

Avoid overlaps of targeting

When testing different audiences, such as a custom audience compared with an interest group, it is possible that individual users may land in both groups. This doesn’t make a fair test as any affected users will be exposed to both sets of adverts so will not make an unaffected decision.

Employing negative audiences eliminates this issue so make sure you exclude all other audience groups from your test pot to keep your test legitimate.

Never stop testing

This can’t be emphasised enough. All split testing will ever achieve is telling you which element is better than its alternatives. You can never have the best advert possible from a single test of a single element. Keep testing.

Use trackable links

Nothing kills an experiment like forgetting to mark up your variations with separate tracking codes. You’ve just lost all insight and will have to repeat your test. Mark up each individual advert with a separate tracking code to properly record each variation in your analytics platform.

Use free social media to test

You don’t have to jump straight into paid advertising. Utilise your current audience to beta test imagery and copy. You can’t accurately split tests as there will be a number of additional elements which cannot be excluded i.e. time of day, day itself or the week when you post your variations. But this is a free way of getting some insight.

Stop ads as soon as statistical significance is reached

Once your test reaches statistical significance you must turn it off. If there is a clear winner, you are just wasting budget on the losing advert. Statistical significances function is to give you confidence in your results – use the insight or continue to waste money which could be spent elsewhere.

Don’t lose sight of your main objective

Whilst constantly tweaking your headline or interest groups to eek out that extra few clicks for your money, it is important to keep your main objective in mind at all times. If your goal is conversions, then perhaps focusing on your CTR is not ideal.

Click bait may lead to a surge in traffic, but also an increased bounce rate. Don’t mislead the user, make it as clear as possible the outcome you want from them before they click.

Now, there has been a lot of information contained within this blog post. So if you only take one thing away it should really be the methodology involved in testing.

Make an assumption on how you think your element will affect the outcome – then test it and refine your assumption accordingly. Always look at your adverts as attempting to prove a premise. Never rest on your assumptions; keep testing and always refine.

Tom Smith is a Search and Data Consultant at Zazzle Media and a contributor to SEW.


The 2023 B2B Superpowers Index
whitepaper | Analytics

The 2023 B2B Superpowers Index

Data Analytics in Marketing
whitepaper | Analytics

Data Analytics in Marketing

The Third-Party Data Deprecation Playbook
whitepaper | Digital Marketing

The Third-Party Data Deprecation Playbook

Utilizing Email To Stop Fraud-eCommerce Client Fraud Case Study
whitepaper | Digital Marketing

Utilizing Email To Stop Fraud-eCommerce Client Fraud Case Study