Multi Arm Bandits And PPC Machine Learning

multi arm bandit
Home » Blog » Multi Arm Bandits And PPC Machine Learning
Free Web Marketing Consultations

Helping B2B Technology Companies Increase Their Lead Volume.
Serving: IT, MSP, Cybersecurity, Software Dev, SaaS, ISV, VARs & More.

Table of Contents
    Add a header to begin generating the table of contents

    In today’s post, we’re going to be talking about a common PPC machine learning algorithm of which some variant is leveraged in part by many pay per click platforms called a multi arm bandit. We’ll talk about how they compare to simple A/B tests and why understanding the types of algorithms these platforms use is critical to understanding how to launch successful campaigns.

    What Is A Multi Arm Bandit?

    A multi arm bandit is a type of machine learning algorithm that is commonly leveraged by pay per click platforms in order to find high performing audiences and high performing ads with limited information available about what might be successful upon launching a campaign. These algorithms are a form of multi-variate test that aim to push as much budget as possible into the highest performing variants.

    To get a better understanding of what a multi arm bandit is it’s helpful to understand how it compares to running an A/B test.

    Running An Ad Campaign With An A/B Test

    Imagine an advertiser spending $10,000 a month running a campaign. They want to get as many sales as possible from that $10,000 a month budget, but they don’t know which ad will perform the best in terms of driving those sales. They create two ads and allocate 50% of the budget each to them and launch the campaign.

    After spending about $2,500 it becomes clear that one of the ads is performing significantly better and is converting at a 5% rate and generating a positive return on ad spend. The other ad is not performing as well and is converting at a 1% rate, generating a negative ROI. However, since the campaign is configured to run as a simple A/B test, the remainder of the campaign budget is still spent delivering an ad that is converting at a 1% rate and generating a negative ROI.

    What may wind up happening in this scenario is that the negative ROI generated from the low performing ad is combined with the positive ROI generated from the high performing ad and makes the campaign appear as though it was a break even campaign and not a success, when in reality a high performing ad was found, but our testing method made the overall campaign results suffer.

    Looking At Campaign Testing Differently With A Multi Arm Bandit

    Another way to look at how our campaign was configured in the example above is that we ran a campaign with 100% of the budget allocated to testing. What if we looked at campaign testing differently? We as advertisers still don’t know which ads will be high performing ads from the onset of our campaigns, so testing ad variants is still valuable, but do we need to allocate 100% of our budget to testing? What if instead, we allocated a small portion of our budget to testing and then redirected the core spend over to the highest performing ads instead?

    This is exactly what a multi arm bandit algorithm aims to do. It will allocate a portion of the budget to testing ad variants, let’s say 20% of ad spend, and the other 80% will be allocated to spend on what the algorithm currently knows is the best performing variant.

    ab tests vs multi arm bandits in ppc advertising

    Other Benefits Of Multi Arm Bandits In PPC

    It would be great if digital advertising was as simple as two ad variants and static market conditions, but real world advertising is MUCH more complex. PPC platforms leverage dynamic creative to test thousands of different ad combinations and combine those ad combinations with audience data and other factors. Market conditions are also always changing, the recent launch of the war in Ukraine is a perfect example.

    Multi arm bandits are a great way to bake in ongoing testing. What constitutes a high performing combination of ad creative and audiences may change over time. These algorithms can learn that a change has happened and redirect spend to the highest performing variants as new information becomes available and high performing creative shifts.

    Multi arm bandits are also a good fit for unsupervised advertising. The reality is, there are a lot of amateur advertisers out there who don’t have any real understanding of how PPC platforms actually work and they just want to launch an ad campaign and pray for the best. PPC platforms typically have ways to launch ad campaigns with minimal configuration settings in less than 30 minutes, and ways to deeply configure a variety of settings and let experts fine tune their campaigns to get the best results possible. Multi arm bandit algorithms are a great way to facilitate unsupervised advertising and get the best results possible.

    Drawbacks Of Multi Arm Bandits In PPC

    It’s pretty well known that you can burn through a lot of money in a hurry via pay per click advertising. If you’ve been paying attention to the article so far, you are probably developing a better understanding as to why. Although multi arm bandits are powerful machine learning algorithms that solve advertising problems in an elegant way, their bias towards action means that a poorly trained algorithm will dump 80% of your budget into utter crap, leaving you with poor results and basically no ROI in a hurry.

    Since such a small portion of budgets are allocated to testing, it’s very easy for unsavvy advertisers to see poor results on a campaign and pull the plug before the machine learning has had a chance to identify a high performing variant. Advertisers can get caught in a never ending cycle of launch, analyze, draw the wrong conclusion, pull the plug, and waste their full ad budget with no results.

    Final Thoughts

    Multi arm bandit algorithms are a staple of PPC advertising and the web in general. They are a common way to identify high performing variants in multi variate testing scenarios with applications across digital advertising, conversion rate optimization, and a range of other activities on the web. Understanding how these algorithms work is essential to understanding how to leverage them effectively. Automated bidding strategies that leverage machine learning are an extremely powerful way to get high ROI from your ad campaigns, but knowing when to use them, how to use them, and how to structure your accounts is a complex topic filled with many subtleties. Working with a PPC consultant to get the most out of your campaigns is an expense that can easily pay for itself. Contact us today and learn more about how we can help.

    Share This Article
    Posted in:

    Hunter Nelson

    Hunter is the founder and president of Tortoise and Hare Software, a digital marketing agency for the technology sector and other lead generation oriented businesses. Hunter has more than 10 years’ experience building web applications and crafting digital strategies for companies ranging from scrappy startups to Fortune 50 household names. When not on the clock, you'll find him spending time with his family and pups, relaxing on the beach, or playing competitive online video games. See for more.

    Leave a Comment





    Recent Blog Posts

    Aesopians E8 – How SaaS Companies Are Maintaining Brand Integrity and Operationalizing Growth with HubSpot Ft. Mohamed Hamad Of Third Wunder Agency

    SaaS companies move fast—but if your branding and systems can’t keep up, growth can actually become a liability. In this episode of the Aesopians Podcast, host Hunter Nelson is joined…

    The Ultimate Guide To ChatGPT SEO

    Most SEO professionals are racing to understand how AI tools are reshaping visibility. But the biggest shift isn’t coming from Google—it’s coming from ChatGPT. As organic search volumes and conversions…

    MSP Google Ads Costs and Pricing

    You’ve heard Google Ads can generate leads quickly, but you’re not sure how much to budget, what kind of results to expect, or whether it’s really worth the spend. Many…

    Aesopians E7 – Joining The Feel Good MSP Sales Training Program Ft. Brian Gillette

    In this episode of the Aesopians Podcast, we sit down with Brian Gillette, founder of Feel-Good MSP and creator of the “Feel-Good Close.” If you’re an MSP leader who’s tired…

    MSP Advertising Strategy: 3 Fundamental Approaches to Drive Real Growth

    Is your MSP making effective use of your advertising budget, or are you weighed down too much by bottom of funnel advertising tactics that leave you in a perpetual cycle…

    How We Save Thousands With Negative Keywords For MSP Google Ad Campaigns

    Google Ads is one of the most powerful inbound lead generation channels available to managed service providers. There are few better moments to introduce your brand than when someone is…

    Aesopians E5: From Tech To Rep: Year 1 In MSP Sales Ft. Ashton Fortuna

    Most MSPs hesitate to move technicians into sales—worried they’ll lack the polish, confidence, or killer instinct to close deals. Sales is a different game. Techs solve problems with systems; sales…

    SEO Not Working: Here’s Why

    Lately I’ve been getting on more and more calls lately with people saying something along the lines of “we’ve been doing SEO or inbound for 6 months, 12 months, or…

    Why SEO Investments Help Your MSP Weather a Recession and Keep the Door Open for New Opportunities

    What happens to your pipeline when the phones go quiet, inboxes stay cold, and paid ads stop converting? That’s not a hypothetical. It’s what happens in a recession. Budgets freeze.…

    MSP Marketing – How to Build a Strategy That Works

    Let’s be honest—most MSP marketing doesn’t work.Not because the tactics are bad, but because they’re unaligned. What looks like a marketing problem is often a strategy problem in disguise. Most…

    The 10 Best MSP SEO Agencies To Help You Grow Organic Traffic

    If you’re searching for SEO agencies for MSPs, the list of generalists can feel endless—and underwhelming. Most SEO providers don’t understand the managed services space, much less the buyer behavior,…

    Why Your MSP’s Online Marketing Efforts Are Failing

    If you’re leading an MSP and investing in online marketing, you’re probably feeling a growing sense of frustration. You’ve put money into websites, content, ads—even hired an agency or two…

    What Makes a Great MSP Website? 5 Examples You Should Follow

    Your MSP website is more than just an online brochure—it’s a powerful tool for attracting and converting potential clients. But what makes a website truly effective in the competitive managed…

    Case Study: Cold Start To 2-5 Leads Per Month Via Local SEO For MSP In Canada

    Client Background A Managed IT Services Provider (MSP) in British Columbia, Canada engaged us to establish a professional online presence and generate a steady flow of inbound leads. Before working…

    Aesopians Episode 4: Leading with Cybersecurity To Spark MSP Sales Conversations – Featuring Michael Bakaic Of Iceberg Cyber

    In this episode of the Aesopians Podcast, Hunter Nelson sits down with Michael Bakaic from Iceberg Cyber to discuss how MSPs can use cybersecurity as a conversation starter to attract…

    WordPress Out OF Memory Exceptions

    Recently I’ve been dabbling in programmatic SEO. I got an idea of rolling out a landing page to attract search engine traffic from every major city in the United States…

    Aesopians Episode 3 – Cold Email Marketing For MSPs Featuring Jeffrey Newton Of Cyft.AI

    In this episode of The Aesopians Podcast, Hunter Nelson sits down with Jeffrey Newton, Co-founder of Cyft and former MSP sales and marketing leader, to discuss the realities of running…

    Case Study: Sourcing 30+ Email Opt-Ins Per Month For Cybersecurity SaaS Startup Via Google Ads

    In this case study we’ll share how we helped a Cybersecurity SaaS startup source roughly 30 email opt-ins per month via Google Ads to help fuel their email marketing efforts…

    Aesopian’s Episode 2 – Streamlining SEO Content Production Featuring Raj Khera Of Make Media

    In this episode of the “Aesopians” podcast, we’re joined by Raj Khera, a serial entrepreneur and the founder of Make Media, to discuss how small businesses can transform their approach…

    Aesopians Episode 1 – Azure Cloud For MSPs

    In the debut episode of Aesopian’s Podcast, host Hunter Nelson sits down with Matt Hache, an infrastructure consultant at PAX8 and founder of Neon Cobra, to explore how Managed Service…

    Related Blog Posts

    MSP Google Ads Costs and Pricing

    You’ve heard Google Ads can generate leads quickly, but you’re not sure how much to budget, what kind of results to expect, or whether it’s really worth the spend. Many…

    MSP Advertising Strategy: 3 Fundamental Approaches to Drive Real Growth

    Is your MSP making effective use of your advertising budget, or are you weighed down too much by bottom of funnel advertising tactics that leave you in a perpetual cycle…

    Case Study: Sourcing 30+ Email Opt-Ins Per Month For Cybersecurity SaaS Startup Via Google Ads

    In this case study we’ll share how we helped a Cybersecurity SaaS startup source roughly 30 email opt-ins per month via Google Ads to help fuel their email marketing efforts…

    Case Study: TNHS Generates 30 Leads In 6 Months For DC Metro MSP

    In July of 2024 a Washington D.C. metro based MSP reached out to Tortoise and Hare Software for help with some of their advertising campaigns. This MSP was working with…

    What MSPs Should Know About Retargeting: Turning Window Shoppers into Revenue

    As a managed IT service provider (MSP) looking to scale your revenue and eventually sell your business at a premium, you need a robust marketing strategy. One often overlooked but…

    GovTech SaaS Paid Search Advertising Case Study

    In today’s post, I would like to take a moment to break down some of the results we were able to generate for a GovTech SaaS via paid search advertising.…

    Effective Keywords For Your MSP To Bid On

    Managed Service Providers (MSPs) understand the value of Google Ads in attracting potential clients actively seeking their services. However, the path to success in this competitive advertising landscape involves not…

    Is LinkedIn Ads A Fit For Your MSP?

    When considering options for marketing your MSP, no doubt you’ve considered using LinkedIn Ads to generate more leads and sales opportunities. LinkedIn is after all, probably the largest collection of…

    Best Practices For Responsive Search Ads

    If you’ve been running paid search campaigns on Google Ads lately you’ve almost certainly noticed that responsive search ads are now the standard. Google is leaning heavily into automation and…

    How To Set A Budget For Paid Search

    In this post, we’re going to break down how to set a budget for paid search to run lead generation campaigns for your B2B tech org. Let’s assume for the…

    How Do I Advertise My MSP? A Short Guide

    Marketing is one thing but advertising is another. You may have your logo and branding in order, a polished website, pamphlets, brochures, t-shirts, stickers, and other swag, but at a…

    The Ultimate Guide To Paid Search On Google Ads For Managed Service Providers

    Generating leads for your MSP can be a challenge. You spend so much time managing employees, making sure customer support tickets are answered, procuring hardware, and defending against cyber threats,…

    The 5 Second Test For PPC Landing Pages

    I’ve been having a lot of conversations recently about optimizing websites for lead generation and explaining a concept called the 5 second test. The 5 second test is a design…

    LinkedIn Ads Rolls Out New JavaScript Event Based Conversion Tracking

    I was poking around in a couple of LinkedIn Ad accounts today, while working on some campaigns and got a notification that there was a change to conversion tracking behaviors.…

    The PRESTO Landing Page Copywriting Framework

    Creating a landing page that converts can be a challenge. There’s a lot that goes into it, but one of the most important aspects of that is the copywriting. It…

    How Much Can I Spend On Google Ads?

    One of the first questions I get when talking about google ads is how much is a click? It’s a fair question, but asking it is the wrong way to…

    10 Reasons Why Your MSP Needs Google Ads

    As a managed service provider, you offer a great service to your clients that helps them run their business more effectively, securely, and frees up their time. The problem is,…

    Google Ads Case Study – Adding 1.5 Million Revenue In 1 Year For A SaaS

    In this post we’re going to walk through an eCommerce SaaS google ads case study. We’ll walk you through how we took one lucky eCommerce software as a service (SaaS)…

    5+ Essential Google Ads Campaigns For Your Ad Account

    Advertising your business on Google Ads is a fantastic way to drive traffic to your website and generate leads for your company. Many companies don’t know where to start when…

    Bid on Branded Keywords

    Why are we spending money on branded keyword searches if we’re already ranking at the top of the page? This is a good question that clients often ask when getting…

    Top Blog Content

    The Ultimate Guide to Hiring an MSP Marketing Agency

    Are you one of the many MSPs struggling to attract new clients consistently? According to research conducted by MSP Dojo, a leading MSP sales consulting firm, approximately 85% of MSPs…

    The Ultimate Guide To MSP Website Optimization

    A well-optimized website is essential for Managed Service Providers (MSPs) looking to scale their business, attract more leads, and achieve a lucrative exit. A lot of MSPs check a few…

    The Ultimate Guide To Paid Search On Google Ads For Managed Service Providers

    Generating leads for your MSP can be a challenge. You spend so much time managing employees, making sure customer support tickets are answered, procuring hardware, and defending against cyber threats,…

    The Ultimate Guide To MSP SEO

    Search Engine Optimization (SEO) is one of the most important ways to attract new business for mid-market managed service providers (MSP). If you look at MSPs that have achieved any…

    The Ultimate Guide To Setting A Marketing Budget For IT Companies

    Many IT companies get their start as a one-man operation and rely almost exclusively on word of mouth, referrals, and other organic offline means to get past their initial growth…

    Featured Review of Tortoise and Hare

    ryan drake president nettech consultants
    R.D.
    President Florida Based MSP

    Tortoise and Hare has been a key partner in our MSP's growth. Over the year's we've worked together they've helped our MSP dramatically increase our website traffic, and build a steady stream of leads sourced from our website and advertising efforts. Over that time, we've been able to raise our base customer size, build economies of scale to more efficiently service customers, and expand into new markets.