{"id":60604,"date":"2022-11-09T20:21:00","date_gmt":"2022-11-09T20:21:00","guid":{"rendered":"https:\/\/mailrelay.com\/glosario\/a-b-testing\/"},"modified":"2026-10-03T11:09:54","modified_gmt":"2026-10-03T11:09:54","slug":"a-b-testing","status":"publish","type":"glossary","link":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/","title":{"rendered":"A\/B testing"},"content":{"rendered":"<p>An A\/B test is a technique that consists of developing two versions of the same element or product, with the sole intention of measuring which of these two versions works better.<\/p>\n<p>A\/B testing has many different uses in digital marketing. Some of the most common (though not the only ones) are:<\/p>\n<ul>\n<li>Determine the best design for a web page.<\/li>\n<li>Measure which is the best version of an app.<\/li>\n<li>Find the best newsletter for your bulk email campaigns.<\/li>\n<li>Quantify which <a href=\"https:\/\/mailrelay.com\/en\/glossary\/landing-page\/\" target=\"_blank\" rel=\"noopener\">landing page<\/a> gets more conversions.<\/li>\n<li>Calculate the effectiveness of two different CTAs.<\/li>\n<li>Determine the best redesign of a website logo.<\/li>\n<li>Test specific elements of the design such as buttons and images.<\/li>\n<li>Check the effectiveness of two different copy versions for the same product.<\/li>\n<\/ul>\n<h2>1. How does an A\/B test work?<\/h2>\n<p>This method consists of developing two versions of the same element\/product before launching it on the market. It applies to both physical and digital products. In our case, we will focus on an example based on creating an A\/B test to find the best <a href=\"https:\/\/mailrelay.com\/en\/glossary\/email-subject-line\/\" target=\"_blank\" rel=\"noopener\">subject line<\/a> between two candidates, so that an <a href=\"https:\/\/mailrelay.com\/en\/\">email marketing<\/a> campaign delivers the best ROI.<\/p>\n<p>Naturally, you can run multiple A\/B tests to take more versions into account, but an A\/B test is usually used to decide between the two &#8220;finalist&#8221; options.<\/p>\n<p>To do this, we create two subject lines for a newsletter from an animal shelter that wants to raise funds among its members.<\/p>\n<p>One includes the name of the email&#8217;s <a href=\"https:\/\/mailrelay.com\/en\/glossary\/recipient\/\" target=\"_blank\" rel=\"noopener\">recipient<\/a> and a question whose answer is obvious to the contact list it is sent to: &#8220;Name, don&#8217;t you just love animals?&#8221; The other version is more direct and aims to get the recipient to read the email: &#8220;The lives of our animals depend on you alone.&#8221; The content of the email is exactly the same; only the subject line changes.<\/p>\n<p>Then, to run the A\/B test, we take a percentage of the total list of subscribers we want to send the newsletter to, for example 20%, and send 10% of them the subject line &#8220;Name, don&#8217;t you just love animals?&#8221; The remaining 10% receive the one with the subject line &#8220;The lives of our animals depend on you alone.&#8221;<\/p>\n<p>After 24 hours, for example, we review the A\/B test statistics and determine which version got the most opens. The subject line with the most opens is the winner of the A\/B test, and the <a href=\"https:\/\/mailrelay.com\/en\/glossary\/email-newsletter\/\" target=\"_blank\" rel=\"noopener\">newsletter<\/a> is sent to the remaining 80% of subscribers using that winning subject line.<\/p>\n<h2>2. Advantages of A\/B testing<\/h2>\n<p>In general, incorporating A\/B tests into any marketing strategy brings you numerous advantages:<\/p>\n<ul>\n<li><strong>Increase the profitability of your campaigns.<\/strong> A\/B tests let you easily find out what really works with your target audience.<\/li>\n<li><strong>They allow you to experiment with different options.<\/strong> What worked a few months ago may not be as effective today, so you have to constantly experiment in a controlled way and A\/B tests are ideal for that.<\/li>\n<li><strong>They help to improve engagement.<\/strong> Through subtle changes, A\/B tests show you, unequivocally, the way your audience wants to be treated, the tone of the conversation they like the most, the content that is relevant to them, etc.<\/li>\n<li><strong>The details make the difference.<\/strong> You may not have realized it, but polishing seemingly minor details, such as font size or color, can make the difference between a text or CTA succeeding or failing. A\/B tests highlight the importance of details.<\/li>\n<\/ul>\n\n<h2 class=\"wp-block-heading\">Related entries<\/h2>\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/word-of-mouth-marketing\/\">Word-of-Mouth marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/affiliate-marketing\/\">Affiliate marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/guerrilla-marketing\/\">Guerrilla marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/emotional-marketing\/\">Emotional marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/viral-marketing\/\">Viral marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/visual-marketing\/\">Visual marketing<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/marketplace\/\">Marketplace<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/mailrelay.com\/en\/glossary\/wholesaler\/\">Wholesaler<\/a><\/li>\n<\/ul>\n","protected":false},"template":"","class_list":["post-60604","glossary","type-glossary","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>A\/B testing - Mailrelay<\/title>\n<meta name=\"description\" content=\"A\/B testing is a technique used for testing two versions of the same element\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A\/B testing - Mailrelay\" \/>\n<meta property=\"og:description\" content=\"A\/B testing is a technique used for testing two versions of the same element\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Mailrelay\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Mailrelay\/\" \/>\n<meta property=\"article:modified_time\" content=\"2026-10-03T11:09:54+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@mailrelay\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/glossary\\\/a-b-testing\\\/\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/glossary\\\/a-b-testing\\\/\",\"name\":\"A\\\/B testing - Mailrelay\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#website\"},\"datePublished\":\"2022-11-09T20:21:00+00:00\",\"dateModified\":\"2026-10-03T11:09:54+00:00\",\"description\":\"A\\\/B testing is a technique used for testing two versions of the same element\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/glossary\\\/a-b-testing\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mailrelay.com\\\/en\\\/glossary\\\/a-b-testing\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/glossary\\\/a-b-testing\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\\\/B testing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\",\"name\":\"Mailrelay\",\"description\":\"Mailrelay.com - Email Marketing Software\",\"publisher\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#organization\",\"name\":\"Mailrelay\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/mailrelay-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/mailrelay-logo.jpg\",\"width\":613,\"height\":291,\"caption\":\"Mailrelay\"},\"image\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Mailrelay\\\/\",\"https:\\\/\\\/x.com\\\/mailrelay\",\"https:\\\/\\\/www.youtube.com\\\/mailrelay-email-marketing\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A\/B testing - Mailrelay","description":"A\/B testing is a technique used for testing two versions of the same element","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/","og_locale":"en_US","og_type":"article","og_title":"A\/B testing - Mailrelay","og_description":"A\/B testing is a technique used for testing two versions of the same element","og_url":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/","og_site_name":"Mailrelay","article_publisher":"https:\/\/www.facebook.com\/Mailrelay\/","article_modified_time":"2026-10-03T11:09:54+00:00","twitter_card":"summary_large_image","twitter_site":"@mailrelay","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/","url":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/","name":"A\/B testing - Mailrelay","isPartOf":{"@id":"https:\/\/mailrelay.com\/en\/#website"},"datePublished":"2022-11-09T20:21:00+00:00","dateModified":"2026-10-03T11:09:54+00:00","description":"A\/B testing is a technique used for testing two versions of the same element","breadcrumb":{"@id":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mailrelay.com\/en\/glossary\/a-b-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mailrelay.com\/en\/"},{"@type":"ListItem","position":2,"name":"A\/B testing"}]},{"@type":"WebSite","@id":"https:\/\/mailrelay.com\/en\/#website","url":"https:\/\/mailrelay.com\/en\/","name":"Mailrelay","description":"Mailrelay.com - Email Marketing Software","publisher":{"@id":"https:\/\/mailrelay.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mailrelay.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mailrelay.com\/en\/#organization","name":"Mailrelay","url":"https:\/\/mailrelay.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailrelay.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/05\/mailrelay-logo.jpg","contentUrl":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/05\/mailrelay-logo.jpg","width":613,"height":291,"caption":"Mailrelay"},"image":{"@id":"https:\/\/mailrelay.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Mailrelay\/","https:\/\/x.com\/mailrelay","https:\/\/www.youtube.com\/mailrelay-email-marketing"]}]}},"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"Jose Argudo","author_link":"https:\/\/mailrelay.com\/en\/blog\/author\/"},"uagb_comment_info":0,"uagb_excerpt":"An A\/B test is a technique that consists of developing two versions of the same element or product, with the sole intention of measuring which of these two versions works better. A\/B testing has many different uses in digital marketing. Some of the most common (though not the only ones) are: Determine the best design&hellip;","_links":{"self":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/glossary\/60604","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/types\/glossary"}],"version-history":[{"count":7,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/glossary\/60604\/revisions"}],"predecessor-version":[{"id":98527,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/glossary\/60604\/revisions\/98527"}],"wp:attachment":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/media?parent=60604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}