{"id":96757,"date":"2019-09-19T06:15:33","date_gmt":"2019-09-19T06:15:33","guid":{"rendered":"https:\/\/mailrelay.com\/blog\/2026\/09\/29\/mailrelay-v3-ab-testing-automated-sending\/"},"modified":"2026-09-29T18:35:44","modified_gmt":"2026-09-29T18:35:44","slug":"mailrelay-v3-ab-testing-automated-sending","status":"publish","type":"post","link":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/","title":{"rendered":"Mailrelay v3: Email Marketing Campaigns with A\/B Testing and Automated Sending"},"content":{"rendered":"<p>One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.<\/p>\n<p>This feature allows&nbsp; you to run a newsletter sending test on:<\/p>\n<ol>\n<li>Sender<\/li>\n<li>Or subject<\/li>\n<\/ol>\n<p><strong>With a small subset of subscribers, and by looking at the results from that small group, you then send to the entire list using the winning option, which gets you better results from the send.<\/strong><\/p>\n<p>Interesting, right?<\/p>\n<p>It&#8217;s a feature that helps us get better results from our <a href=\"https:\/\/mailrelay.com\/en\/blog\/2017\/01\/17\/how-to-create-a-mailing\/\" target=\"_blank\" rel=\"noopener\">email campaigns<\/a>, without us having&nbsp; to do anything.<\/p>\n<p>Also, this version of Mailrelay includes a very interesting&nbsp; new feature. Want to find out more?<\/p>\n<p>Keep reading!<\/p>\n\n<h2>\u00b7 Preparing the A\/B test for our newsletter<\/h2>\n<p>The first thing to keep in mind is that, to run an A\/B test campaign, we must have created a newsletter beforehand.<\/p>\n<p>If we meet this requirement, we&#8217;ll go to the menu&nbsp;<strong>&#8220;Newsletters&#8221; &#8211; &#8220;A\/B Tests&#8221;:<\/strong><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22319 size-full\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-1.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"273\" height=\"283\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-1.jpg 273w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-1-110x114.jpg 110w\" sizes=\"auto, (max-width: 273px) 100vw, 273px\" \/><\/p>\n<p>Then we&#8217;ll click the <strong>Add&nbsp;<\/strong>button to create the new test:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22320 size-full\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-2.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"431\" height=\"377\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-2.jpg 431w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-2-300x262.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-2-110x96.jpg 110w\" sizes=\"auto, (max-width: 431px) 100vw, 431px\" \/><\/p>\n<p>The first step now, as we mentioned earlier, is to choose the&nbsp;<strong>base newsletter<\/strong> that we&#8217;ve created, to use it in the A\/B test:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22322\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-3.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"630\" height=\"277\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-3.jpg 726w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-3-300x132.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-3-110x48.jpg 110w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/p>\n<p>As you can see in the image, all you need to do is choose the newsletter and then click&nbsp;<strong>&#8220;Next&#8221;.<\/strong><\/p>\n<p>The next step is to select the group the email will be sent to:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22323\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-4.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"630\" height=\"260\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-4.jpg 802w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-4-300x124.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-4-768x317.jpg 768w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-4-110x45.jpg 110w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/p>\n<p>We can select one group or several. What matters is that together they have at least 10 contacts, otherwise&nbsp; it won&#8217;t be possible to send with an A\/B test.<\/p>\n<p>When we click&nbsp;<strong>&#8220;Next&#8221;<\/strong> we&#8217;ll go to the final A\/B test screen, where we&#8217;ll make some important decisions:<\/p>\n<ol>\n<li>The type of A\/B test<\/li>\n<li>What percentage of the total contacts we&#8217;ll use for the test<\/li>\n<li>And how the winning newsletter will be decided.<\/li>\n<\/ol>\n<p>Here you can see an example of the options:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22327\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"630\" height=\"301\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5.jpg 1133w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5-300x143.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5-1024x489.jpg 1024w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5-768x367.jpg 768w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-5-110x53.jpg 110w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/p>\n<p>In this case, I&#8217;ve chosen to run a test on the&nbsp;<strong>&#8220;Subject&#8221;<\/strong>, so I&#8217;ll test two different subjects: the original one and another that we think might work better.<\/p>\n<p>With 20% of the total contacts.<\/p>\n<p><strong>And I&#8217;ll decide manually<\/strong> which of the two options to send to the full list.<\/p>\n<p>If we had chosen one of the automated decision options <em>(by clicks or views)<\/em>, we would see this:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22329 size-full\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-6.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"450\" height=\"256\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-6.jpg 450w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-6-300x171.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-6-110x63.jpg 110w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/p>\n<p>This way, we can have the system <strong>evaluate the clicks or views<\/strong>, after the <strong>defined waiting time<\/strong>, and after that period <em>send the newsletter&nbsp;<strong>automatically<\/strong> <\/em>using the option that has produced the best results.<\/p>\n<p>Very useful for setting the process up on a schedule so that we don&#8217;t have to do anything else.<\/p>\n<h3>\u25ba Contact summary<\/h3>\n<p>On the right side of that screen, we can see a summary of the number of contacts that will be used:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22337\" title=\"Preparing the A\/B test for our newsletter\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-7.jpg\" alt=\"Preparing the A\/B test for our newsletter\" width=\"629\" height=\"240\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-7.jpg 642w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-7-300x114.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-7-110x42.jpg 110w\" sizes=\"auto, (max-width: 629px) 100vw, 629px\" \/><\/p>\n<p>The total number of subscribers, the ones that will be used in the test, and the ones that will be left for the final send.<\/p>\n<h3>\u25ba Selecting the subjects \/ senders<\/h3>\n<p>Then we&#8217;ll click <strong>&#8220;Next&#8221;<\/strong> and finally we just have to define the subjects to be tested, or the senders if we&#8217;ve chosen that option:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22338 size-full\" title=\"Selecting the subjects \/ senders\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-8.jpg\" alt=\"Selecting the subjects \/ senders\" width=\"493\" height=\"265\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-8.jpg 493w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-8-300x161.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-8-110x59.jpg 110w\" sizes=\"auto, (max-width: 493px) 100vw, 493px\" \/><\/p>\n<p>After choosing that, when we click&nbsp;<strong>&#8220;Next&#8221;<\/strong> it will take us to the final summary screen.<\/p>\n<h3>\u25ba Final summary<\/h3>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22339 size-full\" title=\"Final summary\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-9.jpg\" alt=\"Final summary\" width=\"678\" height=\"291\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-9.jpg 678w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-9-300x129.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-9-110x47.jpg 110w\" sizes=\"auto, (max-width: 678px) 100vw, 678px\" \/><\/p>\n<p>Here we can see a complete summary of the actions that will be carried out, how many subscribers the tests will be run with, and how many contacts the final send will go to.<\/p>\n<p>When we click&nbsp;<strong>&#8220;Send now&#8221;<\/strong> the actions will be executed, and it will take us to a screen with preliminary statistics and decision-making:<\/p>\n<h2>\u00b7 A\/B test statistics and decision-making screen<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22341\" title=\"A\/B test statistics and decision-making screen\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10.jpg\" alt=\"A\/B test statistics and decision-making screen\" width=\"630\" height=\"388\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10.jpg 1047w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10-300x185.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10-1024x631.jpg 1024w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10-768x473.jpg 768w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-10-110x68.jpg 110w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/p>\n<p>If we&#8217;ve selected <strong>manual decision-making<\/strong>, here we&#8217;ll have all the data we need to make the decision:<\/p>\n<ol>\n<li>Emails sent, total views and clicks<\/li>\n<li>The subjects used<\/li>\n<li>Emails sent, views and clicks for each specific version<\/li>\n<\/ol>\n<p><strong>It&#8217;s important to let enough time pass,&nbsp;<\/strong>until we can make the right decision, and once it&#8217;s clear, we&#8217;ll just have to click the button&nbsp;<strong>&#8220;Use this combination&#8221;.<\/strong><\/p>\n<p><span style=\"text-decoration: underline;\"><strong>IMPORTANT<\/strong><\/span><\/p>\n<p>We can always come back to this screen from the menu&nbsp;<strong>&#8220;Newsletters&#8221; &#8211; &#8220;A\/B Tests&#8221;,&nbsp;<\/strong>and we&#8217;ll see the tests, as well as their status:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22343\" title=\"A\/B test statistics and decision-making screen\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11.jpg\" alt=\"A\/B test statistics and decision-making screen\" width=\"630\" height=\"227\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11.jpg 1109w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11-300x108.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11-1024x368.jpg 1024w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11-768x276.jpg 768w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-11-110x40.jpg 110w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/p>\n<p>In this case, you can see that the send is&nbsp;<strong>&#8220;Awaiting approval&#8221;.<\/strong><\/p>\n<h2>\u00b7 A\/B test statistics<\/h2>\n<p>After sending, we can review the statistics by going into the A\/B test, as before, and clicking the magnifying glass to see the details in the usual statistics report:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-22347\" title=\"A\/B test statistics\" src=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12.jpg\" alt=\"A\/B test statistics\" width=\"629\" height=\"425\" srcset=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12.jpg 1047w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12-300x203.jpg 300w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12-1024x691.jpg 1024w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12-768x519.jpg 768w, https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-test-ab-12-110x74.jpg 110w\" sizes=\"auto, (max-width: 629px) 100vw, 629px\" \/><\/p>\n<p>We can see the statistics for the different tests and for the resulting send.<\/p>\n<p>The statistics screen is identical to the one for a normal send. You can check previous posts to see how this screen works.<\/p>\n<p>Overall, the A\/B testing feature is very interesting.&nbsp;<strong>Have you used it in your email sends?<\/strong><\/p>\n<p>This type of testing helps you improve your <a href=\"https:\/\/mailrelay.com\/en\/glossary\/open-rate-2\/\">open rate<\/a> by identifying which subjects and senders work best with your audience.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing. This feature allows&nbsp; you to run a newsletter sending test on: Sender Or subject With a small subset of subscribers, and by looking at the results from that small group, you then send to the entire [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":39721,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","footnotes":""},"categories":[882,562],"tags":[],"class_list":["post-96757","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-deliverability-and-technical-aspects","category-email-marketing-2"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Automated Email Marketing Sends with A\/B Testing | Mailrelay<\/title>\n<meta name=\"description\" content=\"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automated Email Marketing Sends with A\/B Testing | Mailrelay\" \/>\n<meta property=\"og:description\" content=\"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/\" \/>\n<meta property=\"og:site_name\" content=\"Mailrelay\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Mailrelay\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-09-19T06:15:33+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-29T18:35:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png\" \/>\n\t<meta property=\"og:image:width\" content=\"630\" \/>\n\t<meta property=\"og:image:height\" content=\"340\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Mailrelay\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@mailrelay\" \/>\n<meta name=\"twitter:site\" content=\"@mailrelay\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mailrelay\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/\"},\"author\":{\"name\":\"Mailrelay\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/person\\\/355071c9f6e00fa8c8731ac93e0aa487\"},\"headline\":\"Mailrelay v3: Email Marketing Campaigns with A\\\/B Testing and Automated Sending\",\"datePublished\":\"2019-09-19T06:15:33+00:00\",\"dateModified\":\"2026-09-29T18:35:44+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/\"},\"wordCount\":847,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/04\\\/mailing-tests-ab.png\",\"articleSection\":[\"Deliverability and Technical Aspects\",\"email marketing\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/\",\"name\":\"Automated Email Marketing Sends with A\\\/B Testing | Mailrelay\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/04\\\/mailing-tests-ab.png\",\"datePublished\":\"2019-09-19T06:15:33+00:00\",\"dateModified\":\"2026-09-29T18:35:44+00:00\",\"description\":\"One of the features that has received an interesting improvement in this new version of Mailrelay is A\\\/B testing.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/04\\\/mailing-tests-ab.png\",\"contentUrl\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/04\\\/mailing-tests-ab.png\",\"width\":630,\"height\":340},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/2019\\\/09\\\/19\\\/mailrelay-v3-ab-testing-automated-sending\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Mailrelay v3: Email Marketing Campaigns with A\\\/B Testing and Automated Sending\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\",\"name\":\"Mailrelay\",\"description\":\"Mailrelay.com - Email Marketing Software\",\"publisher\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#organization\",\"name\":\"Mailrelay\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/mailrelay-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/mailrelay.com\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/mailrelay-logo.jpg\",\"width\":613,\"height\":291,\"caption\":\"Mailrelay\"},\"image\":{\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Mailrelay\\\/\",\"https:\\\/\\\/x.com\\\/mailrelay\",\"https:\\\/\\\/www.youtube.com\\\/mailrelay-email-marketing\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/#\\\/schema\\\/person\\\/355071c9f6e00fa8c8731ac93e0aa487\",\"name\":\"Mailrelay\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g\",\"caption\":\"Mailrelay\"},\"url\":\"https:\\\/\\\/mailrelay.com\\\/en\\\/blog\\\/author\\\/mailrelay\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Automated Email Marketing Sends with A\/B Testing | Mailrelay","description":"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/","og_locale":"en_US","og_type":"article","og_title":"Automated Email Marketing Sends with A\/B Testing | Mailrelay","og_description":"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.","og_url":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/","og_site_name":"Mailrelay","article_publisher":"https:\/\/www.facebook.com\/Mailrelay\/","article_published_time":"2019-09-19T06:15:33+00:00","article_modified_time":"2026-09-29T18:35:44+00:00","og_image":[{"width":630,"height":340,"url":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png","type":"image\/png"}],"author":"Mailrelay","twitter_card":"summary_large_image","twitter_creator":"@mailrelay","twitter_site":"@mailrelay","twitter_misc":{"Written by":"Mailrelay","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#article","isPartOf":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/"},"author":{"name":"Mailrelay","@id":"https:\/\/mailrelay.com\/en\/#\/schema\/person\/355071c9f6e00fa8c8731ac93e0aa487"},"headline":"Mailrelay v3: Email Marketing Campaigns with A\/B Testing and Automated Sending","datePublished":"2019-09-19T06:15:33+00:00","dateModified":"2026-09-29T18:35:44+00:00","mainEntityOfPage":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/"},"wordCount":847,"commentCount":0,"publisher":{"@id":"https:\/\/mailrelay.com\/en\/#organization"},"image":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#primaryimage"},"thumbnailUrl":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png","articleSection":["Deliverability and Technical Aspects","email marketing"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/","url":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/","name":"Automated Email Marketing Sends with A\/B Testing | Mailrelay","isPartOf":{"@id":"https:\/\/mailrelay.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#primaryimage"},"image":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#primaryimage"},"thumbnailUrl":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png","datePublished":"2019-09-19T06:15:33+00:00","dateModified":"2026-09-29T18:35:44+00:00","description":"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing.","breadcrumb":{"@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#primaryimage","url":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png","contentUrl":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png","width":630,"height":340},{"@type":"BreadcrumbList","@id":"https:\/\/mailrelay.com\/en\/blog\/2019\/09\/19\/mailrelay-v3-ab-testing-automated-sending\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mailrelay.com\/en\/"},{"@type":"ListItem","position":2,"name":"Mailrelay v3: Email Marketing Campaigns with A\/B Testing and Automated Sending"}]},{"@type":"WebSite","@id":"https:\/\/mailrelay.com\/en\/#website","url":"https:\/\/mailrelay.com\/en\/","name":"Mailrelay","description":"Mailrelay.com - Email Marketing Software","publisher":{"@id":"https:\/\/mailrelay.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mailrelay.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mailrelay.com\/en\/#organization","name":"Mailrelay","url":"https:\/\/mailrelay.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailrelay.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/05\/mailrelay-logo.jpg","contentUrl":"https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/05\/mailrelay-logo.jpg","width":613,"height":291,"caption":"Mailrelay"},"image":{"@id":"https:\/\/mailrelay.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Mailrelay\/","https:\/\/x.com\/mailrelay","https:\/\/www.youtube.com\/mailrelay-email-marketing"]},{"@type":"Person","@id":"https:\/\/mailrelay.com\/en\/#\/schema\/person\/355071c9f6e00fa8c8731ac93e0aa487","name":"Mailrelay","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/871548d8ea792b1be4dca815f1997730a5a337670dbe077351e8e02f813d2b58?s=96&d=mm&r=g","caption":"Mailrelay"},"url":"https:\/\/mailrelay.com\/en\/blog\/author\/mailrelay\/"}]}},"uagb_featured_image_src":{"full":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",630,340,false],"thumbnail":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab-150x150.png",150,150,true],"medium":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab-300x162.png",300,162,true],"medium_large":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",630,340,false],"large":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",630,340,false],"1536x1536":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",630,340,false],"2048x2048":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",630,340,false],"testimonials":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab-110x59.png",110,59,true],"author-image":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",60,32,false],"yarpp-thumbnail":["https:\/\/mailrelay.com\/wp-content\/uploads\/2019\/04\/mailing-tests-ab.png",120,65,false]},"uagb_author_info":{"display_name":"Mailrelay","author_link":"https:\/\/mailrelay.com\/en\/blog\/author\/mailrelay\/"},"uagb_comment_info":0,"uagb_excerpt":"One of the features that has received an interesting improvement in this new version of Mailrelay is A\/B testing. This feature allows&nbsp; you to run a newsletter sending test on: Sender Or subject With a small subset of subscribers, and by looking at the results from that small group, you then send to the entire&hellip;","_links":{"self":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/posts\/96757","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/comments?post=96757"}],"version-history":[{"count":2,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/posts\/96757\/revisions"}],"predecessor-version":[{"id":96776,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/posts\/96757\/revisions\/96776"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/media\/39721"}],"wp:attachment":[{"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/media?parent=96757"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/categories?post=96757"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mailrelay.com\/en\/wp-json\/wp\/v2\/tags?post=96757"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}