This guide is a brief summary of email best practices that we have learned from managing mail servers for thousands of customers and sending (and receiving) a lot of email. The objective is to help outline what you need to do to have your emails delivered whether or not you use Mailgun. Of course, if after reading the guide you decide that you have better things to do than maintaining email servers and managing email deliverability, we’d love to help!
In this guide, we will not focus much on the content of email messages. Content can be paraphrased with a few words: ‘send something people want’ (to paraphrase Y Combinator’s motto). Creating good content is probably the hardest part, so apologies for the huge caveat. We focus on the infrastructure and monitoring of email so that if you are sending something people want, they will get it; and if you are not sending something people want, you will know about it and hopefully change that.
Reputation¶
And since engagement is an important element of email deliverability, let’s look at ways how you can improve your brand identity: Use your own custom domain to send your email campaigns (as opposed to free email domains like Gmail) Use consistent Email fields (From, Name, and Address) across all your campaigns. By sending regular emails, your email deliverability score is likely to improve. Sending random emails can lower your sender score — an important number that shows your sender reputation. If your sender score is too low, mailbox providers might reject your email outright. A consistent email sending schedule can help improve email deliverability. I’ve collected 12 of the smartest and most effective techniques for improving email deliverability. Prime your IP for success. The job of ISP filters is to defend against spam emails. Many factors impact email delivery rates. The time it takes to deliver your email campaign to your entire audience depends on the sending server's reputation, the email's content, and its recipients. Email send times will also depend on the size of your audience, and on the current mail queue at Mailchimp.
One of the most important assets you have in the email world (much like the real world) is your reputation. If you do not have a good reputation tied to your domain and your IP address (“IP” used herein for abbreviation), your email will not reach your recipients’ inboxes. Due to its popularity and its unique ability to push information to users, email has been overrun with spammers (as if you didn’t notice). Depending on your definition, approximately 90% of all email is spam (source: MAAWG). Due to this, email service providers (“ESPs”) like Gmail, AOL, Yahoo and MSN/Hotmail have declared an all-out war on spammers. This has made our inboxes a more pleasant place. This also makes it very important to manage your email reputation. If it is not impeccable, you will get caught in the ESPs’ spam filters.
A good analogy for your email reputation is your personal credit score. Obviously, a bad reputation will hurt you. However, not having a reputation will also hurt you. If ESPs don’t know you (or more specifically your IP and domain) they will assume the worst and filter you, at least initially. It’s tough to blame them given all the spam out there. Due to the importance of reputation, a significant portion of our discussion on best practices revolves around building and maintaining your email reputation.
Our goal with respect to your email reputation is to make sure that the infrastructure is optimized for emails reaching the inbox and doesn’t get in your way. We test all of our IPs’ reputation before we allocate them and we use the authentication methods that major ESPs require.
Beyond making sure that the infrastructure is properly set up, we also provide the tools to answer some important questions:
- Are emails being delivered and if not, why?
- Is a recipient ESP throttling your traffic and why?
- Are messages bouncing due to incorrect domains or stale addresses?
- Are recipients unsubscribing or complaining of spam?
- Are recipients engaging with your emails by opening them and/or clicking on links?
You should use all of this data to make sure that you are complying with ESPs guidelines and adjust your email sending to stay in their good graces.
We give you all the tools for establishing a good sending reputation, but it’s ultimately up to you to send emails appropriately. Some email service providers use F.U.D. about email deliverability to sell you a deliverability fairy that magically gets your emails to the inbox. This is most definitely not the case and your actions, as the email sender, play the biggest part in good deliverability.
However, if you follow a couple rules (along with properly authenticating your email), you will most likely build up a great email sending reputation:
- Only send emails to people that have signed-up to receive them from your website/application/service and always first send a confirmation link to confirm their address is correct (aka, “double opt-in”); and
- Track your email and adjust your sending based on feedback from ESPs and recipients (eg., don’t send additional emails to recipients that have unsubscribed or complained of spam).
Hosting¶
A brief note on hosting since hosting technology is changing so quickly, it will likely be out of date in a few months. Large, virtual cloud environments are generally not the best environments for email for a few reasons:
- The IP address should be static so that your domain(s) & IP address(es) build a reputation together. Also, some more strict recipients ESPs may require whitelisting your IP address. Unfortunately, these should be IPv4.
- The IP address and surrounding IP addresses should have a good reputation. This is rarely the case at large cloud environments due to their ease of use and lax monitoring (which is inviting to spammers).
- Mail Transfer Agents should ideally be on real (non-virtual) machines, optimized for I/O.
We host Mailgun mostly on dedicated servers. We do use cloud servers for some of the infrastructure (where it makes sense), but for most of Mailgun we like large, robust, dedicated machines.
We use dedicated IP addresses in large subnets and we do background checks and extensive testing on our IP addresses. Because they are in large continuous blocks, they are less likely to be affected by other, external IP addresses. ESPs and blacklists occasionally block entire subnets if any of the IPs have questionable reputations. So even if your IP is clean, it might be blocked because of surrounding IPs. Larger subnets mitigate this risk.
We dream of a day when IP reputation does not matter and we can rely on domain reputation, but unfortunately we are not there yet.
IP Addresses and Sending Volume¶
If you are sending a lot of email (greater than 50k per week), it is a good idea to have a dedicated IP in order to isolate your reputation. If you are sharing your IP, you are sharing your reputation with those other senders. In addition, ESPs rate limit your emails based on the IP. So if you are a high volume sender you should consider getting a pool of IPs. However, your reputation can also be hurt if you are not sending enough volume consistently from an IP so it’s a tricky balance.
Email Deliverability Blog
If your email sending is volatile with large spikes of volume, ESPs may assume those large spikes are spam. Also, if you overall volume is too low, they won’t acknowledge your reputation. Generally, if you are sending less than 5,000 emails per day, a shared IP may be the right solution.
The other thing to consider is using separate IPs for your bulk and transactional mail if you are sending high volumes of email. There are a couple reasons for this:
- Delivery of time-sensitive transactional emails may get queued behind a large batch of bulk/marketing emails.
- Your transactional mail will be affected by the reputation created by your bulk/marketing mail.
Even if you have a clean IP address, you need to warm up the IP gradually. This means sending emails at a low rate initially and then gradually increasing that rate, taking into account ESP feedback. If you send a ton of emails right away, they will get filtered or dropped by the ESPs. In some cases, they won’t even tell you they are dropping them.
Mailgun offers both shared and dedicated IPs. We are constantly monitoring the traffic on these IPs. So even for shared IPs, you can be comfortable that your reputation is not being unduly influenced by others. We also offer pools of IPs for high volume senders. In addition, we have queuing algorithms that gradually warm up your IPs. Our sending rates automatically increase over time as your IP warms up. Finally, we separate our sending queues for each domain you set up at Mailgun, which mitigates the need for multiple IPs for different types of traffic.
DNS¶
Your email reputation is not only tied to your IP, but your domain name as well. You should keep this in mind as you set up your email infrastructure. For the same reasons as above, It is a good idea to have separate domains or subdomains for your marketing, transactional and corporate mail. We suggest that you use your top level domain for your corporate mail and using different domains or subdomains for your marketing and transactional mail.
While it is not required to use the same domain in the From field of the message as the actual domain sending the message, it is highly recommended. Hotmail is especially finicky about this requirement and has a higher propensity to filter your messages to junk if the two domains do not match.
You should also make sure that you are using a well regarded DNS provider and that you publish all of your contact information in the WHOIS record. If you are hiding your contact information through a proxy, ESPs may take that as a signal that you are spamming.
Also, make sure you include the appropriate records at your DNS provider for authentication (see below). While it’s not required to point mx records to the same domain as you are sending from, it is recommended. There are email providers (albeit, a minority) that will check if mx records for the domain are valid before accepting email.
Mailgun gives you the ability to create multiple domains or subdomains very easily. You are free to create multiple domains and subdomains for each of your transactional, marketing and corporate email. Each domain has an isolated queue, so your transactional emails won’t get held up by your bulk mailings.
Authentication¶
It is very important that you are using the appropriate authentication methods with your email. If you are not authenticating your email properly, ESPs will assume you are spamming and will filter or just drop your email.
The common types of authentication are:
Mailgun uses all of these types of authentication. When you sign up for Mailgun, we provide the appropriate records for you to include at your DNS registrar. We also provide a verification button you can use to make sure that your records are set up correctly.
Mailing Lists¶
The number one reason we see people get blocked is because they have a bad mailing list. Don’t purchase your list or scrape websites for emails. It’s the easy way out and you will pay the consequences. Most of these lists have bad email addresses and include spam traps. ESPs are very good at recognizing bad mailing lists.
You should only send emails to people that have opted in to receiving your emails on YOUR website. In addition, you should be sending a verification email with a link that confirms their subscription (double opt-in) to make sure their email address is correct and that they are the person that signed up. If everyone did this, the world would be a better place.
You should have your Privacy Policy easily accessible on your website. In addition, you should have a place on your website where users can unsubscribe from your mailings, in addition to a link in every email you send (see Unsubscribe Handling).
While we have to rely on you to be responsible about how you procure your mailing list, we do track and give you data to easily see how your emails are being received. We give you information for bounces, unsubscribes, complaints, opens and clicks so that you can modify your mailing lists appropriately. In addition, we automate a lot of the work by keeping track of recipients that have unsubscribed, bounced or complained and stopping future deliveries to those recipients. We give you various levels of unsubscribe granularity so your recipients can unsubscribe to all emails from the domain, just that mailing list or just emails with that “tag” (which you define).
Bounce and ESP Feedback Handling¶
A big part of maintaining your email reputation is processing bounces properly. While most major ESPs give bounce replies “on the wire” during the SMTP session, there are some that send bounce messages via email. In order receive these emailed bounce messages, you must have the appropriate return path header included with your email so that recipients know where to reply with bounce information.
You must also process this bounce data and act accordingly. In addition, many ESPs will soft bounce your initial attempts at delivery. This is also called grey-listing or throttling. If you continue to send emails to bad addresses or you do not listen to ESPs feedback, you will get filtered and eventually your emails will just get dropped.
Mailgun automatically processes bounce information and reacts accordingly. A good portion of Mailgun’s technology is devoted to the parsing of this feedback and adjusting your sending in accordance with this feedback so that you maintain a good reputation.
If we receive a hard bounce, we will stop sending to that address immediately and will not attempt future deliveries to that address. We will stop sending to an address after multiple soft bounces, according to the ESPs’ guidelines. It is possible to remove addresses from the flagged list in your Control Panel or through the API, in case it was a temporary issue.
Please see our User Manual for more information.
Feedback Loops and Spam Complaints¶
Most of the major ESPs (other than Gmail) provide feedback loops through which they give you information about spam complaints. Here is a thorough list from Word to the Wise. It is important that you sign up for these feedback loops and pay attention to the feedback you are getting. If you ignore this feedback, ESPs will throttle you and eventually block you completely.
We register all of our IPs for these feedback loops. You can access this information through the Control Panel, the API or Webhooks. In addition, we process spam complaints automatically and will stop sending to email addresses after a recipient complains. It is possible to remove addresses from the flagged list in your Control Panel or through the API.
Please see our User Manual for more information.
Unsubscribe Handling¶
Improve Email Deliverability
It is important to give your recipients the ability to unsubscribe from emails. First, it is required by the CAN-Spam Act. Second, if you don’t give them this option, they are more likely to click on the spam complaint button, which will cause more harm than allowing them to unsubscribe. Finally, many ESPs look for unsubscribe links and are more likely to filter your email if they don’t have them.
Mailgun gives you the ability to include an unsubscribe link or email automatically in your email. We give you the ability to link the unsubscribe to a certain campaign, mailing list or make the request global to your domain. You can access this data through the Control Panel, API or via Webhooks. In addition, we will automatically stop sending to email addresses that have unsubscribed. It is possible to remove addresses from the flagged list in your Control Panel or through the API.
Please see our User Manual for more information.
Recipient Engagement¶
In addition to processing bounces, complaints and unsubscribes, ESPs measure your reputation through the engagement of your recipients. If recipients are opening, forwarding and replying to your emails, it will improve your reputation. This is what makes ‘do-not-reply’ emails so offensive. At many ESPs, it is also helpful if recipients add your email address to their address books.
Mailgun allows you to track opens and link clicks with our Tracking and Tagging functionality (see our User Manual for more information). You are free to create up to 4,000 tags and use them simultaneously for A/B testing. In addition, Mailgun is built to receive and parse emails efficiently. So there is no excuse to not allow your recipients to reply to your emails. Email is not a billboard - it is a conversant technology.
Email Content¶
There are a few tricks to remember about content besides the mantra of ‘sending something people want’. As mentioned above, you can set up a test mailbox at Mailgun and enable our spam filters to receive a “spamicity” score to test how your content is being judged by spam filters.
- Personalize your emails to each recipient. Ideally, the content should reflect recipient’s specific interests or usage patterns in your application. At least address them by their name…don’t be rude!. Mailgun has recipient variables that you can define and use with your email templates to achieve detailed levels of personalization.
- It is best to send multi-part emails using both text and HTML or text only. Sending HTML only email is not well received by ESPs. Also, remember that ESPs generally block images by default so HTML only will not look very good unless users are proactive about enabling images. There are a few tools available to test how your email will render across ESPs and browsers. Litmus offers one, as does Return Path.
- The higher the text to link and text to image ratios, the better. Too many links and images trigger spam flags at ESPs.
- Misspellings, spammy words (buy now!, Free!) are big spam flags, as are ALL CAPS AND EXCLAMATION MARKS!!!!!!!!!!!!!
- The domains in the from field, return-path and message-id should match the domain you are sending from.
- Make sure you are using unsubscribe links and headers in your emails. Many ESPs (particularly Hotmail) pay attention to this and if they are not there, you are likely to get filtered. You can always use Mailgun’s auto unsubscribe handling if you don’t want to deal with this on your end.
- Gmail pays particularly close attention to Message ID and Received headers. Message IDs that are formed incorrectly (without brackets <> and with wrong domain after @) can make Gmail think you are a spammer. The simplest way to create the right Message ID with Mailgun is to not include one. Then Mailgun will create a perfect Message ID for you.
- Links should include the domain that is sending the email. Also, popular url shorteners can be a bad idea because they are frequently used by spammers.
- A/B test your emails to optimize recipient engagement. Subject lines are particularly important. You can use Mailgun’s tagging and tracking statistics in order to measure A/B testing and improve your content.
Best of luck with your emailing…we hope we made it easier!
Learning Objectives
After completing this unit, you’ll be able to:
- Explain effective methods to improve deliverability.
- Describe how to protect your messages from spam filters.
It’s All About Deliverability
Deliverability is the key to all email marketing. If your email isn’t reaching the majority of your subscribers, then what’s the point of sending it?
Let’s talk about best practices you can use to ensure your emails are signed, sealed, delivered, and wanted. What do we mean when we say deliverability? It refers to the various stages of an email’s life: the sending, receiving, and opening of an email.
Who’s This From?
Some Internet service providers show only the From address, rather than the name and address of the sender. Because the From address can be just a mixture of letters and numbers instead of a recognizable name, recipients can think your email is spam. To avoid this, include an actual name in the From address.
Another way to ensure your subscribers recognize an email is from you is to add the name of your organization to the subject line. Using your organization name in both the From address and the subject line will decrease the chances your email will end up in spam folder.
Bounce and Purge
When you send out marketing emails, you often receive bounce-back messages alerting you to defunct email accounts. It‘s critical that you remove any bounced addresses from your mailing lists between one marketing message and the next that you send. Even though most email marketing systems stop sending to addresses that bounced a set number of times, a bounce rate over 20% for any single mailing can have serious consequences. This is because if deliverability is bad, your IP address can be put on a blocklist or even shut down. Don’t let that happen. Nip it in the bud.
We also recommend purging old or inactive addresses from your mailing lists. Don’t keep those names and emails that you haven’t emailed in months. Don’t spend money on sending emails that aren’t even being opened.
The same holds for those subscribers who haven’t opened your emails in months—remove them from your mailing lists using either a suppression list or more permanently, contact deletion. They detract from your profitability because it costs money to contact them, and they’re more likely to complain about your emails. With the Salesforce Marketing Cloud, you can run reports that show you which subscribers are unengaged or have not opened an email or clicked.
Note
Learn how to run reports and track results in the Trailhead module: Marketing Cloud Setup.
Manage Email Frequency
Another best practice is to deliver what you promise. If you promised a monthly newsletter, make sure you send it monthly. Not bimonthly, not every other week—monthly. Not only do you want your communications with your subscribers to be personal and relevant, you want them to be anticipated. If your messages don’t score a hit on those three points, is there really a need to send the content you’re sending?
Note
You can also use AI to help out! Activate Einstein Engagement Frequency to evaluate your email activities and identify the optimum number of email messages to send.
Spam Filters
How To Improve Email Deliverability
Most Internet service providers use filters to sort legitimate email from the junk or spam. There are more than 300 spam-filtering companies. They vary in the filter logic they use, but most spam filters use content—or keyword-based logic. Others might incorporate email volume from any one sender, customer complaints into their algorithms. Some function on a score basis and filter messages that rate high as spam after the characteristics of the message (content, volume, response, and sender) have been reviewed using anti-spam filters.
Deliverability is key when it comes to your emails. So think about everything that can affect deliverability and use it to your advantage when sending your emails!
Your emails are now being delivered directly to your subscribers’ inboxes and are tempting your readers with offers they can’t resist. That’s great, but how do you get these subscribers in the first place? That’s the topic of our next unit.
Resources
- External Site: Ultimate Guide to Deliverability (Download required)