Menu

Partial AdGuard VPN outage on November 22, 2023

On November 22, 2023, there was a disruption in the AdGuard VPN service that may have caused Internet access issues for a significant number of users. Primarily affected were users in locations such as Frankfurt, Amsterdam, London, and Dallas. We apologize for this outage and would like to provide more information about its causes and the steps we are taking to prevent such issues in the future.

It's always DNS

By default, AdGuard VPN users use AdGuard DNS Non-Filtering as their DNS server.

Why do we do this? The goal is to make you 'less noticeable' among Internet users. Normally, VPN services use the same VPN server as your DNS server. We believe this is not the best tactic, and matching your IP address with your DNS server's address can be a signal of using a VPN. By using a popular public DNS server (such as AdGuard DNS), you are sharing the same server as tens or hundreds of millions of other Internet users.

AdGuard DNS employs rate limiting to restrict the number of requests a user can send to the DNS server. This is a standard tactic to prevent DNS amplification (i.e., using a public DNS server to perform DDOS attacks on a third party). The rate limit is quite low, and some popular AdGuard VPN locations generate more requests than allowed. To work around this problem, we remove the rate limit for VPN servers. AdGuard DNS servers periodically request an updated list of IP addresses for which the rate limit should be disabled. This list is formed by a management service that knows all the IP addresses of all the VPN servers.

On November 22 at 9:14 UTC, a new version of the management service was deployed that contained an error. Due to this mistake, only part of the VPN server addresses were included in the allowed list. The 'busiest' locations (such as Frankfurt and Amsterdam) were immediately limited, and users faced Internet access issues.

The problem was exacerbated by several factors that delayed our understanding of what was happening. Firstly, there were no problems observed in smaller locations. Secondly, users did not immediately realize the nature of their problem. DNS query results are cached by the operating system, so everything seems to work fine for a while, and then a small portion of domains become inaccessible. Some might not have noticed the issue at all.

Finally, to our embarrassment, we had not set up automatic notifications for an increase in the number of DNS errors. Had we noticed this in time, the resolution time would have been significantly shorter. Below, you can see how much more DNS errors were registered in the system during the outage.

Link to DNS error chart

Incident timeline

9:14 UTC: Deployment of the management service fails.
9:30-9:40 UTC: We start getting the first individual complaints from users.
9:40-10:00 UTC: Investigating and searching for the source of the problem.
10:00-10:20 UTC: Preparing a fix in the management service.
10:20-10:30 UTC: Deploying the new version of the management service.
10:30-10:35 UTC: Restart of AdGuard DNS

Follow-up steps

To prevent similar problems in the future, we are taking the following steps:

  1. Automated notifications for increased DNS errors on VPN servers are now set up.
  2. Separate automated tests to check the creation of the exception list for DNS rate limiting have been added to the management service test suite.
Liked this post?
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Windows

Use any browser or app and never worry about your anonymity again. The entire world is at your fingertips with AdGuard VPN.
Learn more
Download
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Mac

In just two clicks, select a city from anywhere in the world — we have 70+ locations — and your data is invisible to prying eyes.
Learn more
Download
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Android

Remain anonymous wherever you go with AdGuard VPN! Dozens of locations, fast and reliable connection — all in your pocket.
Learn more
Google Play
By downloading the program you accept the terms of the License agreement
Download
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for iOS

Boost your online protection by taking it with you wherever you go. Use AdGuard VPN to enjoy your favorite movies and shows!
Learn more
App Store
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Android TV

Discover AdGuard VPN for Android TV! Enjoy seamless streaming, enhanced security, and easy setup.
Learn more
Google Play
By downloading the program you accept the terms of the License agreement
Download
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Chrome

Hide your true location and emerge from another place in the world — access any content without speed limits and preserve your web anonymity.
Learn more
Install
By downloading the program you accept the terms of the License agreement

AdGuard VPN
for Edge

Get to a different location in one click, hide your IP, and make your web surfing safe and anonymous.
Learn more
Install
By downloading the program you accept the terms of the License agreement

AdGuard VPN
for Firefox

Protect your privacy, hide your real location, and decide to where you need the VPN and where you don't!
Learn more
Install
By downloading the program you accept the terms of the License agreement

AdGuard VPN
for Opera

Be a ninja in your Opera browser: move quickly to any part of the world and remain unnoticed.
Learn more
Install
By downloading the program you accept the terms of the License agreement
9,332 9332 user reviews
Excellent!

AdGuard VPN
for routers

Install AdGuard VPN on your router to secure your entire network. Decide which devices to protect and when This option is only available with an AdGuard VPN subscription
Learn more
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Linux

Get the best free VPN for Linux and enjoy seamless web browsing, enhanced security, Internet traffic encryption, and DNS leak protection. Choose from multiple VPN servers and access the locations you want
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Apple TV

Discover AdGuard VPN for Apple TV! Enjoy seamless streaming, enhanced security, and easy setup This option is only available with an AdGuard VPN subscription
Learn more
9,332 9332 user reviews
Excellent!

AdGuard VPN for Xbox

Protect your Xbox with AdGuard VPN and enjoy seamless online gaming, enhanced security, and easy setup This option is only available with an AdGuard VPN subscription
Learn more
9,332 9332 user reviews
Excellent!

AdGuard VPN
for PS4/PS5

Protect your PlayStation with AdGuard VPN and enjoy seamless online gaming, enhanced security, and easy setup. Choose from multiple VPN servers and access the locations you want
This feature is only available with an AdGuard VPN subscription
Learn more
9,332 9332 user reviews
Excellent!

AdGuard VPN
for Chromecast

Install AdGuard VPN on your Google TV (Chromecast Gen 4) or on your network router (Chromecast Gen 3) and enjoy streaming content with Chromecast while staying anonymous online and accessing content from anywhere. For Chromecast Gen 3, you need an AdGuard VPN subscription
Learn more
AdGuard VPN
download has started
Click the button indicated by the arrow to start the installation.
Scan to install AdGuard VPN on your mobile device