{"id":388119,"date":"2024-06-29T07:44:41","date_gmt":"2024-06-29T07:44:41","guid":{"rendered":"http:\/\/savepearlharbor.com\/?p=388119"},"modified":"-0001-11-30T00:00:00","modified_gmt":"-0001-11-29T21:00:00","slug":"","status":"publish","type":"post","link":"https:\/\/savepearlharbor.com\/?p=388119","title":{"rendered":"<span>The 2020 National Internet Segment Reliability Research<\/span>"},"content":{"rendered":"<div><!--[--><!--]--><\/div>\n<div id=\"post-content-body\">\n<div>\n<div class=\"article-formatted-body article-formatted-body article-formatted-body_version-1\">\n<div xmlns=\"http:\/\/www.w3.org\/1999\/xhtml\"><img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/lu\/kl\/io\/lukliopkf5rrs0imdo1e_adaogg.png\" data-src=\"https:\/\/habrastorage.org\/webt\/lu\/kl\/io\/lukliopkf5rrs0imdo1e_adaogg.png\"\/><br \/>  The National Internet Segment Reliability Research explains how the outage of a single Autonomous System might affect the connectivity of the impacted region with the rest of the world. Most of the time, the most critical AS in the region is the dominant ISP on the market, but not always.<\/p>\n<p>  As the number of alternate routes between AS\u2019s increases (and do not forget that the Internet stands for \u201cinterconnected network\u201d \u2014 and each network is an AS), so does the fault-tolerance and stability of the Internet across the globe. Although some paths are from the beginning more important than others, establishing as many alternate routes as possible is the only viable way to ensure an adequately robust network.<\/p>\n<p>  The global connectivity of any given AS, regardless of whether it is an international giant or regional player, depends on the quantity and quality of its path to Tier-1 ISPs.<\/p>\n<p>  Usually, Tier-1 implies an international company offering global IP transit service over connections with other Tier-1 providers. Nevertheless, there is no guarantee that such connectivity will be maintained all the time. For many ISPs at all \u201ctiers\u201d, losing connection to just one Tier-1 peer would likely render them unreachable from some parts of the world.<br \/>  <a name=\"habracut\"><\/a>  <\/p>\n<h3>The Methodology of Internet Reliability Measurement<\/h3>\n<p>  Examining a case when an AS experiences network degradation, we want to answer the following question: \u201cHow many AS\u2019s in the same region would lose connectivity with Tier-1 operators and their global availability along with it?\u201d<\/p>\n<p>  Throughout the years we model such a situation because at the dawn of BGP and interdomain routing design its creators assumed that every non-transit AS would have at least two upstream providers to guarantee fault tolerance in case one of them goes down.<\/p>\n<p>  However, the current reality is different; with less than half of all ISPs in the world having only one connection to an upstream transit provider. A range of unconventional relationships among transit ISPs further reduces availability.<\/p>\n<p>  Have transit ISPs ever failed? The answer is yes, and it happens with increasing frequency. The more appropriate question is \u2014 under what conditions would a particular ISP experience service degradation so severe we would call it an outage? If such problems seem unlikely, it may be worth considering Murphy\u2019s Law: \u201cAnything that can go wrong, will\u201d.<\/p>\n<p>  To model such a scenario, we have applied the same model for the fourth year in a row. Although again, we did not merely repeat previous calculations \u2014 the research is expanding over the years.<\/p>\n<p>  <b>The following steps were taken to rate AS reliability<\/b>:<\/p>\n<ul>\n<li>For every AS in the world, we examine all alternate paths to Tier-1 operators with the help of an AS relationship model, the core of Qrator.Radar;<\/li>\n<li>Using the Maxmind GeoIP database, we matched countries to every IP address of every AS;<\/li>\n<li>For every AS we calculated the share of its address space that corresponds to the relevant region. ISP\u2019s were filtered out that reside at an Internet Exchange point in a region where they do not have a significant presence. The example we are using here is Hong Kong, where traffic is exchanged among hundreds of members of HKIX \u2014 yet the biggest Asian Internet Exchange, most of which have zero presence in the local internet segment;<\/li>\n<li>After isolating regional ASs, we analyzed the potential impact of one\u2019s outage on other AS\u2019s as well as their respective countries;<\/li>\n<li>In the end, for each country, we identified the AS with the greatest\/largest impact on other ASes in their region. Foreign AS\u2019s were not considered.<\/li>\n<li>We took that AS\u2019s impact value as a reliability score for the country. And used that score to rate reliability of countries. The less score\u00ad is \u2014 the better reliability is.<\/li>\n<\/ul>\n<p>  <\/p>\n<h3>IPv4 Reliability<\/h3>\n<p>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/v8\/b_\/3d\/v8b_3dbkqfafcs66dt1pxzja6am.png\" data-src=\"https:\/\/habrastorage.org\/webt\/v8\/b_\/3d\/v8b_3dbkqfafcs66dt1pxzja6am.png\"\/><br \/>  The 2019 column represents the score that an individual country had in the 2019 rating on a certain position.<\/p>\n<p>  <b>Long Story Short<\/b>:<\/p>\n<ul>\n<li>The United States regained 10 out of 11 positions they lost in 2019, residing at position 8 in 2020;<\/li>\n<li>Four new countries entered the Top-20 of reliability rating: Liechtenstein, Japan, Indonesia and Argentina.<\/li>\n<li>Four countries effectively left the Top-20: Ireland, Bulgaria and Luxembourg and Czech Republic, which is residing at position 21 this year.<\/li>\n<li>Hong Kong dropped eight positions and closes the Top-20 in 2020;<\/li>\n<li>Singapore lost 11 positions.<\/li>\n<li>A longtime leader of the rating \u2014 Germany \u2014 gave way to Brazil, the 2020 leader of reliability rating.<\/li>\n<li>Every year exciting movements happen in the reliability rating, often corresponding to what is happening inside the respective regions.<\/li>\n<\/ul>\n<p>  First things first \u2014 the overall trend in global reliability, counted as an average and medium. This time we are looking at the five years of continuous research:<br \/>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/s2\/be\/kb\/s2bekb6e9w12uhe73ulmlkueyze.png\" data-src=\"https:\/\/habrastorage.org\/webt\/s2\/be\/kb\/s2bekb6e9w12uhe73ulmlkueyze.png\"\/><br \/>  In 2020 the number of countries that successfully improved reliability score to under 10%, indicating high fault tolerance, increased by 5 for the second year in a row, reaching a total of 40.<\/p>\n<p>  As you can also see, the average reliability score is improving over time. However, the median stays at comparable levels since 2018 \u2014 the lower part of the rating does not improve quickly enough, compared to the upper half.<\/p>\n<p>  However, the most significant fact remains \u2014 for the period of our research, both IPv4 and IPv6 show significant improvements in reliability. Furthermore, there is an inevitable point in the future, where the IPv6 version of the rating would become the primary one.<\/p>\n<h3>IPv6 Reliability<\/h3>\n<p>  In 2020 it seems that something has changed in the perception and adoption of the IPv6 protocol. Google obtains the most appropriate statistics we want to mention.<\/p>\n<p>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/ex\/r9\/9b\/exr99bd8erbljamwwi-ud0g-7gw.png\" data-src=\"https:\/\/habrastorage.org\/webt\/ex\/r9\/9b\/exr99bd8erbljamwwi-ud0g-7gw.png\"\/><br \/>  As of September 2020, almost 30% of Google users use the native IPv6 connection, which effectively translates into their ISPs supporting the v6 version of IP protocol.<\/p>\n<p>  Although the main issue with IPv6 still persists \u2014 that is the partial connectivity. Due to peering wars, not universal IPv6 adoption and other issues, the IPv6 still has the problem of limited network visibility. To better understand this, take a look at the IPv6 reliability versus the partial connectivity rate.<\/p>\n<p>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/tv\/tl\/9t\/tvtl9trfdwr18yq4o33tinjdxzc.png\" data-src=\"https:\/\/habrastorage.org\/webt\/tv\/tl\/9t\/tvtl9trfdwr18yq4o33tinjdxzc.png\"\/><br \/>  It is evident from this IPv6 Top-20 Reliability to Partial Connectivity Comparison chart that there are several countries where the partial connectivity in IPv6 exceeds 10%: Italy, Hong Kong, Ireland, Romania. <\/p>\n<p>  Looking at the partial connectivity combined with \u201cclassic\u201d reliability percentage, showing the share of unavailable in case of an outage resources, we could state that in Hong Kong alone the IPv6 failure of AS3491 would result in 18% of IPv6-connected resources rendered unavailable. 16% in Ireland; almost the same in Italy and Romania. Those numbers are high even in Great Britain \u2014 7.5%, Germany \u2014 8%, United States \u2014 15%. <\/p>\n<p>  The lowest value among IPv6 Top-20 belongs to Brazil \u2014 4.66%, Netherlands \u2014 4.72% and Japan \u2014 5.24%.<\/p>\n<p>  It seems that in the year 2020 the tides turned and the IPv6 reliability, even considering the partial connectivity, looks better than that of IPv4. Average IPv4 reliability score in 2020 is 36.22%, and for IPv6 the same metrics is as high as 28.71% \u2014 and as we measure the outage impact, the lower the metric is \u2014 the better. However, it is necessary to mention that the country adoption for IPv6 is twice as low, as in the IPv4 case \u2014 the newer version of the protocol still has to go a long way to the total adoption.<\/p>\n<h3>Broadband Internet and PTR records<\/h3>\n<p>  \u201cDoes a country\u2019s leading ISP always influence regional reliability more than everyone else?\u201d \u2014 this is the question we are trying to answer with the help of additional information and investigation. We suggest that the most significant (by user base or customer base) ISP in a region is not necessarily the most critical for the region\u2019s network connectivity.<\/p>\n<p>  Two years ago, we started to analyze the PTR records. Generally, PTR records are used for Reverse DNS lookup: using the IP-address to identify the associated hostname or domain name.<\/p>\n<p>  Since we already know the largest AS\u2019s for every country in the world, we could count the PTR records within their network and determine their share of overall PTR records for the corresponding region. We counted only PTR records and did not calculate the ratio of IP-addresses without PTR records to IP-address with them.<\/p>\n<p>  So, we are speaking strictly of IP-addresses with PTR records present. The practice of adding those is not universal; some providers do this and others do not.<\/p>\n<p>  In the PTR-based rating, we are looking at what part of PTR-enabled IP-addresses would go offline with an outage of each country\u2019s AS and the percentage that represents the relevant region.<\/p>\n<p>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/du\/3w\/i_\/du3wi_evjcnm44vfc30gs_trv1y.png\" data-src=\"https:\/\/habrastorage.org\/webt\/du\/3w\/i_\/du3wi_evjcnm44vfc30gs_trv1y.png\"\/><br \/>  Such an approach that considers PTR-records yields very different results. In most cases, not only does the primary regional AS change, but the percentage is entirely different. In all of the generally reliable (from the global availability point of view) regions, the number of PTR-enabled IP-addresses that shut down following an outage of one autonomous system is dozens of times higher. That could mean that the leading national ISP always handles end-users at one point or another. <\/p>\n<p>  Thus, we should assume that this percentage represents the part of the ISP\u2019s user base and customer base that would go offline (if switching to a second internet service provider were not possible) in the event of an outage. From this perspective, countries appear to be less reliable than they look from the transit point of view. We leave possible conclusions from this PTR-enabled rating to the reader.<\/p>\n<h3>ISPs With Only One Upstream (Stub networks) and Their Reliability<\/h3>\n<p>  In seven out of the top twenty IPv4 Reliability Rating countries, we found a peculiar detail. Suppose we look for the largest provider for <a href=\"https:\/\/en.wikipedia.org\/wiki\/Stub_network\">\u201cstub networks\u201d<\/a>, which are essentially networks with only one upstream provider. In that case, we will find another AS and ISP, different from the one responsible for the current classical reliability metric for the corresponding national segment.<\/p>\n<p>  <img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/cl\/5g\/9m\/cl5g9mrdmfc-qzcrlx-iy1naala.png\" data-src=\"https:\/\/habrastorage.org\/webt\/cl\/5g\/9m\/cl5g9mrdmfc-qzcrlx-iy1naala.png\"\/><br \/>  Here we highlighted the countries from both the top of IPv4 Reliability Rating and IPv6 Reliability Rating for 2020.<\/p>\n<p>  Let\u2019s talk about the most visible differences between the critical AS in terms of global transit versus the primary upstream choice in a specific region. It is interesting to notice that rarely a critical AS for stub networks would not be the classical global critical AS simultaneously.<\/p>\n<p>  <a href=\"https:\/\/radar.qrator.net\/as174\">AS174<\/a> \u2014 Cogent \u2014 is special in IPv4. Cogent\u2019s changes are always interesting to investigate \u2014 as a Tier-1 with a strong presence in Europe it has a tremendous responsibility, as it is also a critical AS for stub networks, as well as the global transit. In 2020 it is critical AS for IPv6 stub networks in France and Belgium, and in IPv4 Cogent is responsible for all the reliability metrics in Great Britain, France, Belgium (from the IPv4 top 20), but also Ireland\u2019s and Vatican\u2019s global reliability metrics.<\/p>\n<p>  However, the Hong Kong example is somewhat outstanding. The classical critical AS for the region\u2019s IPv4 connectivity is <a href=\"https:\/\/radar.qrator.net\/as3491\">AS3491<\/a> \u2014 PCCW Global, a Tier-1 ISP. However, the stub networks\u2019 critical AS is an <a href=\"https:\/\/radar.qrator.net\/as4515\">AS4515<\/a> \u2014 ERX-STAR \u2014 connected to both PCCW Global and Hong Kong IX. So for ERX-STAR, the situation is the following \u2014 if AS3491 somehow fails \u2014 it would still retain the regional connectivity through the IX, if, on the other hand, IX fails \u2014 the data would be still globally available through the Tier-1 network.<\/p>\n<p>  That is a particular example of how a significant and profound Internet Exchange in one region could be a substitute for the second strong upstream provider. If there is a big IX nearby, by connecting to it and to only one classical transit ISP you could get almost the same regional reliability as by connecting to the two transit upstreams. Although, once again, IX is not able to fully replace the Tier-1 connection in the global sense \u2014 It\u2019s an excellent example of regional versus global connectivity.<\/p>\n<p>  <a href=\"https:\/\/radar.qrator.net\/as6939\">AS6939<\/a> \u2014 Hurricane Electric \u2014 is the stub networks\u2019 critical autonomous systems in both Hong Kong and the U.S.A. for IPv6. <\/p>\n<p>  In the IPv4 it also changes \u2014 in the U.S.A. the classical reliability arises from the position of <a href=\"https:\/\/radar.qrator.net\/as3356\">AS3356<\/a>, belonging to the CenturyLink ISP \u2014 but the critical AS for stub networks in v4 is AT&amp;T\u2019s <a href=\"https:\/\/radar.qrator.net\/as7018\">AS7018<\/a> \u2014 another Tier-1 in the national segment of United States.<\/p>\n<h3>Details by Regions<\/h3>\n<p>  One of the most important questions to ask ourselves while conducting the 2020 research was: \u201cHow was it possible for the U.S. segment to regain some reliability after the dramatical 11 positions drop last year and improve the fault tolerance of the national segment\u2019s Internet, without swapping the ISP in question \u2014 CenturyLink?\u201d<\/p>\n<p>  Well, the first thing is that CenturyLink could have lost some of its market value, and this is probably the main reason why the numbers improved. Although it is hard to say for sure, we tend to think that CenturyLink\u2019s outages in the previous years, and <a href=\"https:\/\/radar.qrator.net\/blog\/another-centurylink-bgp-incident\">the most recent one<\/a>, probably motivated their customers to at least try to find some additional transit capabilities, if not refusing the further CenturyLink service at all.<\/p>\n<p>  Hong Kong\u2019s position drop from 2019 to 2020 transition could be connected to the changing situation within the region, although PCCW\u2019s market share almost evidently fluctuated during this year.<\/p>\n<p>  We outlined the Singaporean change in critical AS for the region in the last year\u2019s research and, looking at the current change; we could state that <a href=\"https:\/\/radar.qrator.net\/as4657\">AS4657<\/a> could be conquering the market further, consolidating as the primary ISP of the country \u2014 this would inevitably lead to the drop of the reliability score.<\/p>\n<p>  As we write this research from the Czech Republic, we feel ourselves obligated to highlight the crucial detail about CZ\u2019s Internet segment. It is probably the only region we know for sure that does not have a single ISP business behind the critical autonomous system for the country. Instead, <a href=\"https:\/\/radar.qrator.net\/as47232\">AS47232<\/a> \u2014 ISPAlliance \u2014 which is critical all around the metrics (classical global transit and stub networks), is a free and voluntary union of smaller ISPs within the Czech Republic. As the company writes on its \u201cAims and vision\u201d page:  <\/p>\n<blockquote><p>\u201cLocal telecommunications operators face many difficulties on the market, which put them at a disadvantage vis-\u00e0-vis the \u201cbig brands\u201d of multinational competition and those who do not play fair. ISP Alliance a.s. we set it up to overcome these difficulties.\u201d <\/p><\/blockquote>\n<p>  It does help to overcome the presence of much more significant players in the national segment! That is a good example of a group unification over a reasonable common goal, resulting in a good reliability score, as even with the entering of the Top 20 by four new countries in 2020, Czech Republic is at the position 21 with the reliability score of 6.5%. Moreover, such a small (compared to the other leaders\u2019 size) national segment taking eight place in the quantity of IPv6 enabled ASes is simply a thing that should be thanked for to everyone involved in building and maintaining computer networks.<\/p>\n<p>  Thank you for reading the Reliability Research! In case you have any questions, feel free to contact us on <a href=\"mailto:radar@qrator.net\">radar@qrator.net<\/a>.<\/div>\n<\/div>\n<\/div>\n<p><!----><!----><\/div>\n<p><!----><!----><br \/> \u0441\u0441\u044b\u043b\u043a\u0430 \u043d\u0430 \u043e\u0440\u0438\u0433\u0438\u043d\u0430\u043b \u0441\u0442\u0430\u0442\u044c\u0438 <a href=\"https:\/\/habr.com\/ru\/articles\/518650\/\"> https:\/\/habr.com\/ru\/articles\/518650\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<div><!--[--><!--]--><\/div>\n<div id=\"post-content-body\">\n<div>\n<div class=\"article-formatted-body article-formatted-body article-formatted-body_version-1\">\n<div xmlns=\"http:\/\/www.w3.org\/1999\/xhtml\"><img decoding=\"async\" src=\"https:\/\/habrastorage.org\/r\/w1560\/webt\/lu\/kl\/io\/lukliopkf5rrs0imdo1e_adaogg.png\" data-src=\"https:\/\/habrastorage.org\/webt\/lu\/kl\/io\/lukliopkf5rrs0imdo1e_adaogg.png\"\/><br \/>  The National Internet Segment Reliability Research explains how the outage of a single Autonomous System might affect the connectivity of the impacted region with the rest of the world. Most of the time, the most critical AS in the region is the dominant ISP on the market, but not always.<\/p>\n<p>  As the number of alternate routes between AS\u2019s increases (and do not forget that the Internet stands for \u201cinterconnected network\u201d \u2014 and each network is an AS), so does the fault-tolerance and stability of the Internet across the globe. Although some paths are from the beginning more important than others, establishing as many alternate routes as possible is the only viable way to ensure an adequately robust network.<\/p>\n<p>  The global connectivity of any given AS, regardless of whether it is an international giant or regional player, depends on the quantity and quality of its path to Tier-1 ISPs.<\/p>\n<p>  Usually, Tier-1 implies an international company offering global IP transit service over connections with other Tier-1 providers. Nevertheless, there is no guarantee that such connectivity will be maintained all the time. For many ISPs at all \u201ctiers\u201d, losing connection to just one Tier-1 peer would likely render them unreachable from some parts of the world.  <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-388119","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts\/388119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=388119"}],"version-history":[{"count":0,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=\/wp\/v2\/posts\/388119\/revisions"}],"wp:attachment":[{"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=388119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=388119"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/savepearlharbor.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=388119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}