In 2019 7 million visitors arrived in Jeddah during Ramadan (5th May to 3rd June) compared to its normal population of between 4 and 5 million. Google’s own insight report shows that demand increases during Ramadan as well. In this report we examine how the MNOs (Mobile Network Operators) coped with this increased demand. We analyse speeds between 17th April through to the 13th June to compare average download speeds before, during and after Ramadan.
Ramadan, Jeddah and the Internet
Internet Use Peaks During Ramadan
Internet use in MENA (Middle East and North Africa) during Ramadan is higher than any other time of the year. Google internal data shows huge spikes across several content categories on YouTube throughout the holy month each year, including TV & Comedy, Cooking & Recipes, Religion & Spirituality, Gaming, Auto & Vehicles and Internet & Telecom. Here is a chart from Google’s report in 2015 showing demand for TV and comedy downloads rising during Ramadan and falling after Ramadan.
“Ramadan is one of the most active times of the year for social media in the Middle East – on all social media channels – as Muslims reach out to friends and family, prepare for the holy month, and celebrate in the run up to Eid.”
Jeddah Welcomes 7 Million Visitors
The Kingdom of Saudi Arabia issued over 7 million Umrah visas for 2019 and as of May 2019 6,964,943 have arrived in the Kingdom. Most of these will arrive in Jeddah because Jeddah airport is the gateway to the capital of the Kingdom of Saudi Arabia and it is the national air transport center.
We analysed data before, during and after Ramadan between 17th April and 5th June. This data was restricted to include only data that was:
Within the city of Jeddah
Cellular only (not fixed)
Provided via the top 3 MNOs operating in Jeddah (STC, Mobily and Zain)
Midday (12 to 2pm) or Evening (8pm to 10pm)
Jeddah was chosen because the number of visitors expected to pass through during this time could be expected to have a significant impact on the service provided by MNOs. We were keen to see how the MNOs coped during this time.
We chose to limit to cellular because this is the type of connection most likely to be used by visitors as well as local residents and therefore more likely to be impacted.
The top 3 MNOs (STC, Mobily and Zain) were chosen because they account for almost all connections in Jeddah.
We chose evening because we anticipated the demand to be high during those hours. Midday was chosen to compare the quality of service during two different parts of the day with different demands on the Internet.
STC and Mobily achieved the best results with nothing to choose between them. Although Zain achieved lower speeds credit is given for sustaining their performance during this spike in demand.
We were also interested to see how performance varied during the day from the quiet of midday to the peak viewing / download time of the evening. Here we see that the speed in the evening was always well below the speeds achieved during the day. Even so, the evening speeds improved by 30% during Ramadan.
For Hajj last year (2018) the King Salman bin Abdulaziz and the Crown Prince Mohammed bin Salman issued a directive “to do everything possible to make it easy for pilgrims to perform the rituals of Hajj”. The initiative’s objective was to allow pilgrims to communicate with their families and enable them to access the digital services available in the Smart Hajj initiative. This was a great access as seen in our report from last year.
Although we didn’t see any similar initiatives being advertised in Jeddah during Ramadan it appears from our results that efforts have been made by MNOs and the Kingdom to sustain performance during this high demand.
We expected to see that as more and more people arrived in or passed through Jeddah during Ramadan that the speeds achieved would fall and then return to previous levels as the demand diminished. However, all three MNOs achieved remarkable results showing an increase in measured speeds during Ramadan compared to the weeks before. Although there was some reduction in speed after Ramadan it seems to have sustained a higher level than before. As discussed previously, the increased demand for Internet was predicted well in advance giving MNOs ample time to prepare. We can only assume that they used this time wisely and their customers (and guests) reaped the benefit.
It is heartening to see that there seems to be a residual benefit to customers of all three MNOs with the speeds after Ramadan being higher than before (if not quite as high as experienced during Ramadan).
The 200,000 festival goers at the 2019 Glastonbury Festival were treated to free 5G via temporary masts installed by EE as it became the UK’s first 5G connected festival. In this report we look at what this meant for the music lovers as they enjoyed the music over 5 days in the English countryside. Did EE customers notice an improvement? How did the other MNOs fare?
Temporary 5G Network Installed by EE to Serve 200,000 Users
EE (owned by BT) have installed 5 temporary masts across the 900 acre (3.5 square kilometres) festival site to broadcast 5G for the first time. The same masts are also providing 2G, 3G and 4G. They have a free 5G-powered Wi-Fi for the 200,000 festival goers to connect to.
In previous years the demand for mobile data during the festival was huge and this year will be even greater. During the previous festival (2017) 54 terabytes of mobile data was used and it is expected that this year it will be 40% higher at 70 terabytes. Possibly higher if the temporary EE 5G network is successful. Research from EE shows that the typical Glastonbury-goer will “watch 16 different performers and post a minimum of 12 videos on social media documenting their experiences at Worthy Farm – resulting in 2.4 million uploaded throughout the weekend”.
The image below is an example of the temporary masts erected by EE at Glastonbury to provide improved 2G/3G/4G service as well as 5G.
We started collecting data when people started to arrive on Wednesday and continued through to Sunday. We concentrated on results in and around Worthy farm and only analysed cellular results. The only residential area was the small village of Pilton (population < 1000) which means that by restricting our analysis to cellular we can be sure that most of the data came from festival goers.
The image below shows the remoteness of the festival and how challenging it can be to provide a good service. The circle shows an approximation of the geographical area covered by our results.
There are many factors that can affect the quality and accuracy of a speed test on a mobile device and we are able to take these into account to grade each result in terms of reliability. For this study we decided to only use the most reliable 2500 taken during the festival.
Our analysis is based on 2500 measurements from 468 unique devices including 145 different models, 23 manufacturers and 4 MNOs taken over the 5 days of the festival. We compare the performance of the MNOs, the devices and also show how performance varied from day to day.
During the festival 4 mobile network operators (MNOs) provided internet to the festival goers with EE, O2 and Three being the most popular. The results show that EE was able to provide nearly twice the average download speed with Vodafone clearly in second place but still very much slower than EE during the festival.
Devices / Phones
During the festival we collected data from 468 unique devices including 145 different models from 23 different manufacturers. Here are the top 10 fastest phones from our data collection during the Glastonbury Festival. The list is dominated by Samsung models 9 and 10 with the S10 being the best by far.
The speeds were quite good on Wednesday when people started to arrive and the final preparations were being. The best day was Thursday, the first full day of the festival and speeds gradually fell away as more people arrived and as the bigger acts appeared. The bigger the act the more videos being uploaded to the Internet and the higher the demand on the services. EE performed particularly well on the final day being twice as fast as its nearest rival, Vodafone.
Glastonbury festival goers have enjoyed excellent performance whilst enjoying the music in the English countryside with 30% enjoying download speeds in excess of 20 Mb/s. 20 Mb/s is also the average for all customers which is higher than expected and is due to the nearly 35 Mb/s average achieved by EE customers thanks to the provision of temporary masts by EE. Although these masts supported 5G we saw no 5G devices being used in our crowdsourced data sample of 468 unique devices.
Of course the real winner was music but EE must be very happy with their performance throughout the festival.
SpeedChecker analysed 300,000 speed test results to produce a Wi-Fi performance ranking of CPE (routers) around the World. Our results show that the choice of router has an important impact on the perceived speed of the Internet even for users of the fastest devices and the with the strongest signals.
In this white paper we explain how our methodology eliminates other causes of slow speeds and presents a ranking table of routers for the top 20 manufactures. We also show the cost of the routers to identify the routers that offer the best value for money. The conclusion of our study show that there are some clear differences between manufacturers and between the models that each provide.
The purpose of this white paper is to rank Customer Premises Equipment (routers) in order of Wi-Fi throughput, to help consumers and providers to diagnose slow internet connections. There is often disagreement between the consumer and the provider regarding where the fault lies for slower than expected Internet connections. There are many causes for a slow internet and this white paper explores the impact of the CPE (router) on the final speed perceived by the consumer.
In this section we explain the methodology used to ensure that we are able to confidently rank routers to identify the fast and slow routers. This will help to diagnose poor speeds because the data will allow the consumer or provider to know what to expect from the routers being used. The methodology is designed to allow for a fair comparison between routers.
This white paper is based on 300,000 speed results collected between 1st April and 10th June 2019.
We analysed these 300K results and filtered them to eliminate other factors that could be reducing the speed of the CPE. We eliminated any speed tests that failed our rigorous accuracy check, any tests that used devices not capable of the fastest speeds and any tests that had a poor signal quality. We also disregarded very strong signals that may not have been representative of the average user. Finally, we disregarded any model of testing device or router that had a small data sample. From the 300K we found 46K that met our criteria.
Because of the filtering, we have reduced the CPE models to the most popular ones used by the users. A more comprehensive study ranking a wider set of CPE models will be published in the future.
Our data set includes results from over 100 countries however the vast majority of results are from France, the United Kingdom and the United States.
During the time that SpeedChecker collected results there were over 600 different client device models used (mobile phones & tablets). To ensure that the devices themselves were not the cause of a slow connection we removed results from slow devices, those with insufficient results and those that were not using the 2.4 GHz band.
We removed devices that had a maximum link speed of less than 100 Mb/s and an average throughput of less than 30 Mb/s.
There were 75 devices that met our criteria to be included in the analysis of the CPEs (routers). These are all Android devices because data from iOS devices was not available for this study. SpeedChecker plan to include iOS devices in future studies.
The most popular fast devices in order of results per device:
Samsung are clearly the most popular device but how do they compare in terms of throughput? The following table shows the average throughput in Mb/s for the top devices. Samsung have 5 of the top 10 but the fastest in our sample was the LGE V30.
There were over 400 routers in our sample of 300,000. After eliminating the results from the devices as previously described there still remained over 360. However, for many of these routers there were too few samples to be statistically sound. Removing these left 78 routers that we could analyse with confidence.
The Wi-Fi Throughput Test shows the average maximum measured transfer speed between the device and the CPE (router) using the UDP protocol. Wi-Fi throughput will normally be higher than or equal to the Internet speed.
Internet Download Test
The Internet Download Test is the actual Internet speed experienced on the device during the SpeedChecker speed test using TCP protocol. Our test uses sophisticated procedures to ensure that the result is as accurate as possible.
How SpeedChecker calculate a slow Wi-Fi connection
In order to determine if a particular result shows that the CPE (router) was responsible for a slow internet experience, SpeedChecker compared the measured Wi-Fi throughput with the Internet Speed test. SpeedChecker looked at the Internet Speed as a % of the Wi-Fi Throughput. Any result that shows an Internet speed greater than 80% of the Wi-Fi Throughput speed indicates a slow CPE (router).
The following table assumes that a customer is being provided with a 100 Mb/s Internet connection and compares how a slow CPE impacts on the speed they actually experience. If the throughput is slower than the Internet being provided to the premises then the actual speed being experienced is limited to that throughput speed.
In the worst case we see that, although there is 100 Mb/s coming into the premises, the Wi-Fi throughput of the CPE is only 50 Mb/s. A better throughput of 150 Mb/s gives the customer the full 100 Mb/s that is being provided with a ratio of 67%. For our analysis we consider any speed test result that has a throughput speed between 80-100% of the measured Internet speed to be slow. In our ranking tables we include the % of slow results for comparison.
Drawbacks of our methodology:
Our results rely on the CPE (router) having UPnP enabled on the router. Although many routers have it turned on by default there are still a significant number of popular routers that will not appear in our list because UPnP is disabled by default on them. Some users may enable it on these but if there are not enough results to be statistically significant they will not appear in our tables.
Our methodology mitigates against the impact of the wifi setup such as poor Wi-Fi signal and slow/old devices by only including results with strong signals and those results from devices capable of faster speeds. We also mitigate against local impacts on the results during the test itself by eliminating poor results.
The steps that we have taken to ensure accurate ranking of CPEs means that the 300K raw results have been reduced to 50K high quality results to ensure a fair comparison.
How SpeedChecker Filter the Data to Produce Meaningful Results
The purpose of this report is to provide an analysis of the speed results to show the best routers in terms of Wi-Fi Throughput. This will allow comparison of routers (CPEs) and help to identify if the router is causing a poor internet performance.
It was important for us to ensure that we only used speed results that provide information that was reliable, significant and relevant to most users. To do this we filtered our results based on :
Number of results per router and device
SpeedChecker take great care to ensure that any speed test result that we use is reliable and accurate. The results that are eliminated include incomplete tests, tests with too few samples and tests that take too long to complete. This can be caused by local interference such as the user moving during the test, the user cancelling before completion and interference during the test by other devices or other apps.
Because we are interested in the performance of the CPE we have included only phones and devices that are capable of the faster speeds. Otherwise, it would not be clear if it was the router or the device that was causing the slowness.
We used the top 75 devices from over 600 devices in the raw data. These all had maximum link speeds of at least 100 Mb/s and we had sufficient results from each device to be statistically significant. To qualify for this list a device was also required to have a minimum of 250 results.
The average Wi-Fi Throughput for these devices ranged from 30 to over 100 Mb/s.
We list the most popular routers based on the number of data samples for each router and their popularity in Europe. It should be noted that some of these routers are offered as ISP brands. A router needs to have sufficient results to allow for statistically sound analysis.
A weak Wi-Fi signal will also produce slow results and would cause a router to be mis-reported as being slow. We looked at the number of results in each band of signal strength and, as seen in the chart, we saw that most of them were between -40 and -70 dBm. We filtered out any results worse than -70 dBm. We also filtered out strong signals (above -40dBm) to ensure that our analysis focuses on the more challenging wireless conditions where users typically struggle with wi-fi, and ideal conditions where most of the CPEs are working well.
Wi-Fi Type (2.4 GHz or 5 GHz)
Our analysis restricts results to those using the 2.4 GHz band to make the comparison equal across all routers. We chose 2.4 Ghz because our results show that there are twice as many users of 2.4 GHz than 5 GHz meaning that most users will be using the 2.4 GHz band. We also see that there are 50% more slow results for 2.4 GHz compared to 5 GHz.
Number of results per router and device
Another filter that we apply to our results is to ensure a minimum number of results per device and per router. The restriction on the device (phone / tablet) was used in identifying the devices to be used to filter the CPE (router) results. These results were then further reduced if a router had insufficient measurements from these faster devices.
CPE Manufacturer Ranking
For the top 20 manufacturers the following table ranks the best CPE from each manufacturer in order of average Wi-Fi Throughput. We also give the average Internet Download speeds as measured by our speed test. The Slow % indicates the % of results for that router that were defined as slow by the metric discussed previously. We provide the cost where available to allow for a Value For Money comparison.
We provide further tables that include their other top-performing equipment in the section that follows.
Wifi Throughput Mb/s
Internet Download Mb/s
BT Home Hub 6.0A
EE Smart Hub 6.0B
ASUSTeK Computer Inc.
Shenzhen Yichen (JCG)
Plusnet Hub One
Ranking table of best models for each CPE manufacturer
Prices are given for CPEs that were available to buy at the time of writing and are in USD.
The Internet speed as measured by our Speed Test is provided to give an indication of the speeds expected by the consumer with most speeds between 20 and 50 Mb/s. A couple are much lower than that, particularly TP-Link Archer_C5. This should not be interpreted as a fault of the router especially in this instance where the slow % is only 2%. i.e. the router is not the cause of the slow internet speed. Most likely the slow internet speeds are linked to the actual router being popular in countries / ISPs which offer internet packages with low speeds.
Vendor-specific CPE Ranking Tables
The previous table ranks all manufacturers by their best-performing CPE (routers). In the following tables we take the top 10 manufacturers and include the overall ranking position.
There are no tables for Compal Broadband or Sercomm because they each have only one CPE in our results.
Arris CPE Ranking
AVM Berlin CPE Ranking
BT CPE Ranking
LinkSys CPE Ranking
Netgear CPE Ranking
Sagemcom CPE Ranking
TP-Link CPE Ranking
ZyXel CPE Ranking
The results of our study show that there are some clear differences between manufacturers and between the models that each provide. Most manufacturers provide one or two routers that are significantly better than the rest, reflecting improvement in technology. For example, BT is releasing new versions of its models and we can see clearly from our data the wi-fi throughput increases with every version and showing it is worthwhile upgrading.
Although more connections are being made using the 5 GHz band than previous years, 2.4 GHz connections are still used twice as often. It is interesting to see that the percentage of slow connections using 2.4 GHz (20%) is 50% larger than for 5 GHz (13%). We conclude that most customers suffering with slow connections are still using 2.4 GHz and that is why we concentrated on this band. The reasons for this include the CPE (router) not having a 5 GHz band, the user not switching to 5 GHz either because of lack of knowledge or because they get better results on 2.4 GHz (because of distance, walls etc).
Routers from BT, Sercomm, Zyxel and Linksys topped the ranking in terms of Wi-Fi throughput, each being 10% faster than their rivals. The Linksys EA7500 and ZyXel EMG2926 were particularly impressive because their slow % was 1% and 6% respectively. Sercomm’s top router (the Livebox) had a faster throughput but a disappointing 19% slow %. If reliable performance is important then choose the Zyxel or Linksys router but if value for money is important then choose BT Home Hub 6 or Sercomm Livebox, each costing less than half of the others. The AVM Berlin Fritz!Box 7490 at $270 does not offer the best VFM, however, their second router (7430) at $110 is a better buy.
Only one manufacturer in the top 10 had a slow % below the average: the Arris TG2492LG-85 at a disappointing 40%. With a throughput of 87 Mb/s it performed well but if reliability is important then choosing their second fastest (TG862G) gives a respectable 73 Mb/s but only 4 % slow %.
Most manufacturers have some routers that have a wide range of slow %. BT is unusual in that the 6 routers in their table range between 13% and 20% with the throughput correlating with the slow % i.e. the faster the throughput the small the slow %. Netgear in contrast has a flagship router (WNDR4500v2) with great throughput and negligible slowness but 6 others that perform poorly in contrast. Linksys have two great routers and two not so great.
In this analysis of speed test results taken in countries in the Middle East during February 2019 we compare download speeds between countries, between MNOs & ISPs within each country and also compare how performance varies across different subsidiaries of the major Telecom Groups.
Middle East average download speed: 7.3 Mb/s
Turkey, Qatar, Bahrain and Jordan have above average download speeds
Egypt and Kuwait have the slowest download speeds
Vodafone in Qatar, Orange in Jordan and Vodafone Turkey are the fastest amongst MNOs & ISPs with download speeds over 10 Mb/s
Inconsistent CDN peering impacts user experience
Regional average download speed is 7.3 Mb/s.
Turkey (10.7 Mb/s), Qatar (9.0 Mb/s), Bahrain (8.4 Mb/s) and Jordan (8.1 Mb/s) top the chart with above Middle East average download speeds. Egypt (4.4 Mb/s) and Kuwait (5.7 Mb/s) have the poorest performance in our tests. These speeds are represented in the following chart.
How Telecom Groups Perform in Different Countries
There are a number of international MNOs & ISPs that offer services in more than one Middle East country:
Bahrain and Jordan
Egypt, Saudi Arabia and United Arab Emirates
Egypt and Jordan
Kuwait, Oman and Qatar
Egypt and Jordan
STC / Viva
Bahrain, Kuwait and Saudi Arabia
Egypt, Qatar and Turkey
Bahrain, Jordan, Kuwait and Saudi Arabia
Our next chart superimposes the average speed for each country with the speeds for each Telecom Group so that we can see which Groups produce above or below average in each country that they operate in. Each country is given a unique colour in the following chart to allow a visual comparison of speeds for different Telecom Groups in each country.
Most Telecom Groups outperform the average in each country with the following exceptions:
Batelco in Jordan
Link.net in Jordan and Egypt
Ooredoo in Qatar
Vodafone in Turkey
Zain in Saudi Arabia, Bahrain and Kuwait
Top MNOs & ISPs in each Country
In this section we look at how the most popular MNOs & ISPs perform in each country. The charts are in order of the fastest available download speeds with a consistent scale of up to 16 Mb/s to make comparison easier.
SpeedChecker Measurement Methodology
SpeedChecker collected data in all countries during the same period in February 2019 to ensure a fair comparison. We gathered many data points using the crowd sourced data samples collected in the field on mobile devices. During the time the data collection took place, SpeedChecker received over 60,000 data samples and the included statistics and analysis are based on this dataset.
It was important for us to not only measure the real speeds as experienced by the user but also to ensure that we measured to the same point to ensure a fair comparison. For this we included only measurements to one server in Amsterdam. Read the following section “Choice of measurement server” for more about this method.
Choice of measurement server
Every measurement methodology differs in the selection of measured server infrastructure. Some methodologies focus on on-net servers hosted in telecom premises and others focus off-net. SpeedChecker believes off-net servers’ measurements are representing real user experience better than on-net as most of the content accessible by end users lies off-net. Most of the content these days is hosted on CDN networks and the best way to measure most relevant download metrics is to choose popular CDN networks. However, as we learn in this report, not all ISPs and MNOs connect to CDNs directly (or peer) and that has major implications on performance.
One of the main advantages of CDN peering is to improve connection time and download speeds by bringing the content closer to the end user. Before we could analyse the speed results, we considered how widespread peering was and discovered that there was a variation between 0 and 100% use of local servers.
The chart above shows the percentage of results from each country that are routed via local Middle East Servers, Europe or Asia. Bahrain, Qatar and Oman are all above 50% Middle East server use with Bahrain at 100%. United Arab Emirates and Egypt have a very low use of local servers. In our case we have used the most popular CDN – Cloudflare.
Speeds achieved to local servers were, on average, around 30% faster than speeds routed via European servers but this is not available to the majority of users. Because of the unbalanced availability of this CDN peering we chose to limit our analysis to results from one particular server based in Amsterdam, Europe.
No country will have an unfair advantage as would be the case if local servers were used
The majority of content is still hosted in Europe which means the download speeds reflect actual usage for most of the content downloaded by the end user
It is acknowledged that the operators in some countries that are peering with CDNs will achieve better results than those shown in this report.
This is a report on the state of Fibre and 4G deployment in Riyadh based on data points collected by Speedchecker in September 2018. The report discusses the state of Fibre and Mobile coverage (the extent of coverage and the quality of service) and the Speedchecker Measurement Method. The conclusion shows how Riyadh is placed to take advantage of future improvements to networks.
Current Network Coverage in Riyadh
Summary of Network Coverage
The three main Internet providers in Riyadh are STC, Mobily and Zain. Only STC provide services over 4G, Fibre AND Copper. Mobily offer 4G and Fibre and Zain provide 4G but not Fibre or Copper. Riyadh has excellent 4G coverage and Fibre is well established in the centre of the city and plans are well underway to extend the coverage to the main city areas. Fibre beyond the main city areas is planned but not currently in progress.
Fibre is widely available across Riyadh particularly in and close to the centre. The map shown below shows that coverage is poor in the South-West of the city and in the rural areas surrounding the city.
Fibre is provided by STC and Mobily with Mobily exclusively covering the South-West and ITC the North-East. Other existing areas are covered jointly by STC and Mobily.
The In Progress areas (yellow on the map) are either STC or ITC with some coverage being provided by Dawiyat.
Zain has no fibre coverage in Riyadh as at October 2018.
Riyadh has excellent 4G coverage with 4G being available in all urban districts and along the length of the main roads going into and out of the city.
Speedchecker Measurement Method
Speedchecker uses the billions of data points collected through its passive and active measurement technologies worldwide to provide insights to our customers. This is used by businesses to improve their service and by research establishments to provide invaluable information.
Each data point consists of many KPIs including speed, latency, location, connection type, device info. Our results focus on speed and latency as experienced on the device to provide insightful information on Quality of Service. More detail about the Speedchecker Measurement Method.
This data is then integrated into our customizable map-based dashboards for geospatial analysis.
STC Fibre Coverage
Riyadh has an ongoing plan to implement fibre broadband across the city. Our results clearly show a correlation between the speeds achieved in districts that have fibre and those that do not.
We analysed the fibre results from STC to see if they correlated with the rollout of fibre across Riyadh. Our results on the left show high-speed results in Red / dark orange and slower results in yellow / light orange. These can be compared with the green areas from the MICT rollout plan where fibre is already available and the yellow areas where it is in process. The blue areas show areas that are planned but not yet in process and it is in these areas that the speeds are low.
We are still analysing the results from Mobily fibre and will publish when the analysis is complete.
State of Riyadh Mobile Networks
Speed result data points collected from Riyadh in September 2018 were analysed and allowed the top 3 mobile providers to be compared.
By adding the download speed data to our districts map of Riyadh we can clearly see that STC provided the fastest download speeds followed by Mobily and finally Zain. The maps also show a consistent difference in speeds from district to district. Districts that are the fastest or slowest for one provider tend to be the fastest or slowest for the others even though their actual speeds may vary.
The following table illustrates the fastest and slowest districts in Riyadh based on the average mobile download speeds. The speeds highlighted in green represent the 5 fastest speeds by provider and the red speeds are the 5 slowest by provider. It is clear from this table and the maps above that STC are getting the fastest mobile speed test results and Zain the slowest.
Riyadh has excellent 4G coverage provided by STC, Mobily, Zain and other mobile operators. The MCIT (Ministry of Communications and Information Technology) plan for rolling out fibre across Riyadh is well-established and their progress map is accurate.
All 3 companies are providing a good service with STC having more coverage and faster speeds. Our report has highlighted some areas of Riyadh that could need some improvement in service and others that are doing very well. This may inform future plans for infrastructure changes.
This is a good foundation that should ensure Riyadh will be well-placed to continue to take advantage of improvements in technology such as 5G. This will ensure that businesses and residential users can continue to enjoy all the benefits that these advances bring.
Interested in more detailed information on the Internet quality and coverage in Middle East and beyond?
Between 19th and 24th August 2018 over 2 million visitors arrived in Mecca for Hajj. This annual pilgrimage to the holiest city for Muslims is associated with the Prophet Mohammed who is said to have lead his followers there before consecrating it to Allah. It is considered a religious duty for all adult worshippers who are able to undertake this pilgrimage at least once in their lives. This number of visitors more than doubles the usual 1.5 million population of Mecca causing almost unimaginable challenges to the city’s infrastructure. In this article we discuss just one of these challenges : mobile Internet speed and access. It is hard to imagine how the infrastructure could cope with the huge increase in demand.
Hajj 2017: Review
During Hajj in 2017 mobile data demand nearly doubled compared to 2016. Although an increase of 60-70% was anticipated the 100% jump was a surprise. This was attributed to the increase in popularity of YouTube and Snapchat. Despite the increased demand, 99% of calls were successful and 23,000 Terabytes of data were consumed. According to the UN Sustainable Development Goals report published in ITU News from September 2017 this was thanks to the deployment of 3700 ICT specialists and 13,000 2G, 3G and 4G mobile base stations in all Hajj cities. The report does not specify which Telcos were involved. Source: ITU News.
Hajj 2018: The Kingdom’s Initiative to Maximise Mobile Communication During Hajj
King Salman bin Abdulaziz and the Crown Prince Mohammed bin Salman issued a directive “to do everything possible to make it easy for pilgrims to perform the rituals of Hajj”. The initiative’s objective is to allow pilgrims to communicate with their families and enable them to access the digital services available in the Smart Hajj initiative, so that they can enhance their experience and allow them to take advantage of enhanced communication services, as per a release issued by the authorities.
In particular, a number of packages provided by some of the main mobile operators offered their customers 1 Gb for 48 hours. Source: https://www.tahawultech.com
The challenge of providing adequate mobile services during a large event is not simply trying to maintain the current service levels. It is also about balancing the needs of the visitors with key service areas that are essential during the event. Consideration must be given to protecting the critical infrastructure of the region to enable it to respond to serious incidents. One way this can be achieved is to ensure there is resilience and redundancy built in to the infrastructure. Consultation with interested parties is essential to ensure that the steps agreed will meet the essential needs of all concerned. A thorough risk and threat assessment will identify where the effort is required.
It is a balance between being good hosts to the visitors and ensuring a continuity of services for the locals. Short term measures and agreements will be a great help in achieving this balance and the generous provision of 1Gb over 48 hours in Mecca is one such example. This may be the headline initiative but it is clear that much more has been done in many other areas to ensure a successful Hajj.
Telco Infrastructure in Mecca
Mecca has an excellent 4G network covered by a number of major operators. Building on the improvements made for Hajj 2017 this has allowed them to improve the average download speed by 83% between 2017 and 2018. They will continue to improve as they roll out 5G and it is expected that this will be further improved as part of Saudi Vision 2030.
Saudi Telecom Company (STC) has been at the forefront of this with investment in FDD and TDD LTE spectrum assets. The rewards of this investment can be seen in our results which show STC outperform the other providers in our research.
Zain have also been investing in technologies that allow them to extract the best out of their infrastructure. They are also preparing for 5G rollout.
Mobily has partnered with Ericsson to deliver 4×4 MIMO and as with STC and Zain they are preparing a 5G rollout.
As the Telcos continue to improve installed and available capacity so the Internet speeds can be expected to increase.
Speedchecker measurement methodology
Ahead of Hajj, Speedchecker started data collection to gather as many data points in Mecca as possible before / during / after the event. The crowd sourced data samples were collected in the field using mobile phones carried by the pilgrims to Mecca. Measurements were run on mobile networks of the top providers using Android and iOS devices. The measurements were made towards local CDN PoP based in Riyadh. The recorded results are a good proxy for the internet quality users were experiencing in Mecca on their mobile devices. During the 15 days the data collection took place, Speedchecker received over 100,000 data samples and the included stats and analysis are based on this dataset.
Hajj 2018: The Results
The results show that not only did Mecca cope with the extra 2 million visitors they exceeded all expectations. It would be reasonable to expect that speeds would decline by up to 50% during Hajj when compared to the week before or the days after. However, the speed test result reveal that the steps taken in Mecca allowed visitors and locals to enjoy an increase in speed that was continued throughout the following days. Our analysis stops after the 26th August.
The chart shown below shows the median (middle value) of Mobily Mobile, Zain Mobile, STC Mobile and STC Fixed broadband. We only have STC data from 21st August (Hajj started on 19th) and we have separated the STC Mobile tests from the STC Fixed Broadband tests. There is an unexplained drop in speed for STC mobile on the 23rd August. We have included the STC Fixed Broadband to show that the problem only affected STC Mobile customers. Despite this 50% drop from STC the overall trend during Hajj was a gradual increase in download speed.
STC mobile download speeds are more than 50% faster than either Mobily or Zain and this shows that investment in infrastructure yields positive results and benefits to the end user.
The following graph compares how the average daily median speeds of each of the providers changed before, during and after Hajj. The average shows a remarkable increase throughout Hajj and into the following days. Zain’s speeds after Hajj are faster than those from before while Mobily has returned to before Hajj speeds.
Whatever improvements and changes were made to the Telco infrastructure during Mecca the results of the download speeds show that it was a huge success.
Internet speed map of Mecca
Using mobile device GPS data we were able to map internet speeds in Mecca to a high geographic precision. Collected data were normalized and color-coded so that the fastest areas are in red and slowest in dark blue. The outskirts of Mecca which are not colored are out of scope for this study.
As can be observed the fastest areas for Mobily are not in the center which can be attributed to increased demand from higher concentration of people.
The Zain speed map is slightly darker and corresponds with slightly slower internet speeds than Mobily. Yet the centre is faring quite well in comparison with Mobily.
The STC internet speed map looks comparatively much better than Mobily and Zain and proves that internet speeds are well distributed across whole of Mecca.
The internet quality around Great Mosque is better illustrated using more detailed heat map where you can see individual measurements (which are also color coded like on previous maps). The area around the mosque has very good speeds also for Zain, which indicates Zain did not underestimate the capacity needed in the center.
The 2 million pilgrims arriving in Mecca in 2018 provided a huge challenge to ensure that the quality of service that visitors and locals expect can be delivered and maintained. We have seen how the demand doubled between 2016 and 2017 and this increase was sure to continue in 2018.
The Saudi Arabia Initiative and the efforts and investments of the major mobile operators has ensured that the quality of the service has not only be sustained but improved. This improvement has continued at least for the few days after Hajj (we have no data beyond this). We don’t know how much of the improvement will be permanent but, with a similar commitment in 2019, we can be confident that Hajj will continue to be a Telco success.
Looking further forward we can see that the Saudi Vision 2030 has ambitious plans that should sustain this for the foreseeable future.
Speedchecker, a private company running large-scale software-based monitoring networks and DD-WRT, the most popular open-source router firmware, announce a partnership which will aim to build the world’s largest hardware probe monitoring network.
Under the terms of the partnership DD-WRT started including the Speedchecker Probe client within the DD-WRT firmware. DD-WRT users can opt-in to the Speedchecker network and get new features for their routers in exchange for providing bandwidth for Internet measurements.
As Christian Scheele from the DD-WRT development team said:
“We are pleased to be part of this partnership to not only help fund the DD-WRT development but also be part of the project which enables Internet research be conducted on a large scale across many countries that are currently not represented in existing measurement networks”.
Since the soft-launch earlier this year over 2000 users of DD-WRT have already opted-in to the network, enabling Speedchecker to cover over 80 countries for its Internet measurements. Speedchecker offers access to its network to clients such as Microsoft and Oracle, as well as researchers in organizations such as LACNIC which publish Internet topology research.
CEO of Speedchecker Ltd, Janusz Jezowicz noted:
Historically, companies always had to make a choice of either running measurements from software probes with its wider coverage but lower accuracy, or rely on hardware probes which had limited coverage. With this partnership we are able to provide global coverage for hardware probes with low costs due to end-users running the tests on their own routers and not expensive custom hardware.
After a few months of hard work we are pleased to announce a new version of our Probe API. We decided to completely rewrite the API specification to apply all the things we have learned over the last few years without breaking API access for our existing user base. We don’t plan to sunset the old API version yet, but new clients are not able to sign up for the old version.
The new version is so much better; we have made following improvements:
We have learned a lot of lessons over the years about how to make the API more scalable . We are pleased to say the new API already supports millions of measurements running every day!
As part of new API release we are offering access to our Android probes to all of our users. API users can leverage increased coverage by testing on all available platforms, or specifically target mobile probes using Platform source targeting. We will soon have an announcement about hardware probes which will be supported in the same way, without the need for code changes.
Great level of support
Being a small company, we have always taken personal care of each client and made sure our support team provides expert advice on internet performance measurements to assist clients in fulfilling their goals.
Our API access starts from 49 EUR per month.
Please check our pricing here.
On top of those improvements mentioned above the API features also got an upgrade. Based on feedback we got from our users we have improved the API methods to include:
Improved probe targeting
Our new API offers many more options on how to select probes for measurements. Our users can select probes by location (e.g. City / Country / Lat and Long coordinates), network (Network name, ASN or IP prefix) and more.
More information about probes Using ProbeInfo properties API users can specify what information about the probe is useful for them to return with the measurement results. We have added new properties such as DNS Resolver IP, Screen size (useful for page load tests), User connection type and more.
Extended tests and new metrics Our API supports existing measurements such as Ping, DNS, Traceroute, HTTP, Webpage load. We have also added a new measurement type – video streaming test.
HTTP We now have available metrics such as TTFB, TotalLatency, DownloadedBytes, TCP connect time.
HTTP GET measurement can also return full HTTP Headers and Body. This can be very useful for many scenarios such as finding out which CDN POPs are being accessed, CDN cache HIT/MISS analysis, keyword monitoring in the HTTP response. The possibilities are endless!
We offer all the web performance metrics you would expect and we have added a couple more: such as the number of requests the page has loaded as well as full HAR file. HAR file is very useful in getting a complete picture of the pageload performance and allows you to construct a waterfall model which we use in our CloudPerf product.
We hope all the improvements we have made will encourage you to sign up for our 7-day FREE trial.
Choosing an optimal server location isn’t necessarily an easy task. Managing costs and selecting an appropriately sized hosting package is just one part of the deal. As much or more important than server capacity, is finding out how your services behave from your client’s perspective. Whether it is for choosing among different hosting providers or deciding in which location it is better to deploy your server, you need to measure latency and throughput. Having an insight into these two metrics can improve your service and result in cost-effective solutions.
In this article, we take a look into these two basic aspects of connectivity: latency and throughput. We discuss their behavior and show you how to use CloudPerf to compare and choose an optimal server for deploying a web page.
As we know, TCP performance is naturally limited by Latency. As for this, the first aspect we have to look into a server’s performance is Latency, then focus on throughput. No matter how big a link may be, if your users experience a high latency, it is not possible for them to achieve high performance. The next graph, shows the interdependency of Thoughput vs. Latency.
Here we can observe an inverse exponential curve, which in practical terms, it means that especially in the 1-30ms range, every millisecond of latency will have a heavy effect on the maximum achievable performance. With this in mind, we can picture very clearly the intuitive notion of choosing a server as close as possible to your clients, but still take into account even the smallest differences in latency.
Let’s say we have an account with a cloud provider and we want to deploy a service for European users. We can take Digital Ocean as an example, where we can deploy a VM in Amsterdam, London or Frankfurt, among others. We deploy the same test service on each of those locations. Then we set up a Static Object measurement for them in CloudPerf pointing to a 100KB test file and a Ping measurement to each server. We make sure to select the countries of our interest and start measuring. We choose to measure for one hour, one measurement per minute.
The following table shows the latencies obtained from each location to each of the three servers. The lowest latencies have been highlighted in yellow.
We can observe that depending on the countries we are serving to, we can expect a very different result for each server. But focusing on all countries altogether, we can say that Amsterdam and Frankfurt have the lowest latencies in general. Let’s confirm that with the graph:
This is one for latency, but what about throughput? Given similar enough latencies, like in this case, the effective TCP Throughput may be affected by other factors, so we take a look at the download speeds achieved for each server, now the highest Throughput has been highlighted in yellow.
Here we can clearly observe that clients from Austria and Germany, which showed ping values favorable to the Frankfurt server, actually show a higher throughput when serving from Amsterdam. Let’s take a look a the graph:
No we have confirmed that our Amsterdam server will show the best performance. Of course results will vary depending on which countries we focus on, but we can clearly see a general advantage of using Amsterdam as a single location for this selection of countries.
Every startup is rightly afraid of a new competition, especially if it comes from Internet giants like Google. The stories of how Google enters the market and dominates it in a few years are not new (such as mobile OS and Android, or recently browser wars with Chrome) . In some cases Google gets a slap on the wrist or occasional $2.7 billion fine . Nevertheless, the situation is not likely to improve and Google’s dominance in search will grow into other areas, if Google decides to compete there.
This blog post hopes to give an insight into the impact of prioritizing Google funded initiative over existing players in the market, using the real numbers from specifically our small business (which I am not sure is still right to call a startup after 10 years) 😊
But before I do so, let me give you a super quick overview of what my company – Speedchecker does – we provide easy to use and accurate speed test of your internet connection. After almost 10 years we have done over 300 million tests and provided speed test technology for many other companies.
Launching Google speed test
The story begins about a year ago when Google launched their own speed test featured directly in search results in USA and followed by other English speaking markets. We knew that the UK launch would happen eventually but we did not know when.
Luckily for us Google picked an open-data solution for running their speed test , noble M-Lab. M-Lab was founded by internet visionaries such as Vint Cerf and is funded by consortium of companies including Google. This choice enabled us to analyze the rollout and provided real numbers for this blog post.
M-Lab speed test data is available to download for everyone through Google Cloud (of course). By analyzing volumes of data each day, we could produce following chart:
(Number of speed tests from UK in M-Lab dataset on random days in May, June and July 2017)
As we can see, Google started the rollout on the 15th of May. We can also observe that Google did not do an immediate rollout across all the UK users but over the course of several days, the feature was introduced to more and more users in the search results.
Impact on visitor numbers to our website
Here is how the search results look like in the UK for one of our main keywords:
As we can see Google speed test occupies significant space on the 1st page and pushes all results below.
Here is the chart plotting user visits from Google (and Bing for comparison) before and after the Google speed test release. We can observe the drop in visitors begins after Google launches the speed test.
To better illustrate that the drop is because of ranking change and not seasonal factors, here is zoomed in data from Bing which does not show any meaningful change before/after 15th of May when Google launched.
Looking at the average drops we can estimate the loss of about 5000 visits per day from 25000 Google visits. Overall that is about 20% traffic loss from being moved from position 1 to 2.
Comparing to industry standard data e.g. by RankScience, 20% drop is quite a good result, it could be worse.
From M-Lab dataset we can also extract quite interesting insights as it contains user IP address as well. If we cross-reference user IPs seen in M-Lab data with our internal data, we can see about 5% of users use both services. We can only speculate whether it’s a good result or not, definitely for the user it is useful to get information from 2 different sources and decide what is more relevant.
From our perspective we are quite happy the Google threat is not as serious as we originally thought. Loosing 10% of our overall traffic (and 20% of Google’s) will have impact on our bottom line but we will survive. Luckily, we provide other features that user’s appreciate such as mobile apps, storing results, mapping, comparisons and more. This I believe contributed heavily to such a small drop. I have no doubt many users will favor convenience of 1 click to get result in search results directly than going to 3rd party site such as ours. Unfortunately, there is nothing we can do to compete with that and stay in business at the same time.
With Google favoring their own speedtest, M-Lab datasets are growing at a rate of almost 1 million results per day and will achieve to serve as many customers in less than a year – something we have achieved in the last 10 years. That is the power of Google search dominance.