How we review internet service providers – CNET

Testing ISPs is a logistical challenge, but there’s still plenty of room for criticism.
I’ve been reviewing tech for CNET for nearly eight years now, and I’ve never had an assignment quite like writing reviews of internet service providers.
From refrigeratorswaffle makers and toasters to smart speakers, light bulbs and security systems, the common thread tying everything I’ve ever reviewed for CNET together is testing. Our team prides itself on finding smart, effective means of putting products to the test, uncovering the key data that separates the good options from the bad ones, and sharing those insights with our readers.
ISPs are an entirely different problem. 
Your first problem is that internet providers are regional, so if you wanted to test a provider’s quality of service, you’d need a home in whatever part of the country they cover. Even then, a single location wouldn’t really cut it, because service offerings and available technologies vary wildly by address. On top of that, testing the quality of a given home’s internet connection means accounting for all sorts of variables that are completely outside of your control, things like service disruptions, infrastructure failures, interference from nearby networks and more. Finding a way to test internet providers that’s fair, repeatable, thorough and helpful to the reader is a logistical nightmare, to be frank with you.
With the help of David Anders and Trey Paul, two new additions to our team with years of experience writing about internet providers, we’ve been grappling with this challenge for months. Now, after lots of legwork, we’re ready to give you a broad look at broadband, and we’ll soon start publishing our full, scored reviews of all of the top ISPs in the country, from big-name providers like AT&T and Comcast Xfinity to little guys like Rise Broadband and WideOpenWest. Here’s how we’re tackling that challenge, and what you can expect from us with every piece we write.
We’ll continue to go hands-on with new internet technologies like 5G service and Starlink’s satellite internet whenever we can.
As I laid out in the intro, there’s no good way for us to test internet providers in a way that’s comprehensive, repeatable and applicable to the entire category. Yes, we can go hands-on with certain providers to offer readers our impression of a given service — and we’re doing that whenever it makes sense, as Rick Broida did with T-Mobile’s new 5G home internet service, or like John Kim did when he tested out Starlink satellite internet service from SpaceX. Both of those are great reports that offer a helpful glimpse at the practical realities of the respective provider’s service — but you can’t build your reviews around tests like those. Rick’s place is a totally different environment than John’s, the sample size is much too small to represent a broader experience, and repeating the process for every provider on our list is an unrealistic goal.
So, how do you review something that you can’t really test? The answer is to remember why you test in the first place — to generate objective data to inform your subjective opinion. And, fortunately, there’s already lots of data for our team to pick through and scrutinize. That’s where we begin.
The FCC’s ISP database gives us a look at the scope of each provider’s coverage, and key details on which percentage of each provider’s footprint has access to the fastest speeds available.
First up is the FCC. Providers are required to disclose metrics about the scope of their coverage and the quality of their speeds every few years — that gives us a look at where each provider offers service, what their speeds are like, and how fast their technology seems to be improving. The data is notoriously flawed (and as of writing this, it’s also almost two years out of date), but it still sets the table with a good bird’s-eye view of the category.
From there, we put each provider’s slate of advertised speeds and plans under the microscope, digging into the fine print on all of their deals and offers to determine what you’ll actually end up paying, and what you’ll actually end up getting. It’s a big job, and it makes up the bulk of what we’ve been working on these past few months. For instance, ISPs will often try and lock you into pricing schemes that regularly cause your bill to increase. Exposing practices like those and helping you to steer clear of them is one of our top priorities.
There’s also a lot we can learn from examining each provider’s customer service track record with reputable organizations like JD Power and the American Customer Satisfaction Index. On top of that, we’re taking publicly available data on each provider’s speeds and outage history into account, as well as industry efforts to improve access to broadband speeds. You can expect our approach to evolve as we continue seeking additional sources of data to inform our reviews.
Gathering all of that information and putting everything into context gives us a thorough look at each provider, and it lets us start to make comparisons. From there, we supplement our research with whatever hands-on testing we’re able to complete, whether that’s a CNET editor reporting on their experience with a new provider, a rundown of the modem and router each provider offers its customers, or even an investigative look at which providers send potential customers the most spam messages. Reports like those are in the works, they’ll continue to be a point of focus for us, and they’ll inform our reviews whenever they provide data we can draw comparisons from.
That’s also a way of saying that we’ll be working hard to keep these reviews current. Internet technology is continuing to evolve and deals come and go, but no matter what, we want you to be able to trust that you’re getting information that’s accurate and up-to-date.
Building that trust takes transparency, so let me also explain how these reviews will make money for CNET. This site is free and doesn’t charge subscription fees — to keep it that way, CNET sells ads on the page, and it also uses affiliate links, which means that CNET earns a small share of revenue if you buy a product or subscribe to a service using the links on our site. Those efforts are strictly separate from the work we do as reviewers, and have no impact whatsoever on how we score or evaluate the providers we write about.
Specifically, we score providers for speed, value and customer care. Here’s how we approach each metric:
It’s what you’re paying for, after all, so the first thing we consider is whether or not the provider offers a reasonably fast internet connection. It’s a question that depends on context — if you live in a city with access to fiber, then a slower, laggier satellite internet connection would seem like a big step down. If you’re in a rural area and your only other option is a 10Mbps fixed wireless plan, then satellite might seem like a godsend.
Our job is to make that context clear for you no matter what your situation is. To get there, we ask the following questions:
Internet plans are notorious for obfuscating their true costs using hidden fees and promotional trap rates that lure you in with a temporary deal. only to jack your bill up a year later. We aim to take all of that into account, make it easy for you to understand the terms before you sign up, and find the plan in your area that offers the most bang for your buck.
Specifically, we consider the following criteria for each provider we write about:
The biggest chunk of each provider’s score comes from customer care, and it’s the category that raises the most questions. The last one here is really the key: Is there anything about the way this provider does business that we need to warn readers about? If so, we’ll tell you all about it.
Our aim is to answer each and every one of these questions to the best of our ability whenever we review an internet provider on CNET. You deserve a full understanding of the good, the bad and the ugly before you sign a contract for internet service, so that’s what we’ll strive to provide.
Our first reviews will be live on CNET in the coming days, with many more set to follow in the coming weeks, so stay tuned. We’ll also continue following important news developments in the category, and publishing relevant how-to content, guides, explainers and versus-style provider comparisons. Got questions? Shoot me an email, look me up on Twitter, or let me know in the comments below.
Be respectful, keep it civil and stay on topic. We delete comments that violate our policy, which we encourage you to read. Discussion threads can be closed at any time at our discretion.

source