Why Is The Network Slow?

by Jay Cuthrell
Share and discuss on LinkedIn or HN

Note: This post will draw heavily upon Techmeme for links. I’m experimenting with the use of unfurl for markdown links to provide a summary card automatically.

What happens when a request for comments (RFC) becomes more than commentary?

Sometimes, the way we think of the state of modern user experiences online can and does change.

When you think of latency, the word latency might be abstract or difficult to define. If so, it can be helpful to remember that 30 years ago, our modern web browsing experience was referred to by a different expansion of the acronym “WWW”.

Back then, there was no 3G, 4G, LTE, or 5G — it was an era of twisted pairs of copper wire then referred to as land lines or telephone lines which were used for dialup modems to reach an Internet Service Provider (ISP). Most homes only had a single phone line, so when you wanted to talk to someone you stood next to a wall and a corded telephone connected you to the world or you’d fight over the line when someone connected the modem instead.

Being online in the mid to late 1990s was a time when the World Wide Web was more commonly referred to as the World Wide Wait.

Eventually, digital subscriber loop (DSL) modems and cable modems would make the crackling sounds of dialup become a quaint relic of Internet history as the new era of broadband emerged. However, the specter of latency followed facilities-based broadband and still does in addition to the increasingly mobile cellular network connectivity we now take for granted.

Getting Informed

When considering latency, think about that Top Gun quote… about feeling a need.

Or, think back to Little’s Law.

As technology is the response to a perceived need, there is a need to decrease latency. Companies such as Apple, Google, Comcast, NVIDIA, and others would agree.


We’re now entering the world of Low Latency, Low Loss, and Scalable Throughput (L4S).

But why?

Why is there a need to decrease latency?

Latency does not always mean you can simply “blame the network” — there is more to understanding latency which requires a fuller user experience (UX).

The study of UX can provide insights beyond the network.


Anticipating a user need can be an important consideration or part of delivering a great UX. ~15 years ago, what is now the most popular web browser, Google Chrome, made specific decisions around how to anticipate the UX impact of looking up a website and the perception of latency.


Back then, iPhone use was on the rise as were 3G, emerging LTE standards, and other competing mobile broadband standards. At the same time, an increasing everyday use of these new technologies and services was becoming a source of nuisance for consumers and the UX experience was, to be charitable, very inconsistent.


Around this time, independent analysis reached the growing mobile broadband market. One group, Opensignal, would go on to become a regular part of news coverage where latency and the UX for consumers needed a quantified source with a vetted methodology.

Where else is latency a concern?

If perception is reality, the reality of latency was not limited to Internet connectivity and the Web. Around the same time, latency was also becoming a concern for online juggernauts for the latest technology darling / buzzword of the times — the cloud.


Does extra security add latency?

In these modern times, we might take a secure website showing the SSL lock for granted. In modern web browsers, we see warnings now when SSL is not present.

However, that wasn’t the case just over a decade ago. As SSL became more prevalent, the implementation of SSL also made the web and applications seem slower… again, the latency reared its head and the industry responded in kind on multiple fronts.


10 years of latency focused progress…

One of my favorite memories at SxSW over a decade ago was a blogger lounge moment where gaming rigs with big screens and controllers were sitting on the table tops… but the consoles were not doing the computing. In this demo environment, the bloggers were playing games on computing resources several miles away in a datacenter and this proof of concept would increasingly become part of the “streaming” and “on demand” nature of entertainment over the network.


The emergence of companies like Akamai and other content delivery networks arguably inspired the founding of Cloudflare.


Experimentation in so-called cloud gaming was ongoing.


Around this time, even AWS elected to move the cloud closer to the users by exploring massive datacenters being built closer to major population centers. Today, AWS Local continues expanding as have the investments that anticipate the latency requirements for applications that 5G has marketed over the years and Microsoft Azure was not far behind with their Azure Edge Zones.


When COVID-19 resulted in knowledge workers heading to somewhere other than the office, the meme of latency was front and center for video conferencing. Companies like Zoom Communications, Twitch, and eSports gaming companies had to respond in ways that were increasingly localized.


In a post COVID-19 world, the investments in companies and technologies to address latency continued both terrestrially and extraterrestrially continues. Or, to think of it another way, latency is a shifting window of UX expectations.


The implications of latency and the architectural considerations for applications with larger user communities appeared in the news cycle this year. If one cloud latency is a concern, then hybrid multi-cloud latency will become the next concern.


And, as a final note, the cloud continues to be a concept that latency is linked to. As such, the cloud in a can at the edge of the network is perhaps the closest and most low latency cloud of all. Oxide now joins the world of Azure Stack, Google Anthos, and AWS Outposts.


So, what will be the next big thing in addressing the perception of latency computing and UX?

Until then… Place your bets!


I am linking to my disclosure.


✍️ 🤓 Edit on Github 🐙 ✍️

Share and discuss on LinkedIn or HN
  • Get Fudge Sunday each week