1 of 62

The Global Baseline, 2022

Alex Russell�

performance.now(), 2022

@slightlylate

infrequently.org

@slightlyoff@toot.cafe�alexrussell@microsoft.com

2 of 62

3 of 62

web performance expands access to information and services by reducing latency and variance across interactions in a session, �with a particular focus on the tail of the distribution (P75+)

infrequently.org/2022/05/performance-management-maturity/

4 of 62

<a href=“https://example.com”>� We Succeed Or Fail � <em>Together</em></a>

5 of 62

infrequently.org/2021/03/the-performance-inequality-gap/chart/

6 of 62

‘16’s Moto G4:� �An Informed Guess

  • ~$300-350 new
    • Cheaper devices available�
  • 8-core, A53-based, 1.1GHz
    • 28nm, FML
    • 2GB RAM�
  • “Out, not up” clear in the data�
  • Sadly prescient

infrequently.org/2021/03/the-performance-inequality-gap/chart/

ELT layout

7 of 62

2017 Budget Calculus

  • Moto G4 baseline�
  • Targets:
    • <= 5000ms first load
    • <= 3000ms repeat view�
  • ~130-170KiB of content / page
    • Budget decreases as JS fraction increases

infrequently.org/2017/10/can-you-afford-it-real-world-web-performance-budgets/

ELT layout

8 of 62

Q1’21 Baseline:�P75+ User

  • $150 USD, 2017 vintage phone
    • Moto E6, e.g.
    • 4-core, 1.4ghz, A53s
    • 2GB RAM�
  • Slow-ish 4G
    • High variance
    • Slipping into 3G at times�
  • ~100KiB HTML/CSS +�~300-350KiB of JS�
  • Heavily content dependent, because CPU

infrequently.org/2021/03/the-performance-inequality-gap/chart/

9 of 62

Guesswork

10 of 62

Legs of the Stool

Browsers�

Networks�

Devices�

Content

ELT layout

11 of 62

https://how.complexsystems.fail/

12 of 62

Browser Factors

  • Diffusion & Retirement
    • Statcounter, private data�
  • Codecs & Protocol Support�
  • bugs * share == pain

ELT layout

13 of 62

Network Factors

  • Availability
    • Opensignal, speedtest, GSMA, Private Data�
  • Hardware Support
  • Variance!!!
    • Density, Oversubscription, Backhaul, Spectrum

ELT layout

14 of 62

OpenSignal 2022 India, USA Experience Reports

15 of 62

OpenSignal 2022 India, USA Experience Reports

FIXED IT

16 of 62

gsma.com/coverage/#107

17 of 62

speedtest.net mobile report

www.speedtest.net/global-index

Country

Median

Mean

Netherlands

105 Mbps

124 Mbps

USA

68 Mbps

141 Mbps

India

14 Mbps

20 Mbps

ELT layout

18 of 62

Desktop Is Variable Too

19 of 62

20 of 62

themarkup.org/still-loading/2022/10/19/dollars-to-megabits-you-may-be-paying-400-times-as-much-as-your-neighbor-for-internet-service

21 of 62

22 of 62

Favour Conservative Estimates

23 of 62

Device Situation Factors

  • Market penetration
  • Retirement rates
  • Sales
    • IDC, Canalys, etc.
  • CPU perf at volume price
  • Radio/modem generations
  • Disk latency

ELT layout

24 of 62

Mobile Sitrep

Phones live 3-4 yrs

ASPs: performance destiny

Today:

  • < $350 average
  • < $300 in Android
  • Premium: > $700

ELT layout

25 of 62

What About Desktop?

Desktop devices live 5-8 yrs.

The P50 PC was sold in 2018

P75 is vintage 2016

ELT layout

26 of 62

From Edge Telemetry

About half of users:�

  • Spinning rust (not SSD)
  • <= 4GB RAM
  • 2-4 core

ELT layout

27 of 62

Wealth Is Unusual

28 of 62

gs.statcounter.com/os-market-share/mobile/worldwide

29 of 62

pewresearch.org/internet/fact-sheet/mobile

30 of 62

Your iPhone Isn’t Real Life

31 of 62

Today’s Median Phone

  • An Android
  • … on 4G
  • …sold 18+ months ago
  • at local market ASP

ELT layout

32 of 62

P50 is a vanity metric

33 of 62

Today’s P75 Phone

  • An Android
  • … on 4G
  • …sold 30+ months ago
  • at local market ASP

ELT layout

34 of 62

httparchive.org/reports/state-of-javascript

35 of 62

36 of 62

httparchive.org/reports/state-of-javascript

37 of 62

2021 CPU Update

38 of 62

39 of 62

40 of 62

2022 CPU Update

41 of 62

42 of 62

43 of 62

Inquiry Is A Lantern For Illuminating Privilege

44 of 62

Web Almanac 2022: Performance (Chrome UX Report)

45 of 62

Web Almanac 2022: Performance (Chrome UX Report)

46 of 62

Web Almanac 2022: Performance (Chrome UX Report)

47 of 62

Web Almanac 2022: Performance (Chrome UX Report)

48 of 62

Web Almanac 2022: Performance (Chrome UX Report)

49 of 62

Where Does This Leave Us?

50 of 62

A Q4’22 Baseline For P75+

  • $200 USD, 2022 vintage phone; e.g. Samsung Galaxy A50
    • 8-core: 4x-A73, 4x-A53
    • 11nm process node
    • 4GB RAM

  • 4G Network
    • P75 speeds well below India’s observed 13000Kbps median
    • Staying with:
      • 9000Kbps
      • 170ms RTT

51 of 62

Q4’22 Content Constraints

  • Largely unchanged�
  • CPUs stagnant in budget tier
    • Frequency scaling w/ move to smaller nodes circa ‘18
    • Caches still abysmal
    • Will improve in next few years, but not enough�
  • Networks reliant on investment
    • Cell density requires $$$
    • Broken markets in US, etc.
    • 5G is a mirage for most

52 of 62

Content Recommendations

  • Prefer HTML/CSS to JS�
  • Baseline budget:�
    • 150KiB HTML/CSS
    • 300-350KiB of JS
    • As few connections as possible�
    • Shrinks as connection count rises
  • Start adding INP to TTFB logging

53 of 62

When Digital Is Default, �Slow Is Exclusionary

54 of 62

55 of 62

“Beware; for I am fearless, and therefore powerful.”

56 of 62

Setting Product Baselines:��Start Globally, �Learn Locally

57 of 62

“Who Is Our Marginal User?”

58 of 62

Applied Guesstimation

  • Start with Global Baseline
  • Be conservative
    • Beware hysteresis!
  • Identify your marginal user
  • Learn about them from RUM
  • Sessions, not pages

ELT layout

59 of 62

What to Collect

  • Network Reality
    • navigator.connection
      • [rtt, downlink, effectiveType]
  • Rough Hardware Classes
    • navigator.hardwareConcurrency
    • navigator.deviceMemory
  • Geography and User Agent
  • Analysis must allow slicing!

ELT layout

60 of 62

Product Clarity Makes Budgeting Actionable

  • What’s our market?
    • Geo & demographics
    • Brand positioning
  • What’s our session depth?
    • Histograms FTW
    • Head/tail? Bi-modal? Other?
  • Key user journeys
    • Get them on the bench!!!

ELT layout

61 of 62

Performance Is Access

62 of 62

Thank You!

@slightlylate

infrequently.org�@slightlyoff@toot.cafe

alexrussell@microsoft.com