Skip to content

Replace the Loading Speed report with CrUX #178

Description

@rviscomi

https://httparchive.org/reports/loading-speed

This report is based on HTTP Archive's synthetic monitoring of the following performance metrics:

  • First Contentful Paint
  • Time to Interactive
  • First CPU Idle
  • DOMContentLoaded
  • onLoad
  • JavaScript Boot-up Time

It's not our intent to draw conclusions about real users' experiences based on synthetic metrics like these. In order to avoid this pitfall, we should replace the metrics in the report with the RUM-based metrics from CrUX.

To implement this, we should overwrite the existing loading-speed report with the metrics in the chrome-ux-report.

Activity

  1. igrigorik commented on Jun 18, 2019

    @igrigorik
    Collaborator

    Strong +1. It's far too easy to draw wrong conclusions based on current synthetic tests running on oversubscribed VMs.

  2. paulirish commented on Mar 31, 2020

    @paulirish
    Contributor

    Strong +1. It's far too easy to draw wrong conclusions based on current synthetic tests running on oversubscribed VMs.

    FWIW, WPT uses n1-standard-2, which should be fine according to the Lighthouse recommended machine specs. It'd be concerning if it were using n1-standard-1. (And of course a beefier machine may improve variability, but we currently haven't collected data to quantify the degree.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions