Closed Bug 1225097 Opened 9 years ago Closed 9 years ago

[e10s] HTTP_* probes that regress under e10s

Categories

(Firefox :: General, defect, P1)

defect

Tracking

()

RESOLVED DUPLICATE of bug 1253379
Tracking Status
e10s + ---

People

(Reporter: rvitillo, Assigned: jimm)

References

(Blocks 1 open bug, )

Details

The histogram regressed in e10s. See provided URL and grep for the metric's name.
See also: HTTP_PAGE_COMPLETE_LOAD_CACHED_V2 HTTP_PAGE_COMPLETE_LOAD
Blocks: e10s-perf
Hey Roberto, can we get a refresh of this now that bug 1217571 is fixed on aurora?
tracking-e10s: --- → +
Flags: needinfo?
Flags: needinfo? → needinfo?(rvitillo)
Assignee: nobody → jmathies
Priority: -- → P1
Hey Honza, I'm trying to figure out if this is a regression we should be concerned about. The
Summary: [e10s] HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2 regressed → [e10s] HTTP_* probes that regress under e10s
(In reply to Jim Mathies [:jimm] from comment #6) > Hey Honza, I'm trying to figure out if this is a regression we should be > concerned about. The ignore this, he wasn't accepting needinfos. I need to find someone else.
*no* regressions: HTTP_PAGE_COMPLETE_LOAD_CACHED_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 regressions: HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - lower bucket regression
jld, any chance you might be able to shed some light on these probes? We're curious if we need to dig into the missing data in the lower buckets.
Flags: needinfo?(jld)
Sorry; I don't think I know anything useful about this part of Necko. Handing off the needinfo to jduell, who might have a better idea of what's going on, and/or who else in networking to ask.
Flags: needinfo?(jld) → needinfo?(jduell.mcbugs)
Blocks: 1198638
latest set: no regression: HTTP_SUB_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-19&table=0&trim=1&use_submission_date=0 HTTP_SUB_COMPLETE_LOAD_CACHED_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-19&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD_CACHED_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 regressions: HTTP_SUB_REVALIDATION https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_REVALIDATION&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-19&table=0&trim=1&use_submission_date=0 - right shift of data HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-11-16&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-10&table=0&trim=1&use_submission_date=0 - lower bucket regression
Updated dates: no regression: HTTP_SUB_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 HTTP_SUB_COMPLETE_LOAD_CACHED_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD_CACHED_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 regressions: HTTP_SUB_REVALIDATION https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_REVALIDATION&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 - right shift of data HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 - no hits in the 0 bucket. HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&start_date=2015-11-19&end_date=2015-11-23&keys=__none__!__none__!__none__&max_channel_version=aurora%252F44&measure=HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&table=0&trim=1&use_submission_date=0 - lower bucket regression
Honza/Michal, can you look at these and see if we've got any idea why they've slower on e10s? It's odd--I was seeing improved network channel load times when I did an experiment a while ago with e10s: see bug 1062713 comment 10. Of course, there's a lot more moving parts involved in the overall page load time.
Flags: needinfo?(jduell.mcbugs) → needinfo?(honzab.moz)
Flags: needinfo?(michal.novotny)
Here are updated graphs from the beta experiment - Generally, e10s does better in general with a few of these probes experiencing fewer lower bucket hits. The general gains I'm seeing here indicate e10s is performing better. HTTP_SUB_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD_CACHED_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_PAGE_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_PAGE_COMPLETE_LOAD https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_PAGE_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUBITEM_FIRST_BYTE_LATENCY_TIME&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_FIRST_SENT_TO_LAST_RECEIVED&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_SUB_REVALIDATION https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_REVALIDATION&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 HTTP_SUB_COMPLETE_LOAD_CACHED_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0
current regressions: HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2: https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 2% vs. 9% lowest bucket hits. the worst regression of the set. HTTP_SUB_COMPLETE_LOAD, HTTP_SUB_COMPLETE_LOAD_CACHED_V2 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_COMPLETE_LOAD&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_COMPLETE_LOAD_CACHED_V2&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 .15% vs. 1.89% lowest bucket hits. small, possibly insignificant regression. HTTP_SUB_REVALIDATION https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2015-12-08&keys=__none__!__none__!__none__&max_channel_version=beta%252F43&measure=HTTP_SUB_REVALIDATION&min_channel_version=null&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-11-26&table=0&trim=1&use_submission_date=0 .02% vs. 1.56% lowest bucket hits. small, possibly insignificant regression.
For the HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2 regression, it seems reasonable to me this would happen since the cache is in the parent and the request is made in the child. A slight 0 ms regression in a probe that measures 'HTTP page: Open -> cache read start (ms)' seems reasonable. The difference is accounted for in the higher 1-2ms, 2-3ms, and 3-4ms values that follow. For HTTP_SUB_COMPLETE_LOAD, which measures 'HTTP subitem: Overall load time - all (ms)' we see an large improvement under e10s for values > 3ms, with a small regression in numbers at 0ms. I'm going to posit that this is caused by latency in the network request made between processes. Overall we see good improvement here. The same pattern can be seen in HTTP_SUB_COMPLETE_LOAD_CACHED_V2 which measures 'HTTP subitem: Overall load time - cache hits (ms) [cache2]'. Lastly we have HTTP_SUB_REVALIDATION, which measures 'HTTP subitem: Positive cache validation time (ms)'. According to the code this measures the difference between a request start and a response end. Again we have a regression between 0->7ms, with substantial improvements beyond that range under e10s. I think we can mark this up similarly as being added latency on the low end due to cross process request times. I'm going to close this out because I don't feel we need to block on it. If anyone cc'd in or ni'd here disagrees please reopen and explain why.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WORKSFORME
Flags: needinfo?(honzab.moz)
Flags: needinfo?(michal.novotny)
From the beta no addons experiment report we have new regressions here that are more explicit compared to the old aurora data. https://github.com/vitillo/e10s_analyses/blob/master/beta45-withoutaddons/e10s_experiment.ipynb search for: HTTP_PAGE_OPEN_TO_FIRST_FROM_CACHE_V2 HTTP_PAGE_COMPLETE_LOAD_CACHED_V2 HTTP_PAGE_COMPLETE_LOAD HTTP_SUB_COMPLETE_LOAD_CACHED_V2 HTTP_SUB_COMPLETE_LOAD" HTTP_SUB_REVALIDATION HTTP_SUB_OPEN_TO_FIRST_FROM_CACHE_V2
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---
Flags: needinfo?(honzab.moz)
Status: REOPENED → RESOLVED
Closed: 9 years ago9 years ago
Flags: needinfo?(honzab.moz)
Resolution: --- → DUPLICATE
I'd more say bug 1253379.
You need to log in before you can comment on or make changes to this bug.