Closed Bug 852754 Opened 12 years ago Closed 7 years ago

Tab favicon briefly switches image downscaling algorithms when being redrawn (glitch)

Categories

(Core :: Graphics: Layers, defect)

All
macOS
defect
Not set
normal

Tracking

()

RESOLVED FIXED
mozilla48
Tracking Status
firefox48 --- fixed

People

(Reporter: fryn, Assigned: mattwoodrow)

References

()

Details

Attachments

(5 files)

Attached video Screencast of glitch (deleted) —
Steps to reproduce on OS X not in HiDPI mode: 1. Navigate tab A to a PNG larger than 16x16 or a page that has a PNG favicon larger than 16x16 or a page that has an ICO favicon containing only images inside the ICO larger than 16x16. Examples: - http://images.wikia.com/lyricwiki/images/f/fd/The_J_Arthur_Keenes_Band.png - http://rdio-a.akamaihd.net/media/images/2/app_icons/rdio_48.png - about:home - rdio.com when logged in 2. Select tab B. 3. Move cursor over favicon in tab A. 4. Move cursor away. Expected result: The favicon dims to opacity 0.8 with no transition. Actual result: While the favicon is dimming to opacity 0.8, image-rendering briefly changes to what seems to -moz-crisp-edges before reverting back to the default downscaling algorithm. This is perceived as a glitch. Workaround implying that it isn't a front-end bug: Adding `display: inline-block;` to the following CSS block prevents the glitch: https://mxr.mozilla.org/mozilla-central/source/browser/themes/osx/browser.css#2187 CC'in gavin, because I'm not sure in which component this bug should go.
This only occurs in-product on mozilla-central (regular nightlies) on OS X, not UX nightlies nor on other platforms. The bug may still exist on those other branches/platforms, but I haven't seen it manifest itself in the actual UI.
Since I have no idea what is causing this bug, I asked Kyle Huey, who suggested that I ask Joe Drew, who suggested that I "maybe start with the style system". David, do you know what might be causing this bug? Screencast is attached, and some relevant information is in the description.
Component: Graphics → Style System (CSS)
Flags: needinfo?(dbaron)
This is because changing the opacity marks it as 'active' and puts the content within it (the image) into it's own layer on the GPU. Scaling happens on the GPU using OpenGL. Once we hit the timeout (1 second) without any further changes to the opacity, we mark it as inactive, and flatten it into the layer behind it. Scaling now happens on the CPU. Different scaling gives different results, which is what you see here.
Component: Style System (CSS) → Graphics: Layers
Flags: needinfo?(dbaron)
(In reply to Matt Woodrow (:mattwoodrow) from comment #3) > This is because changing the opacity marks it as 'active' and puts the > content within it (the image) into it's own layer on the GPU. Scaling > happens on the GPU using OpenGL. > > Once we hit the timeout (1 second) without any further changes to the > opacity, we mark it as inactive, and flatten it into the layer behind it. > Scaling now happens on the CPU. > > Different scaling gives different results, which is what you see here. I see. Thank you for the explanation. :) Is there a recommended workaround to force the image to "flatten" it immediately? Setting a different value for display causes it to update of course, but that's not a landable workaround.
There isn't a standard way to avoid it, no. The reason we're scaling on GPU is because the image is the only thing within the layer. In this case we just upload the whole image at it's original size and let the GPU scale it to fit. If the layer was made up of multiple pieces of content, then we'd draw it all in software at the required size and upload that. Adding something else within the opacity would do this, but if it's not visible then layout will do it's best to optimize it away and it won't help. Alternatively, if it is visible, then it will change rendering and I doubt you want that. Maybe a background color with an opacity of 0.01 would work? CC'ing roc to see if he has any other ideas.
The GPU-scaled version looks crummy, honestly. Matt, do you have an idea how big the perf impact would be to scale the image on the CPU before uploading the texture to the GPU in cases like this?
Is the GPU using nearest-neighbour or something? Why is it so different?
(In reply to Seth Fowler [:seth] from comment #6) > The GPU-scaled version looks crummy, honestly. Matt, do you have an idea how > big the perf impact would be to scale the image on the CPU before uploading > the texture to the GPU in cases like this? It shouldn't be any worse than drawing the scaled image in software. (In reply to Robert O'Callahan (:roc) (Mozilla Corporation) from comment #7) > Is the GPU using nearest-neighbour or something? Why is it so different? I believe so, yes. Maybe we should just abort the ImageLayer optimization if there are large scale factors set.
Actually, no, we should definitely be using bilinear for OpenGL. Quartz does different high-quality downsampling though I believe.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WORKSFORME
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---
Is this something that is easy to fix? It's really quite annoying
Flags: needinfo?(matt.woodrow)
(In reply to Dave Townsend [:mossop] from comment #11) > Is this something that is easy to fix? It's really quite annoying It is also getting worse over time as more sites are adding hi-res favicons and just scaling them down.
What's the scale factor in these cases? 2? In bug 1182929 I added a workaround so that we don't use ImageLayers (low quality resizing) if the scale factor is 5 or higher.
Here is an example image that is causing it: https://static.wunderlist.com/44685ca8cfaade90d24f718bf876257562a21214/images/favicon.ico It's 128x128px and displayed in the tabstrip as a 16x16px image.
So the scale factors I'm seeing look to be higher than 5 unless I'm misunderstanding things.
Flags: needinfo?(mstange)
Bueller?
Flags: needinfo?(roc)
(In reply to Dave Townsend [:mossop] from comment #15) > So the scale factors I'm seeing look to be higher than 5 unless I'm > misunderstanding things. Ok, in that case I don't know why this happens and can't say anything more without debugging it.
Flags: needinfo?(mstange)
Me neither, and I can't reproduce on Linux with Basic compositor.
Flags: needinfo?(roc)
Even though there are already several examples in this bug I just noticed a particularly bad one on Amazon.com Screencast: http://people.mozilla.org/~shorlander/bugs/Bug-852754-amazon-favicon-flicker.webm Favicon file: http://www.amazon.com/favicon.ico
This affects Amazon, Facebook, Twitter, Reddit and Gmail at least. How do we get someone to look into this?
How does one reproduce this? What version of firefox, platform etc. I've tried Firefox 48 on both Windows and OSX (at various resolutions and DPIs), and can't reproduce this at all. The amazon icon from comment 19 is only 48x48, so that would be well within the 5x limit though. The 128x128 example from comment could also be, if we were on a screen that had 2x DPI scaling (like Retina).
Flags: needinfo?(matt.woodrow)
(In reply to Matt Woodrow (:mattwoodrow) from comment #21) > How does one reproduce this? What version of firefox, platform etc. > > I've tried Firefox 48 on both Windows and OSX (at various resolutions and > DPIs), and can't reproduce this at all. > > The amazon icon from comment 19 is only 48x48, so that would be well within > the 5x limit though. > > The 128x128 example from comment could also be, if we were on a screen that > had 2x DPI scaling (like Retina). I am on OS X on a normal DPI monitor. Open a background tab with an affected site and mouse over it some. What's shown in this video is how I see it happen: http://people.mozilla.org/~shorlander/bugs/Bug-852754-amazon-favicon-flicker.webm
Flags: needinfo?(matt.woodrow)
(In reply to Stephen Horlander [:shorlander] from comment #22) > (In reply to Matt Woodrow (:mattwoodrow) from comment #21) > > How does one reproduce this? What version of firefox, platform etc. > > > > I've tried Firefox 48 on both Windows and OSX (at various resolutions and > > DPIs), and can't reproduce this at all. > > > > The amazon icon from comment 19 is only 48x48, so that would be well within > > the 5x limit though. > > > > The 128x128 example from comment could also be, if we were on a screen that > > had 2x DPI scaling (like Retina). > > I am on OS X on a normal DPI monitor. Open a background tab with an affected > site and mouse over it some. > > What's shown in this video is how I see it happen: > http://people.mozilla.org/~shorlander/bugs/Bug-852754-amazon-favicon-flicker. > webm Ditto. Latest OSX, latest nightly but it's been happening on nightlies for months. Of the five different sites I have opened in pinned tabs permanently all but two exhibit this issue.
I can also see this on my MBP's retina display but the effect is far less pronounced and as far as I can see only affects one of my tabs, Wunderlist's favicon: https://static.wunderlist.com/44685ca8cfaade90d24f718bf876257562a21214/images/favicon.ico
Oh, looks like Markus' code for limiting the scale only applies to <image>, not xul imagebox, nor css background images.
Flags: needinfo?(matt.woodrow)
This patch sort of got away from me a bit, I can try split it out if you'd like.
Assignee: nobody → matt.woodrow
Attachment #8738832 - Flags: review?(mstange)
Attachment #8738834 - Flags: review?(mstange)
Attachment #8738835 - Flags: review?(mstange)
Apparently drawing a 48x48 favicon at 16x16 looks bad, so this new limit should block that.
Attachment #8738836 - Flags: review?(mstange)
Fair bit of trailing whitespace snuck in, I'll fix those locally.
Attachment #8738832 - Flags: review?(mstange) → review+
Attachment #8738834 - Flags: review?(mstange) → review+
Attachment #8738835 - Flags: review?(mstange) → review+
Comment on attachment 8738836 [details] [diff] [review] Part 4: Reduce max downscaling allowed to <3 Review of attachment 8738836 [details] [diff] [review]: ----------------------------------------------------------------- <3
Attachment #8738836 - Flags: review?(mstange) → review+
hey, I think we have a perf win on tscrollx for linux64: https://treeherder.mozilla.org/perf.html#/alerts?id=766
Fixed on Nightly for me. Thank you!
Depends on: 1263480
(In reply to Stephen Horlander [:shorlander] from comment #35) > Fixed on Nightly for me. Thank you! So, it seems mostly fixed, but I discovered that Yahoo at least still exhibits this behavior. STR: Do a Yahoo search, switch tabs, hover over background Yahoo search tab, notice flickering.
Status: RESOLVED → REOPENED
Flags: needinfo?(matt.woodrow)
Resolution: FIXED → ---
I see this, it's not particularly bad though. I guess we could lower the scaling threshold even more, but we're trading off performance for quality and I'm not sure it's worth it.
Flags: needinfo?(matt.woodrow)
Depends on: 1265256
(In reply to Joel Maher (:jmaher) from comment #33) > hey, I think we have a perf win on tscrollx for linux64: > https://treeherder.mozilla.org/perf.html#/alerts?id=766 Looks like this was just due to the test hitting bug 1263480. Now that bug 1263480 has been fixed, tscrollx has reverted to the old numbers.
Depends on: 1265574
Looks like all the patches landed here. If we still care about the issue mentioned in comment 36 then we should file a new bug for it. Leaving this bug open only serves to confuse things.
Status: REOPENED → RESOLVED
Closed: 9 years ago7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: