Closed
Bug 1105066
Opened 10 years ago
Closed 10 years ago
[MSE] Sound synch issues with MP4 YouTube videos
Categories
(Core :: Audio/Video, defect, P1)
Tracking
()
VERIFIED
FIXED
mozilla37
People
(Reporter: bugs, Assigned: ajones)
References
(Blocks 1 open bug)
Details
Attachments
(3 files)
(deleted),
patch
|
ajones
:
review+
Sylvestre
:
approval-mozilla-beta+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
ajones
:
review+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
mattwoodrow
:
review+
|
Details | Diff | Splinter Review |
When MSE is enabled and the video is using MP4, seeking into videos causes sound to play back from earlier seek points. This may be a dupe of other seeking issues, so feel free to dupe as needed. Please let me know if I can provide anymore information.
Comment 2•10 years ago
|
||
I saw this with a build based on 7b33ee7fd162 after seeking on https://www.youtube.com/watch?v=fhcZ6b2FSsk but then couldn't reproduce.
Comment 3•10 years ago
|
||
I saw this in today's Nightly on my wife's Win 7 ultrabook and on my Win 8 work Desktop on this video:
https://www.youtube.com/watch?v=KqBin1GSkF4
It happened (on both occurrences) when I skipped an ad while playing in fullscreen mode.
Assignee | ||
Comment 4•10 years ago
|
||
(In reply to Chris Pearce (:cpearce) from comment #3)
> I saw this in today's Nightly on my wife's Win 7 ultrabook and on my Win 8
> work Desktop on this video:
> https://www.youtube.com/watch?v=KqBin1GSkF4
>
> It happened (on both occurrences) when I skipped an ad while playing in
> fullscreen mode.
I playing that video on Android and the AV sync is up the boohai.
Comment 5•10 years ago
|
||
I see logs like this when it's happening:
1342992384[14020b670]: Decoder=12aab53a0 playing video frame 3632866666 (queued=12, state-machine=7, decoder-queued=5)
1356075008[12e5cf710]: Decoder=12aab53a0 EnsureVideoDecodeTaskQueued isDecoding=1 status=1
1342992384[14020b670]: Decoder=12aab53a0 UpdatePlaybackPositionInternal(3632866930) (mStartTime=0)
1573171200[140209070]: AudioSink=13fe37030 playing 1024 frames of audio at time 3633876235
For some reason it looks like our audio is a full second ahead of the playback position, not sure why the AdvanceFrame logic in MDSM isn't fixing it.
Comment 6•10 years ago
|
||
The GetClock() value being returned in AdvanceFrame matches (is close to) the video frame time.
We're definitely getting the value from ::GetAudioClock, though part of it comes from mAudioStartTime and part from mAudioSink->GetPosition().
I'm not sure how these two values are meant to match up with the presentation timestamp of the audio frames being played, but they don't seem be doing it right.
Comment 7•10 years ago
|
||
Is there a seek before A/V async happenes?
Assignee | ||
Comment 8•10 years ago
|
||
The MDSM decodes a full second of audio ahead. It looks like that video is just broken becuse the AV sync is busted on IE as well.
Marcia - can you see if you can reproduce this issue and get a log? I did it in the past by seeking around while compiling.
Flags: needinfo?(mozillamarcia.knous)
Comment 10•10 years ago
|
||
The audio decode runs 1 second ahead of the video decode/playback position. When we skip the ad, maybe the MDSM's audio queue is full and not getting cleared properly when playback seeks ahead to after the ad?
Flags: needinfo?(cpearce)
Assignee | ||
Comment 11•10 years ago
|
||
Steps to reproduce:
* Navigate to https://www.youtube.com/watch?v=HykiuFCly0A&t=4000
* Remove the |&t=4000| and press enter
Expected results:
The clip will start again at the beginning. This is what IE does.
Actual results:
The video indicates that it is at the same position but plays back a different point in the video with the wrong AV sync.
Assignee | ||
Comment 12•10 years ago
|
||
I can't reproduce this on IE or with MSE disabled.
Comment 13•10 years ago
|
||
Comment 14•10 years ago
|
||
Assignee | ||
Updated•10 years ago
|
Attachment #8547231 -
Flags: review+
Assignee | ||
Updated•10 years ago
|
Attachment #8547232 -
Flags: review+
Assignee | ||
Comment 15•10 years ago
|
||
Attachment #8547265 -
Flags: review?(matt.woodrow)
Assignee | ||
Updated•10 years ago
|
Assignee: nobody → ajones
Status: NEW → ASSIGNED
Updated•10 years ago
|
Attachment #8547265 -
Flags: review?(matt.woodrow) → review+
Assignee | ||
Comment 16•10 years ago
|
||
Comment 17•10 years ago
|
||
https://hg.mozilla.org/mozilla-central/rev/f433e2cda307
https://hg.mozilla.org/mozilla-central/rev/db991158a2fe
https://hg.mozilla.org/mozilla-central/rev/a0954dd9d40a
Status: ASSIGNED → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla37
Comment 18•10 years ago
|
||
Comment on attachment 8547231 [details] [diff] [review]
Part 1: make SeekPromise return the time we actually seeked to
Approval Request Comment
[Feature/regressing bug #]: MSE
[User impact if declined]: Audio/Video sync issues with YouTube playback.
[Describe test coverage new/current, TBPL]: Landed on m-c. Manual testing.
[Risks and why]: This isn't a small change, but is relatively straightforward, and fixes a clear problem. Only Part 1 affects non-MSE playback. We can't ship the feature without this one.
[String/UUID change made/needed]: None.
Attachment #8547231 -
Flags: approval-mozilla-beta?
Comment 19•10 years ago
|
||
Beta approval request is for all three patches on this bug.
status-firefox36:
--- → affected
status-firefox37:
--- → fixed
Updated•10 years ago
|
Attachment #8547231 -
Flags: approval-mozilla-beta? → approval-mozilla-beta+
Comment 20•10 years ago
|
||
Updated•10 years ago
|
Flags: qe-verify+
Comment 21•10 years ago
|
||
I have spot checked a few different Windows machines including Win 7, Vista and Win 8. Following the STR in Comment 11 I haven't been able to reproduce any issues using the latest Nightly.
Mozilla/5.0 (Windows NT 6.0; rv:38.0) Gecko/20100101 Firefox/38.0 ID:20150121030203 CSet: 540077a30866
I will also spot check the betas to verify that this is no longer being seen.
Flags: needinfo?(mozillamarcia.knous)
Comment 22•10 years ago
|
||
I was unable to reproduce the initial issue using a Nightly build before the fix.
I also used Firefox 36 beta 3 and latest Aurora builds on Windows 7 64bit, Windows 10 and Windows 8.1 64bit and did not reproduce either. Anthony, since you reproduced this can you please also verify that this is not reproducible anymore for you on 36 beta and Aurora?
Flags: needinfo?(ajones)
Comment 24•10 years ago
|
||
Great, thanks Anthony.
Updated•9 years ago
|
You need to log in
before you can comment on or make changes to this bug.
Description
•