Closed Bug 1235925 Opened 9 years ago Closed 8 years ago

libvpx: OOM Crash [@vp9_get_frame_buffer]

Categories

(Core :: Audio/Video: Playback, defect, P3)

defect

Tracking

()

RESOLVED FIXED
Tracking Status
firefox46 --- affected

People

(Reporter: tsmith, Assigned: rillian)

References

Details

(Keywords: csectype-oom, testcase)

Attachments

(2 files)

This was found by fuzzing libvpx (commit b8c2a4eb0c47b633096f5c428b70607e7bf8d570). This bug slows down feedback driven fuzzing of libvpx.
Attached file call_stack.txt (deleted) —
Attached file test_case.vp9.ivf (deleted) —
I reported this bug (alongside a fix) many moons ago to google.
(In reply to Jean-Yves Avenard [:jya] from comment #4) > I reported this bug (alongside a fix) many moons ago to google. Great! I'm surprised it hasn't been fixed, it took seconds to find and really slows down feedback driven fuzzing when variations make it in to the test corpus.
the problem is that within the frame recycling/allocation, if there's an OOM, that information is never passed on to the caller: so at best it will enter an infinite loop ; or it will crash. need to find that bug#
Jean-Yves, can you link your fix so we can apply it to m-c, please?
Assignee: nobody → giles
Flags: needinfo?(jyavenard)
Priority: -- → P1
Hmm. I can't reproduce with a (mac) asan build of libvpx b8c2a4eb0c47b633096f5c428b70607e7bf8d570. Tyson, can you confirm the bug is still in libvpx e67d45d4ce92468ba193288b59093fef0a502662? That's the revision the current firefox in-tree copy is based on.
Flags: needinfo?(twsmith)
(In reply to Ralph Giles (:rillian) from comment #8) > Hmm. I can't reproduce with a (mac) asan build of libvpx > b8c2a4eb0c47b633096f5c428b70607e7bf8d570. Tyson, can you confirm the bug is > still in libvpx e67d45d4ce92468ba193288b59093fef0a502662? That's the > revision the current firefox in-tree copy is based on. Yes I can still reproduce this with libvpx at e67d45d4ce92468ba193288b59093fef0a502662
Flags: needinfo?(twsmith)
Ok. Thanks for checking.
Priority: P1 → P2
I haven't been able to follow up on this. Maire, can someone on your team take a look?
Flags: needinfo?(mreavy)
Can I get a link to the bug report to Google? And a link to Jean-Yves' fix?
Flags: needinfo?(mreavy)
I got a reply from Jean-Yves in irc last night saying he can't find a reference to this. So I think we have to start from scratch. Comment 6 (from Jean-Yves) provides a big clue about what's happening and how to fix the problem. Anthony -- Do you need this fixed soon? IIUC this is slowing down fuzzing of VP9 decode. I can put someone on this eventually, but for WebRTC and our work, this isn't a high priority -- at least not yet. If my team takes this bug over, we'll realistically get to this toward the end of Q1 or beginning of Q2. Let me know if that's "ok" (and you want me to take this over) or if you want to put someone on it sooner; obviously Jean-Yves would be ideal to take this over. Thanks.
Flags: needinfo?(jyavenard) → needinfo?(ajones)
FWIW I am not fuzzing this at the moment. I will likely revisit is in a couple months unless it is needed earlier.
(In reply to Tyson Smith [:tsmith] (PTO until Feb 10) from comment #14) > FWIW I am not fuzzing this at the moment. I will likely revisit is in a > couple months unless it is needed earlier. Thanks, Tyson. This info helps with planning. When you are close to getting back to this, can you re-ping me (needinfo :mreavy works well for me)? I'll then huddle with Anthony to figure out who is available to fix this.
Flags: needinfo?(twsmith)
I don't think we should spend time on it now.
Flags: needinfo?(ajones)
If you have a link to the upstream bug/patch I can take a look.
We don't have an upstream link. If you can reproduce with the ivf testcase, bisecting should be straightforward.
Is it already merged upstream? I am offering to take the patch mentioned in comment #4.
(In reply to johannkoenig from comment #19) > Is it already merged upstream? I am offering to take the patch mentioned in > comment #4. Jean-Yves can you provide details please?
Flags: needinfo?(twsmith) → needinfo?(jyavenard)
Flags: needinfo?(jyavenard)
Mass change P2 -> P3
Priority: P2 → P3
The patch mentioned in #21 was upstreamed and part of the v1.6.0 release, merged in bug #1223692
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: