We'll be establishing infrastructure for adding site-specific wrapper scripts in bug 1670108 and while we have an approach for testing site-specific scripts, it's not entirely reliable because these tests mock what we expect the video player to do at the time of writing them. With this approach, we have to rely on QA or users to report when a site-specific wrapper no longer works and updated our tests...so I think we can do better.

It would be ideal if we can establish a testing framework for automating UI tests on the real thing (or at least get close to it).