Closed
Bug 1122032
Opened 10 years ago
Closed 10 years ago
Setup minimal screensharing for Loop desktop in Rooms
Categories
(Hello (Loop) :: Client, defect, P1)
Hello (Loop)
Client
Tracking
(firefox38 fixed)
People
(Reporter: standard8, Assigned: standard8)
References
Details
User Story
Set up a minimal screen sharing functionality for Loop that's disabled by default: - Add a green button on conversation window for toggling on/off one form of screen sharing. - Hook up screen sharing to the TokBox sdk - Hide remote video on standalone, and show screen sharing video in place (or something similar) Do the minimum: for example, disabling perms prompt is fine, selecting a random window or tab is also fine.
Attachments
(5 files, 7 obsolete files)
(deleted),
patch
|
scaraveo
:
feedback+
florian
:
feedback+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
Details | Diff | Splinter Review | |
(deleted),
patch
|
jesup
:
review+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
standard8
:
review+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
mikedeboer
:
review+
|
Details | Diff | Splinter Review |
No description provided.
Assignee | ||
Comment 1•10 years ago
|
||
Matej/Sevaan: I need a couple of tooltips for the screen sharing button. I'm thinking:
- Share your screen or windows
- Stop sharing
I'm not quite sure about the first one.
btw, here's the UX: https://projects.invisionapp.com/share/GU1Z0XTXR#/screens/56154705
Flags: needinfo?(sfranks)
Flags: needinfo?(matej)
Comment 2•10 years ago
|
||
I feel like "Share your screen" may be sufficient for the first one.
Flags: needinfo?(matej)
Updated•10 years ago
|
backlog: --- → Fx38+
Priority: -- → P1
Updated•10 years ago
|
Flags: needinfo?(sfranks)
Assignee | ||
Comment 3•10 years ago
|
||
These depend on bug 1093780 & its dependencies. This sets up a screen sharing button on desktop.
Assignee | ||
Comment 4•10 years ago
|
||
Enables standalone to receive and display the video reasonably nicely.
Assignee | ||
Comment 5•10 years ago
|
||
Assignee | ||
Comment 6•10 years ago
|
||
Assignee | ||
Comment 7•10 years ago
|
||
Assignee | ||
Comment 8•10 years ago
|
||
This is what we need for Loop's screen sharing functionality.
Moving the Loop privilege detection allows the about:loopconversation to bypass the screen-sharing url whitelist (since we're browser anyway, and that would depend on https). We then turn the privilege off for window/application sharing as we currently want the prompt to appear. This may change in future, but for now this is the simplest option we're taking to get something landed.
I've also extended the mochitests to check that the permissions are granted or prompted at the right time. I'm not testing the full functionality for the permissions prompt for screen share as that should be tested elsewhere.
Attachment #8555279 -
Attachment is obsolete: true
Attachment #8555474 -
Flags: review?(rjesup)
Assignee | ||
Comment 9•10 years ago
|
||
Try push for part 3:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=b5a165507cd2
Assignee | ||
Comment 10•10 years ago
|
||
Updated patch for try server results. I've disabled the added tests on WinXP, Mac 10.6 and Linux.
WinXP and Mac 10.6 are unsupported except by pref, and I don't think it makes sense to turn that on just for these tests (and risk something breaking).
Linux tests are failing for some unknown reason. As we've not got any other screenshare prompt tests around, I'm going to suggest that we file a bug for screenshare prompt tests and have it attempt to fix the Linux issues at the same time.
Attachment #8555474 -
Attachment is obsolete: true
Attachment #8555474 -
Flags: review?(rjesup)
Attachment #8556495 -
Flags: review?(rjesup)
Updated•10 years ago
|
Attachment #8555280 -
Flags: feedback?(florian)
Comment 11•10 years ago
|
||
Comment on attachment 8555281 [details] [diff] [review]
Part 5 - Allow multiple anchors for multiple notifications without using an iconbox.
Review of attachment 8555281 [details] [diff] [review]:
-----------------------------------------------------------------
Florian, I'd really appreciate your thoughts on part 4 and part 5; they're extending the PopupNotifications.jsm implementation to support multiple anchors that can target a specific notification (type).
Part 4 adds the separate anchor for screensharing notifications.
Part 5 adds logic to connect a specific anchor to notifications, without the specific need for an iconbox, like the urlbar uses. This is most definitely compatible with the urlbar notifications, so not regression sensitive. The non-specific anchor will still be used as a catch-all for all other notifications for the chat window.
Attachment #8555281 -
Flags: feedback?(florian)
Comment 12•10 years ago
|
||
Comment on attachment 8556495 [details] [diff] [review]
Part 3 - Automatically allow screensharing for the Loop in-desktop pages.
Review of attachment 8556495 [details] [diff] [review]:
-----------------------------------------------------------------
r+ if you make it prompt for all types of sharing, or explain why not and ask again.
::: dom/media/MediaManager.cpp
@@ +1740,5 @@
> +
> + // For window and application sharing, Loop needs to prompt.
> + if (isLoop &&
> + (src == dom::MediaSourceEnum::Window ||
> + src == dom::MediaSourceEnum::Application)) {
screen sharing?
tab sharing?
They all should prompt for now, right?
Attachment #8556495 -
Flags: review?(rjesup) → review-
Assignee | ||
Comment 13•10 years ago
|
||
Yes, we do want to disable the prompts for tab sharing (screen is TBD at the moment, so I've added it in) - we'll be implementing active tab sharing, with our own UX to control it.
For window sharing we're currently using the permissions dialog.
We're probably going to be moving to a UX which would mean we circumvent all the permissions dialog by providing our own UX (since we're build into FF we're using different rules).
At the moment, screen and application do prompt, we're not using those for the first versions, so it doesn't really matter atm.
I've also commented in the patch to try and explain this a bit.
Attachment #8556495 -
Attachment is obsolete: true
Attachment #8557085 -
Flags: review?(rjesup)
Assignee | ||
Comment 14•10 years ago
|
||
This one removes the test that now doesn't work due to the patch no longer allowing screen wthout prompt.
Attachment #8557085 -
Attachment is obsolete: true
Attachment #8557085 -
Flags: review?(rjesup)
Attachment #8557096 -
Flags: review?(rjesup)
Assignee | ||
Comment 15•10 years ago
|
||
Updated patch on top of current sdk patches.
Attachment #8557100 -
Flags: review?(mdeboer)
Assignee | ||
Updated•10 years ago
|
Attachment #8555270 -
Attachment is obsolete: true
Updated•10 years ago
|
Attachment #8555280 -
Attachment description: Part 4 - Support the screensharing doorhanger in Social API chat windows and allow for mutiple independent notification icons per type. → Part 4 - Support the screensharing doorhanger in Social API chat windows and allow for multiple independent notification icons per type.
Attachment #8555280 -
Flags: feedback?(mixedpuppy)
Comment 16•10 years ago
|
||
Comment on attachment 8557100 [details] [diff] [review]
Part 1 - Setup minimal screen sharing for Loop from desktop (disabled by default).
Review of attachment 8557100 [details] [diff] [review]:
-----------------------------------------------------------------
Pfew, big patch!
I could only really find a few nits, the whole thing looks nicely done. Plus, I've seen it working, which helps.
::: browser/components/loop/content/conversation.html
@@ +39,5 @@
> <script type="text/javascript" src="loop/shared/js/roomStates.js"></script>
> <script type="text/javascript" src="loop/shared/js/fxOSActiveRoomStore.js"></script>
> <script type="text/javascript" src="loop/shared/js/activeRoomStore.js"></script>
> <script type="text/javascript" src="loop/shared/js/feedbackStore.js"></script>
> + <script type="text/javascript" src="loop/shared/js/views.js"></script>
why here, right between the two feedback feature related files?
::: browser/components/loop/content/js/roomViews.jsx
@@ +171,5 @@
>
> propTypes: {
> + dispatcher: React.PropTypes.instanceOf(loop.Dispatcher).isRequired,
> + mozLoop:
> + React.PropTypes.object.isRequired,
Why the newline?
@@ +246,5 @@
> + state: this.state.screenSharingState,
> + visible: false
> + };
> +
> + if (this.props.mozLoop.getLoopPref("screenshare.enabled")) {
since this returns a bool anyway, can you simply do:
```js
var screenShareData = {
visible: this.props.mozLoop.getLoopPref("screenshare.enabled")
}
```
?
::: browser/components/loop/content/shared/js/actions.js
@@ +198,5 @@
> enabled: Boolean
> }),
>
> /**
> + * Used to start a screen share
nit: missing dot.
@@ +204,5 @@
> + StartScreenShare: Action.define("startScreenShare", {
> + }),
> +
> + /**
> + * Used to end a screen share
nit: missing dot.
@@ +213,5 @@
> + /**
> + * Used to notifiy that screen sharing is active or not.
> + */
> + ScreenSharingState: Action.define("screenSharingState", {
> + // One of loop.shared.utils.SCREEN_SHARE_STATES
nit: missing dot.
::: browser/components/loop/content/shared/js/otSdkDriver.js
@@ +94,5 @@
> + state: SCREEN_SHARE_STATES.PENDING
> + }));
> +
> + var config = this._getCopyPublisherConfig();
> + config.videoSource = "window";
Please add a comment that this is temporary, pending a dropdown share type selector
@@ +421,5 @@
> + _onScreenShareDenied: function() {
> + this.dispatcher.dispatch(new sharedActions.ScreenSharingState({
> + state: SCREEN_SHARE_STATES.INACTIVE
> + }));
> + },
nit: trailing comma
::: browser/components/loop/standalone/content/index.html
@@ +111,5 @@
> <script type="text/javascript" src="shared/js/roomStates.js"></script>
> <script type="text/javascript" src="shared/js/fxOSActiveRoomStore.js"></script>
> <script type="text/javascript" src="shared/js/activeRoomStore.js"></script>
> <script type="text/javascript" src="shared/js/feedbackStore.js"></script>
> + <script type="text/javascript" src="shared/js/views.js"></script>
Same question here ;)
::: browser/components/loop/test/desktop-local/index.html
@@ +54,5 @@
> <script src="../../content/shared/js/roomStates.js"></script>
> <script src="../../content/shared/js/fxOSActiveRoomStore.js"></script>
> <script src="../../content/shared/js/activeRoomStore.js"></script>
> <script src="../../content/shared/js/feedbackStore.js"></script>
> + <script src="../../content/shared/js/views.js"></script>
Same question here ;)
::: browser/components/loop/test/desktop-local/roomViews_test.js
@@ +283,5 @@
> + view.setState({screenSharingState: SCREEN_SHARE_STATES.INACTIVE});
> +
> + var muteBtn = view.getDOMNode().querySelector('.btn-mute-video');
> +
> + React.addons.TestUtils.Simulate.click(muteBtn);
nit: indentation
::: browser/components/loop/test/shared/views_test.js
@@ +134,5 @@
> + expect(comp.getDOMNode().classList.contains("disabled")).eql(false);
> + });
> +
> + it("should dispatch a StartScreenShare action on click when the state" +
> + "is not active", function() {
nit: Really, this 80-column rule... it's kinda outdated and we're not sticking to it in desktop code IF it reduces readability of the code. Concatenating a string here is not what we want, so can you keep the string on one line?
@@ +151,5 @@
> + }));
> + });
> +
> + it("should dispatch a EndScreenShare action on click when the state" +
> + "is active", function() {
nit: same.
@@ +164,5 @@
> +
> + sinon.assert.calledOnce(dispatcher.dispatch);
> + sinon.assert.calledWithExactly(dispatcher.dispatch,
> + new sharedActions.EndScreenShare({
> + }));
nit: indentation.
Attachment #8557100 -
Flags: review?(mdeboer) → review+
Updated•10 years ago
|
Attachment #8557096 -
Flags: review?(rjesup) → review+
Assignee | ||
Comment 17•10 years ago
|
||
(In reply to Mike de Boer [:mikedeboer] from comment #16)
> ::: browser/components/loop/content/conversation.html
> @@ +39,5 @@
> > <script type="text/javascript" src="loop/shared/js/roomStates.js"></script>
> > <script type="text/javascript" src="loop/shared/js/fxOSActiveRoomStore.js"></script>
> > <script type="text/javascript" src="loop/shared/js/activeRoomStore.js"></script>
> > <script type="text/javascript" src="loop/shared/js/feedbackStore.js"></script>
> > + <script type="text/javascript" src="loop/shared/js/views.js"></script>
>
> why here, right between the two feedback feature related files?
views.js now depends on the dispatcher, it also is possible that it could, in future, depend on some of the stores. I didn't want us to keep on having to move it, if that was the case... However, also feedbackViews.js depends on views.js, so we can't swap the order.
Assignee | ||
Comment 18•10 years ago
|
||
Updated for review comments.
Attachment #8557100 -
Attachment is obsolete: true
Attachment #8557919 -
Flags: review+
Assignee | ||
Comment 19•10 years ago
|
||
This part is now ready for review. Updated with extra comments and tests.
The functional test has been updated, but I've disabled the screenshare testing parts at the moment - I think the tests should work, save for the permissions issues.
I'll probably take a look at the prompt issues in the functional test later, but I think this can land without those, hence putting up for review, I can always make them a separate bug/patch.
Attachment #8555271 -
Attachment is obsolete: true
Attachment #8557971 -
Flags: review?(mdeboer)
Assignee | ||
Updated•10 years ago
|
Assignee: nobody → standard8
Iteration: --- → 38.2 - 9 Feb
Points: --- → 8
Comment 20•10 years ago
|
||
Comment on attachment 8557971 [details] [diff] [review]
Part 2 - Show the Loop screenshare video in place of the remote video for now.
Review of attachment 8557971 [details] [diff] [review]:
-----------------------------------------------------------------
So I have one question, but that doesn't keep me from saying: ship it!
::: browser/components/loop/content/shared/js/activeRoomStore.js
@@ +382,5 @@
> this.setStoreState({screenSharingState: actionData.state});
> },
>
> /**
> + * Used to not the current state of receiving screenshare data.
nit: note.
::: browser/components/loop/content/shared/js/otSdkDriver.js
@@ +355,5 @@
> +
> + /**
> + * Handles the event when the remote stream is destroyed.
> + *
> + * @param {StreamEvent} event The event details:
nit: superfluous space.
::: browser/components/loop/test/functional/config.py
@@ +13,5 @@
> "devtools.debugger.remote-enabled": True,
> "media.volume_scale": "0",
> "loop.gettingStarted.seen": True,
> "loop.seenToS": "seen",
> + "loop.screenshare.enabled": True,
I thought you wanted to disable the screenshare tests for now?
Attachment #8557971 -
Flags: review?(mdeboer) → review+
Assignee | ||
Comment 21•10 years ago
|
||
(In reply to Mike de Boer [:mikedeboer] from comment #20)
> ::: browser/components/loop/test/functional/config.py
> > + "loop.screenshare.enabled": True,
>
> I thought you wanted to disable the screenshare tests for now?
The pref only enables the button on the display. The code that runs the screenshare part is commented out. I don't think having it displayed affects anything significant.
Comment 22•10 years ago
|
||
Comment on attachment 8555280 [details] [diff] [review]
Part 4 - Support the screensharing doorhanger in Social API chat windows and allow for multiple independent notification icons per type.
This looks ok. I wonder a little bit if it isn't time to just make an iconbox here, but that may be more effort than it's worth.
Attachment #8555280 -
Flags: feedback?(mixedpuppy) → feedback+
Assignee | ||
Comment 23•10 years ago
|
||
https://hg.mozilla.org/integration/fx-team/rev/818a084951ec
https://hg.mozilla.org/integration/fx-team/rev/213565c829e4
https://hg.mozilla.org/integration/fx-team/rev/09c2a262ed60
Leave-open as we need to do some bug cleanup, which I'll make sure happens in the morning.
Keywords: leave-open
Comment 24•10 years ago
|
||
Comment 25•10 years ago
|
||
Comment on attachment 8555280 [details] [diff] [review]
Part 4 - Support the screensharing doorhanger in Social API chat windows and allow for multiple independent notification icons per type.
Review of attachment 8555280 [details] [diff] [review]:
-----------------------------------------------------------------
Like Shane, I wonder if we shouldn't just make the chat window have an icon box. But this seems fine otherwise.
::: toolkit/modules/PopupNotifications.jsm
@@ +731,5 @@
> // remove previous icon classes
> let className = anchorElement.className.replace(/([-\w]+-notification-icon\s?)/g,"")
> className = "default-notification-icon " + className;
> + if (notifications.length > 0) {
> + // Find the first notification this anchor used for.
I can't parse this comment.
Attachment #8555280 -
Flags: feedback?(florian) → feedback+
Comment 26•10 years ago
|
||
Comment on attachment 8555281 [details] [diff] [review]
Part 5 - Allow multiple anchors for multiple notifications without using an iconbox.
Review of attachment 8555281 [details] [diff] [review]:
-----------------------------------------------------------------
The code in PopupNotifications.jsm has pretty good test coverage, so if you are extending it, please add tests for your additions.
::: toolkit/modules/PopupNotifications.jsm
@@ +655,4 @@
> * notifications will be retrieved off the current
> * browser tab
> * @param anchor is a XUL element that the notifications panel will be
> * anchored to
Please update the comment here.
@@ +659,5 @@
> * @param dismissShowing if true, dismiss any currently visible notifications
> * if there are no notifications to show. Otherwise,
> * currently displayed notifications will be left alone.
> */
> + _update: function PopupNotifications_update(notifications, anchors = new Set(), dismissShowing = false) {
I'm not really excited by the change of type of the second parameter here; I wonder if this method could have been used by add-ons despite the leading _ character.
How would you feel about something like:
if (anchors instanceof Ci.nsIDOMXULElement)
anchors = new Set(anchors);
@@ +689,5 @@
>
> // If no anchor has been passed in, use the anchor of the first
> // showable notification.
> + if (!anchorElements.size && notificationsToShow.length)
> + anchorElements.add(notificationsToShow[0].anchorElement);
Should this actually be:
anchorsElements = this._getAnchorsForNotifications(notificationsToShow)?
Or should we set the anchors parameter automatically to this._getAnchorsForNotifications(notifications) when it's not been provided?
It seems it would simplify the callers in _swapBrowserNotifications.
@@ +734,5 @@
> }
> },
>
> _updateAnchorIcon: function PopupNotifications_updateAnchorIcon(notifications,
> + anchorElements) {
Should this still support receiving a single anchorElement? Looks like it's not needed as you changed all the callers, so maybe rename this to _updateAnchorIcon*s*?
Attachment #8555281 -
Flags: feedback?(florian)
Updated•10 years ago
|
Updated•10 years ago
|
Keywords: leave-open
You need to log in
before you can comment on or make changes to this bug.
Description
•