WebRTC App Development on Mobile by Shubh Agarwal, OpenClove. Presented at WebRTC Expo and Conference in Santa Clara.

1. 1
11/26/2013

2. Shubh Agarwal
OpenClove
DEVELOPING FOR MOBILE WEBRTC
2
11/26/2013

3. Mobile Principles
• User Experience - Focus on the app and the content
• Performance - Highly efficient video delivery
• Features - Un-limit the capabilities for human
behavior
3
11/26/2013

4. Brave New World
2.8 B
Internet
Users
Content &
Reach
The NEW
WebRTC
Paradigm
Consume any online Content
with Friends, Family,
and Community
People Interaction
4
4.5 Billion
Mobile subs
(unique)

5. Why Mobile or Tablets?
Enterprise migration toward tablets
from PCs will effectively cause
many – if not most – companies to
“dismantle” their current businessas-usual approach to technology
- Eric Schmidt
Fundamental behavior change in
Content Consumption
5
11/26/2013

6. All About the User
What are you trying to deliver to
your end user?
Sample video
How do we deliver features, quality
and consistent user experience on
mobiles and tablets?
6
11/26/2013

7. Mobile User Experience
• User experience based on use case
– Is Video is central to experience or complementary?
– Co-browsing content part of the experience?
– How much control do you want to provide the user?
• Rendering and Layouts
– Fixed vs. Flexible layouts, position, sizing
– Branded backgrounds, personalization skin overlays
– Mid call feature invocation, moderation
7
11/26/2013

8. Example: WebRTC App
PC vs. Tablet
8
11/26/2013

9. Development Options
• Chrome and FF on android devices supported
• Native Apps supported with various SDKs
• IOS and Android can be supported via 3rd party
WebRTC browsers (LiveBoard)
Native WebRTC or adapter.js
WebRTC + SDK development
3rd Party JS / HTML only
3rd Party JS + Native Apps
WebRTC Non RTC
X




X
*
*
Android

iOS
X




*
*
Features Costs / Time
X
One time
X
*
*
3x development
One time (ovx.js)
3x development
* Limited vendors, implementation variations
9
11/26/2013

10. Mobile Constraints
• Mobile CPU and Power limitations
– Software encoding + decoding .... Barely
supported for single stream
– For multiparty, mobile devices cannot
support with NxN or 1xN streams with App or
content processing
• Bandwidth Constraints (3G, 4G)
– Mobile bandwidth are always at a premium
– Each VP8 video stream dynamically adjusts
for max bandwidth at the best quality
S/W VP8 encoder testing on TI OMAP4460:
OS: Ubuntu Linux 3.4.0-1487-omap4
Speed : 1.2GHz (Single Thread) (2400 MIPS)
Encoding Source File Format: YUV4MPEG2
Media Resolution :W1280 H720
Testing Result: Average 6.5 fps
Software: libvpx version 1.0.0
• Reachability, Screen real estate
10
11/26/2013

11. To Cloud or Not?
Peer to Peer
Cloud MCU
Mixer
Platform
wrappers
Hybrid
Chrome or
adapter.js
Cloud MCU
Router
Platform
wrappers
Direct
Cloud / Network
Cloud / Network
Hybrid
BYO
Included
Included
Mixed
Group (UL x DL)
N-1 x N-1
1 x N-1
1x1
On Demand
Mobile Delivery
Inconsistent
Limited
Optimized
On Demand
Features –
Recording, SIP etc.
Not Available
Platform
Dependent
Platform
Dependent
On Demand
APIs
Media Routing
STUN/TURN
Mixed
11
11/26/2013

12. Group over Mobile
• Mobile Environment
– Multiple streams on same session contend for
resources, making it impractical to support on
mobile device
– Resolutions, frame rate stability vs. a constant
battle to the top
– Video sustainability, downgrade to audio
• Developing with Cloud MCU
– Video complexity moved to cloud and
wrapped in JS, SDK, API
– “Meet-me” bridge concept
– Abstraction to a Session ID
Sample Code using OVX.JS
<script src="js/ovx.js?v4"></script>
<script>
….
….
function placeCall()
{
……
……
/* Unique Session ID */
OVX.Session.setId(document.getElementById("groupname").value);
OVX.Session.start();
}
12
11/26/2013

13. Enterprise Apps
• Most serious use of real-time audio and video sessions in Enterprise
verticals require audit and archiving
Sample Code using OVX.JS
– Client side recording may be done on PC/Mac
– It is impractical to do that on mobile device
OVX.Session.recordStart();
OVX.Session.recordStop();
• Streaming used in consumer sharing apps and enterprise collaboration
– Scalable simulcasting of active conferences requires anchor and media
processing
• Global and Enterprise connectivity important for reach
– Need to transcode and anchor call on to a gateway for connectivity
Cloud / Network becomes critical to deliver features
for Enterprise adoption on mobiles and tablets
13
11/26/2013

14. Conclusion
• WebRTC is about behavior change in App or Content
Consumption
• Define the long term feature and performance
requirements
• Cloud MCU provides the most optimal solution for
multi-party, multi-platform, feature rich video
communications over mobile
14
11/26/2013

15. Contact OpenClove
• WebRTC Apps: http://ovx.me
• iOS and Android WebRTC Browser: http://liveboard.me
• Developer portal: http://developer.openclove.com
• WebRTC EXPO Booth #500
• marketing@openclove.com
15
11/26/2013