The Web of Things (WoT) aims to extend the Web into the physical world by promoting the adoption of Web protocols by situated services and smart objects (ambient artifacts). However, real-world ambient artifacts often adopt proprietary and/or non-Web protocols, making them invisible to Web search engines and inaccessible to conventional Web agents. Smart Gateways have been proposed as a way to “Web-enable” proprietary ambient artifacts through intermediary proxy nodes; however, the requisite infrastructure is difficult to deploy at Web scale. To address such challenges, we are developing Ambient Dynamix (Dynamix): a plug-and-play context framework for mobile devices, which enables Web agents to interoperate with non-Web ambient artifacts – directly from the browser. In this paper, we describe how Dynamix can be used to transform the user’s device into an ad-hoc Smart Gateway in-situ, enabling Web applications (in the device’s browser) to seamlessly interact with non-Web ambient artifacts in the physical environment. We describe an operational prototype implementation, which enables Web apps to discover and control nearby UPnP and AirPlay media devices uniformly. We also present a performance evaluation that indicates the prototype imposes low processing and memory overhead, and is suitable for deployment on many commodity mobile devices.

1. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
An Ad-hoc Smart Gateway Platform for
the Web of Things
Darren Carlson1
, Bashar Altakrouri2
and Andreas Schrader2
1
Felicitous Computing Institute / National University of Singapore
2
Ambient Computing Group / University of Luebeck
This presentation includes graphics from the Crystal Project, which is released under the LGPL license.

2. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Motivation 1/2
Local Link Communications
Locked
Web Proxy
Web-proxied
Devices
Locked
Web Proxy
Dual-mode
Devices
Wireless
Sensors
INTERNET
WLAN, PAN
Networked Media
Devices
Sensor/Actor
Networks
Non-Web Non-Web, Prop. I/OProp. I/O Prop. I/O, Web locked Web locked

3. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Motivation 2/2
DLNA
Projector
Local Media
Server
CDNs
Router
Internet
Local link
Streaming
Servers
Nexus 7
Browser-based Web App Media Center
Laptop
Web
Browser
Apple
TV

4. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Context-awareness Challenges
4
Social Proximity
and Networks
Advanced Context Sensing and Actuations
User
Activity
Unproxied
Sensor Networks
Biotelemetry
Data
Indoor
Positioning
Others…
Ad-hoc
Interactions
External
Sensors
Sensor
Fusion
Browser-based Web Apps Can’t see the Internet of Things
IoT

5. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Introducing Ambient Dynamix
5
Dynamix adapts the
user’s device to the
environment using
plug-ins
Dynamix provides
simple means for
apps to request
context support
Dynamix is a plug-and-play context framework that helps applications sense and adapt to
the user’s continuously evolving situation and requirements
Community-based approach with 3rd
party API support
Plug-ins are provisioned
to the device at runtime
(network or file system)
Includes a scalable
infrastructure for
sharing plug-ins
Domain experts
create context
plug-ins

6. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Ambient Dynamix Overview (1/2)
6
Context domain expertise is
packaged into plug-ins
Plug-ins are dynamically
provisioned at runtime
A Dynamix app
requests context
support

7. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Ambient Dynamix Overview (2/2)
77
Browser-based Apps
Dynamix WebDynamix Web
Web Server
Dynamix Plug-in
Repository
Plug-ins
HTML, CSS,
JavaScript
Dynamix Web Extension
Browser
Based!
Context-aware
Web apps

8. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Example Dynamix Plug-ins
Context Plug-in
Power-aware Location, NFC, Beacon, Orientation, and Photodetector Plug-ins
ArtNet Plug-in (ad-hoc discovery/control of DMX automation equipment)
Acoustic Fingerprint Plug-in (Native Code Integration)
Speech Recognition Plug-in
Sound Pressure Level Plug-in (Ambient Sound Detector)
Sleep State Plug-in (Zeo Mobile)
Heart-rate Biotelemetry Plug-in (Zephyr Sensors)
OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist)
Barcode Scanner Plug-in (ZXing port)
Ambient Media Device Discovery and Control (UPnP & AirPlay)
Weight and BMI Measurement Plug-in (Supports Withings Wireless Scales)
Pedometer with Step Force Plug-in 8
Many more plug-ins in development!Many more plug-ins in development!

9. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Dynamix Device
Towards an Ad-hoc Smart Gateway Platform 1/2
9
Ambient Media
Plug-in
Unified Interface (RTSP-based)
Addressing: DHCP/IPv4LL
Discovery: SSDP
Description: XML
Control: XML/SOAP
Addressing: DHCP/IPv4LL
Discovery: mDNS/DNS-SD
Description: DNS SRV, TXT,
PTR
Control: REST
Service Protocol Domain 1 Service Protocol Domain 2
Runtime Installation
Web app Support
Ad-hoc Protocol
Gateway

10. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Towards an Ad-hoc Smart Gateway Platform 2/2
10
UPnP
Device
AirPlay
Device
Device (AirPlay):
97069172aa702ca8f0
9ba68715cfcb90f
Device (AirPlay):
97069172aa702ca8f0
9ba68715cfcb90f
Play URI: http://test.com/image.jpg
Target Device (AirPlay):
97069172aa702ca8f09ba68715cfcb90f
Play URI: http://test.com/image.jpg
Target Device (AirPlay):
97069172aa702ca8f09ba68715cfcb90f
Device (UPnP):
a4a4960f401821f31c0
6813ba3d09b78
Device (UPnP):
a4a4960f401821f31c0
6813ba3d09b78
Request Routing
97069172aa702ca8f09ba687
15cfcb90f
Protocol-specific
Request Handling
Unified Interface
Media
Playback
Future Work:
Split Protocol
Support into
Multiple Plug-ins

11. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Enhanced Share to Screen Web Application
11
Dynamix Framework
Background Service
UPnP & Airplay Devices
Facebook
Servers
App Server
Plug-in
Repository
Web Content and
Image Content
Web Content and
Dynamix JavaScript
Dynamix Plug-ins:
Ambient Media
and ArtNet
Tapping Dims the Lights
& Displays Media on the
Selected Media Device
ArtNet Light System

12. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Demo Scenario and Testbed
12
Demo Scenario and Testbed

13. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 1/3
13
CPU Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization

14. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 2/3
14
Heap Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization

15. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 3/3
15
Overview of OSGi Memory Usage Before and
After Plug-in Installation and Initialization
Steady-state Performance (CPU & Heap)

16. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Join Us!
16
Plug-in Development
App Development
Framework Development
Native Apps Web Apps
• Inter Plug-in Communications
• Mobile Security
• Client Interface
• Advanced Topics (Ambient Web)

17. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
17
Thank You!
Q&A